00:00:00.000 Started by upstream project "autotest-nightly-lts" build number 2414 00:00:00.000 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3675 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.199 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.200 The recommended git tool is: git 00:00:00.200 using credential 00000000-0000-0000-0000-000000000002 00:00:00.202 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.217 Fetching changes from the remote Git repository 00:00:00.219 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.234 Using shallow fetch with depth 1 00:00:00.235 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.235 > git --version # timeout=10 00:00:00.258 > git --version # 'git version 2.39.2' 00:00:00.258 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.277 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.277 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.574 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.585 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.595 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:05.595 > git config core.sparsecheckout # timeout=10 00:00:05.607 > git read-tree -mu HEAD # timeout=10 00:00:05.622 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:05.645 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:05.645 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:05.724 [Pipeline] Start of Pipeline 00:00:05.735 [Pipeline] library 00:00:05.737 Loading library shm_lib@master 00:00:05.737 Library shm_lib@master is cached. Copying from home. 00:00:05.751 [Pipeline] node 00:00:05.759 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.760 [Pipeline] { 00:00:05.768 [Pipeline] catchError 00:00:05.769 [Pipeline] { 00:00:05.779 [Pipeline] wrap 00:00:05.786 [Pipeline] { 00:00:05.792 [Pipeline] stage 00:00:05.793 [Pipeline] { (Prologue) 00:00:05.984 [Pipeline] sh 00:00:06.264 + logger -p user.info -t JENKINS-CI 00:00:06.284 [Pipeline] echo 00:00:06.286 Node: GP11 00:00:06.296 [Pipeline] sh 00:00:06.596 [Pipeline] setCustomBuildProperty 00:00:06.606 [Pipeline] echo 00:00:06.607 Cleanup processes 00:00:06.611 [Pipeline] sh 00:00:06.891 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.891 3608347 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.905 [Pipeline] sh 00:00:07.188 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.188 ++ grep -v 'sudo pgrep' 00:00:07.188 ++ awk '{print $1}' 00:00:07.188 + sudo kill -9 00:00:07.188 + true 00:00:07.207 [Pipeline] cleanWs 00:00:07.217 [WS-CLEANUP] Deleting project workspace... 00:00:07.217 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.224 [WS-CLEANUP] done 00:00:07.228 [Pipeline] setCustomBuildProperty 00:00:07.242 [Pipeline] sh 00:00:07.526 + sudo git config --global --replace-all safe.directory '*' 00:00:07.619 [Pipeline] httpRequest 00:00:07.971 [Pipeline] echo 00:00:07.972 Sorcerer 10.211.164.20 is alive 00:00:07.981 [Pipeline] retry 00:00:07.983 [Pipeline] { 00:00:07.999 [Pipeline] httpRequest 00:00:08.003 HttpMethod: GET 00:00:08.004 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.004 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.007 Response Code: HTTP/1.1 200 OK 00:00:08.008 Success: Status code 200 is in the accepted range: 200,404 00:00:08.008 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.581 [Pipeline] } 00:00:09.599 [Pipeline] // retry 00:00:09.607 [Pipeline] sh 00:00:09.889 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.909 [Pipeline] httpRequest 00:00:10.270 [Pipeline] echo 00:00:10.272 Sorcerer 10.211.164.20 is alive 00:00:10.283 [Pipeline] retry 00:00:10.286 [Pipeline] { 00:00:10.303 [Pipeline] httpRequest 00:00:10.308 HttpMethod: GET 00:00:10.309 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:10.310 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:10.328 Response Code: HTTP/1.1 200 OK 00:00:10.329 Success: Status code 200 is in the accepted range: 200,404 00:00:10.329 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:40.472 [Pipeline] } 00:00:40.490 [Pipeline] // retry 00:00:40.499 [Pipeline] sh 00:00:40.780 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:43.322 [Pipeline] sh 00:00:43.599 + git -C spdk log --oneline -n5 00:00:43.600 c13c99a5e test: Various fixes for Fedora40 00:00:43.600 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:00:43.600 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:00:43.600 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:00:43.600 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:00:43.609 [Pipeline] } 00:00:43.624 [Pipeline] // stage 00:00:43.634 [Pipeline] stage 00:00:43.636 [Pipeline] { (Prepare) 00:00:43.655 [Pipeline] writeFile 00:00:43.674 [Pipeline] sh 00:00:43.956 + logger -p user.info -t JENKINS-CI 00:00:43.967 [Pipeline] sh 00:00:44.242 + logger -p user.info -t JENKINS-CI 00:00:44.254 [Pipeline] sh 00:00:44.536 + cat autorun-spdk.conf 00:00:44.536 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:44.536 SPDK_TEST_NVMF=1 00:00:44.536 SPDK_TEST_NVME_CLI=1 00:00:44.536 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:44.536 SPDK_TEST_NVMF_NICS=e810 00:00:44.536 SPDK_RUN_UBSAN=1 00:00:44.536 NET_TYPE=phy 00:00:44.543 RUN_NIGHTLY=1 00:00:44.549 [Pipeline] readFile 00:00:44.579 [Pipeline] withEnv 00:00:44.581 [Pipeline] { 00:00:44.593 [Pipeline] sh 00:00:44.870 + set -ex 00:00:44.870 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:00:44.870 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:44.870 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:44.870 ++ SPDK_TEST_NVMF=1 00:00:44.870 ++ SPDK_TEST_NVME_CLI=1 00:00:44.870 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:44.870 ++ SPDK_TEST_NVMF_NICS=e810 00:00:44.870 ++ SPDK_RUN_UBSAN=1 00:00:44.870 ++ NET_TYPE=phy 00:00:44.870 ++ RUN_NIGHTLY=1 00:00:44.870 + case $SPDK_TEST_NVMF_NICS in 00:00:44.870 + DRIVERS=ice 00:00:44.870 + [[ tcp == \r\d\m\a ]] 00:00:44.870 + [[ -n ice ]] 00:00:44.870 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:00:44.870 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:00:44.870 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:00:44.870 rmmod: ERROR: Module irdma is not currently loaded 00:00:44.870 rmmod: ERROR: Module i40iw is not currently loaded 00:00:44.870 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:00:44.870 + true 00:00:44.871 + for D in $DRIVERS 00:00:44.871 + sudo modprobe ice 00:00:44.871 + exit 0 00:00:44.879 [Pipeline] } 00:00:44.896 [Pipeline] // withEnv 00:00:44.901 [Pipeline] } 00:00:44.917 [Pipeline] // stage 00:00:44.925 [Pipeline] catchError 00:00:44.926 [Pipeline] { 00:00:44.941 [Pipeline] timeout 00:00:44.941 Timeout set to expire in 1 hr 0 min 00:00:44.944 [Pipeline] { 00:00:44.959 [Pipeline] stage 00:00:44.961 [Pipeline] { (Tests) 00:00:44.977 [Pipeline] sh 00:00:45.261 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:45.261 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:45.261 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:45.261 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:00:45.261 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:45.261 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:45.261 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:00:45.261 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:45.261 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:45.261 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:45.261 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:00:45.261 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:45.261 + source /etc/os-release 00:00:45.261 ++ NAME='Fedora Linux' 00:00:45.261 ++ VERSION='39 (Cloud Edition)' 00:00:45.261 ++ ID=fedora 00:00:45.261 ++ VERSION_ID=39 00:00:45.261 ++ VERSION_CODENAME= 00:00:45.261 ++ PLATFORM_ID=platform:f39 00:00:45.261 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:00:45.261 ++ ANSI_COLOR='0;38;2;60;110;180' 00:00:45.261 ++ LOGO=fedora-logo-icon 00:00:45.261 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:00:45.261 ++ HOME_URL=https://fedoraproject.org/ 00:00:45.261 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:00:45.261 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:00:45.261 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:00:45.261 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:00:45.261 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:00:45.261 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:00:45.261 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:00:45.261 ++ SUPPORT_END=2024-11-12 00:00:45.261 ++ VARIANT='Cloud Edition' 00:00:45.261 ++ VARIANT_ID=cloud 00:00:45.261 + uname -a 00:00:45.261 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:00:45.261 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:00:46.196 Hugepages 00:00:46.196 node hugesize free / total 00:00:46.196 node0 1048576kB 0 / 0 00:00:46.196 node0 2048kB 0 / 0 00:00:46.196 node1 1048576kB 0 / 0 00:00:46.196 node1 2048kB 0 / 0 00:00:46.196 00:00:46.196 Type BDF Vendor Device NUMA Driver Device Block devices 00:00:46.196 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:00:46.196 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:00:46.196 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:00:46.196 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:00:46.196 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:00:46.196 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:00:46.196 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:00:46.196 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:00:46.196 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:00:46.196 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:00:46.196 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:00:46.196 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:00:46.196 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:00:46.196 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:00:46.196 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:00:46.196 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:00:46.196 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:00:46.196 + rm -f /tmp/spdk-ld-path 00:00:46.196 + source autorun-spdk.conf 00:00:46.196 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:46.196 ++ SPDK_TEST_NVMF=1 00:00:46.196 ++ SPDK_TEST_NVME_CLI=1 00:00:46.196 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:46.196 ++ SPDK_TEST_NVMF_NICS=e810 00:00:46.196 ++ SPDK_RUN_UBSAN=1 00:00:46.196 ++ NET_TYPE=phy 00:00:46.196 ++ RUN_NIGHTLY=1 00:00:46.196 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:00:46.196 + [[ -n '' ]] 00:00:46.196 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:46.196 + for M in /var/spdk/build-*-manifest.txt 00:00:46.196 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:00:46.196 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:46.196 + for M in /var/spdk/build-*-manifest.txt 00:00:46.196 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:00:46.196 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:46.196 + for M in /var/spdk/build-*-manifest.txt 00:00:46.196 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:00:46.196 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:46.196 ++ uname 00:00:46.196 + [[ Linux == \L\i\n\u\x ]] 00:00:46.196 + sudo dmesg -T 00:00:46.196 + sudo dmesg --clear 00:00:46.456 + dmesg_pid=3609010 00:00:46.456 + [[ Fedora Linux == FreeBSD ]] 00:00:46.456 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:46.456 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:46.456 + sudo dmesg -Tw 00:00:46.456 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:00:46.456 + [[ -x /usr/src/fio-static/fio ]] 00:00:46.456 + export FIO_BIN=/usr/src/fio-static/fio 00:00:46.456 + FIO_BIN=/usr/src/fio-static/fio 00:00:46.456 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:00:46.456 + [[ ! -v VFIO_QEMU_BIN ]] 00:00:46.456 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:00:46.456 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:46.456 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:46.456 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:00:46.456 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:46.456 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:46.456 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:46.456 Test configuration: 00:00:46.456 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:46.456 SPDK_TEST_NVMF=1 00:00:46.456 SPDK_TEST_NVME_CLI=1 00:00:46.456 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:46.456 SPDK_TEST_NVMF_NICS=e810 00:00:46.456 SPDK_RUN_UBSAN=1 00:00:46.456 NET_TYPE=phy 00:00:46.456 RUN_NIGHTLY=1 11:25:06 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:00:46.456 11:25:06 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:00:46.456 11:25:06 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:00:46.456 11:25:06 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:00:46.456 11:25:06 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:00:46.456 11:25:06 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:46.456 11:25:06 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:46.456 11:25:06 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:46.456 11:25:06 -- paths/export.sh@5 -- $ export PATH 00:00:46.456 11:25:06 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:46.456 11:25:06 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:00:46.456 11:25:06 -- common/autobuild_common.sh@440 -- $ date +%s 00:00:46.456 11:25:06 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732789506.XXXXXX 00:00:46.456 11:25:06 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732789506.8Zowxy 00:00:46.456 11:25:06 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:00:46.456 11:25:06 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:00:46.456 11:25:06 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:00:46.456 11:25:06 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:00:46.456 11:25:06 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:00:46.456 11:25:06 -- common/autobuild_common.sh@456 -- $ get_config_params 00:00:46.456 11:25:06 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:00:46.456 11:25:06 -- common/autotest_common.sh@10 -- $ set +x 00:00:46.456 11:25:06 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:00:46.456 11:25:06 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:00:46.456 11:25:06 -- spdk/autobuild.sh@12 -- $ umask 022 00:00:46.456 11:25:06 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:46.456 11:25:06 -- spdk/autobuild.sh@16 -- $ date -u 00:00:46.456 Thu Nov 28 10:25:06 AM UTC 2024 00:00:46.456 11:25:06 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:00:46.456 LTS-67-gc13c99a5e 00:00:46.456 11:25:06 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:00:46.456 11:25:06 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:00:46.456 11:25:06 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:00:46.456 11:25:06 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:00:46.456 11:25:06 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:00:46.456 11:25:06 -- common/autotest_common.sh@10 -- $ set +x 00:00:46.456 ************************************ 00:00:46.456 START TEST ubsan 00:00:46.456 ************************************ 00:00:46.456 11:25:06 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:00:46.456 using ubsan 00:00:46.456 00:00:46.456 real 0m0.000s 00:00:46.456 user 0m0.000s 00:00:46.456 sys 0m0.000s 00:00:46.456 11:25:06 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:00:46.456 11:25:06 -- common/autotest_common.sh@10 -- $ set +x 00:00:46.456 ************************************ 00:00:46.456 END TEST ubsan 00:00:46.456 ************************************ 00:00:46.456 11:25:06 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:00:46.456 11:25:06 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:00:46.456 11:25:06 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:00:46.456 11:25:06 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:00:46.456 11:25:06 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:00:46.456 11:25:06 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:00:46.456 11:25:06 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:00:46.456 11:25:06 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:00:46.456 11:25:06 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:00:46.456 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:00:46.456 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:00:46.715 Using 'verbs' RDMA provider 00:00:57.285 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:07.276 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:07.276 Creating mk/config.mk...done. 00:01:07.276 Creating mk/cc.flags.mk...done. 00:01:07.276 Type 'make' to build. 00:01:07.276 11:25:26 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:07.276 11:25:26 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:07.276 11:25:26 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:07.276 11:25:26 -- common/autotest_common.sh@10 -- $ set +x 00:01:07.277 ************************************ 00:01:07.277 START TEST make 00:01:07.277 ************************************ 00:01:07.277 11:25:26 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:07.277 make[1]: Nothing to be done for 'all'. 00:01:15.417 The Meson build system 00:01:15.417 Version: 1.5.0 00:01:15.417 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:15.417 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:15.417 Build type: native build 00:01:15.418 Program cat found: YES (/usr/bin/cat) 00:01:15.418 Project name: DPDK 00:01:15.418 Project version: 23.11.0 00:01:15.418 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:15.418 C linker for the host machine: cc ld.bfd 2.40-14 00:01:15.418 Host machine cpu family: x86_64 00:01:15.418 Host machine cpu: x86_64 00:01:15.418 Message: ## Building in Developer Mode ## 00:01:15.418 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:15.418 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:15.418 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:15.418 Program python3 found: YES (/usr/bin/python3) 00:01:15.418 Program cat found: YES (/usr/bin/cat) 00:01:15.418 Compiler for C supports arguments -march=native: YES 00:01:15.418 Checking for size of "void *" : 8 00:01:15.418 Checking for size of "void *" : 8 (cached) 00:01:15.418 Library m found: YES 00:01:15.418 Library numa found: YES 00:01:15.418 Has header "numaif.h" : YES 00:01:15.418 Library fdt found: NO 00:01:15.418 Library execinfo found: NO 00:01:15.418 Has header "execinfo.h" : YES 00:01:15.418 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:15.418 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:15.418 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:15.418 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:15.418 Run-time dependency openssl found: YES 3.1.1 00:01:15.418 Run-time dependency libpcap found: YES 1.10.4 00:01:15.418 Has header "pcap.h" with dependency libpcap: YES 00:01:15.418 Compiler for C supports arguments -Wcast-qual: YES 00:01:15.418 Compiler for C supports arguments -Wdeprecated: YES 00:01:15.418 Compiler for C supports arguments -Wformat: YES 00:01:15.418 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:15.418 Compiler for C supports arguments -Wformat-security: NO 00:01:15.418 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:15.418 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:15.418 Compiler for C supports arguments -Wnested-externs: YES 00:01:15.418 Compiler for C supports arguments -Wold-style-definition: YES 00:01:15.418 Compiler for C supports arguments -Wpointer-arith: YES 00:01:15.418 Compiler for C supports arguments -Wsign-compare: YES 00:01:15.418 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:15.418 Compiler for C supports arguments -Wundef: YES 00:01:15.418 Compiler for C supports arguments -Wwrite-strings: YES 00:01:15.418 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:15.418 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:15.418 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:15.418 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:15.418 Program objdump found: YES (/usr/bin/objdump) 00:01:15.418 Compiler for C supports arguments -mavx512f: YES 00:01:15.418 Checking if "AVX512 checking" compiles: YES 00:01:15.418 Fetching value of define "__SSE4_2__" : 1 00:01:15.418 Fetching value of define "__AES__" : 1 00:01:15.418 Fetching value of define "__AVX__" : 1 00:01:15.418 Fetching value of define "__AVX2__" : (undefined) 00:01:15.418 Fetching value of define "__AVX512BW__" : (undefined) 00:01:15.418 Fetching value of define "__AVX512CD__" : (undefined) 00:01:15.418 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:15.418 Fetching value of define "__AVX512F__" : (undefined) 00:01:15.418 Fetching value of define "__AVX512VL__" : (undefined) 00:01:15.418 Fetching value of define "__PCLMUL__" : 1 00:01:15.418 Fetching value of define "__RDRND__" : 1 00:01:15.418 Fetching value of define "__RDSEED__" : (undefined) 00:01:15.418 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:15.418 Fetching value of define "__znver1__" : (undefined) 00:01:15.418 Fetching value of define "__znver2__" : (undefined) 00:01:15.418 Fetching value of define "__znver3__" : (undefined) 00:01:15.418 Fetching value of define "__znver4__" : (undefined) 00:01:15.418 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:15.418 Message: lib/log: Defining dependency "log" 00:01:15.418 Message: lib/kvargs: Defining dependency "kvargs" 00:01:15.418 Message: lib/telemetry: Defining dependency "telemetry" 00:01:15.418 Checking for function "getentropy" : NO 00:01:15.418 Message: lib/eal: Defining dependency "eal" 00:01:15.418 Message: lib/ring: Defining dependency "ring" 00:01:15.418 Message: lib/rcu: Defining dependency "rcu" 00:01:15.418 Message: lib/mempool: Defining dependency "mempool" 00:01:15.418 Message: lib/mbuf: Defining dependency "mbuf" 00:01:15.418 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:15.418 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:15.418 Compiler for C supports arguments -mpclmul: YES 00:01:15.418 Compiler for C supports arguments -maes: YES 00:01:15.418 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:15.418 Compiler for C supports arguments -mavx512bw: YES 00:01:15.418 Compiler for C supports arguments -mavx512dq: YES 00:01:15.418 Compiler for C supports arguments -mavx512vl: YES 00:01:15.418 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:15.418 Compiler for C supports arguments -mavx2: YES 00:01:15.418 Compiler for C supports arguments -mavx: YES 00:01:15.418 Message: lib/net: Defining dependency "net" 00:01:15.418 Message: lib/meter: Defining dependency "meter" 00:01:15.418 Message: lib/ethdev: Defining dependency "ethdev" 00:01:15.418 Message: lib/pci: Defining dependency "pci" 00:01:15.418 Message: lib/cmdline: Defining dependency "cmdline" 00:01:15.418 Message: lib/hash: Defining dependency "hash" 00:01:15.418 Message: lib/timer: Defining dependency "timer" 00:01:15.418 Message: lib/compressdev: Defining dependency "compressdev" 00:01:15.418 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:15.418 Message: lib/dmadev: Defining dependency "dmadev" 00:01:15.418 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:15.418 Message: lib/power: Defining dependency "power" 00:01:15.418 Message: lib/reorder: Defining dependency "reorder" 00:01:15.418 Message: lib/security: Defining dependency "security" 00:01:15.418 Has header "linux/userfaultfd.h" : YES 00:01:15.418 Has header "linux/vduse.h" : YES 00:01:15.418 Message: lib/vhost: Defining dependency "vhost" 00:01:15.418 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:15.418 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:15.418 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:15.418 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:15.418 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:15.418 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:15.418 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:15.418 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:15.418 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:15.418 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:15.418 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:15.418 Configuring doxy-api-html.conf using configuration 00:01:15.418 Configuring doxy-api-man.conf using configuration 00:01:15.418 Program mandb found: YES (/usr/bin/mandb) 00:01:15.418 Program sphinx-build found: NO 00:01:15.418 Configuring rte_build_config.h using configuration 00:01:15.418 Message: 00:01:15.418 ================= 00:01:15.418 Applications Enabled 00:01:15.418 ================= 00:01:15.418 00:01:15.418 apps: 00:01:15.418 00:01:15.418 00:01:15.418 Message: 00:01:15.418 ================= 00:01:15.418 Libraries Enabled 00:01:15.418 ================= 00:01:15.418 00:01:15.418 libs: 00:01:15.418 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:15.418 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:15.418 cryptodev, dmadev, power, reorder, security, vhost, 00:01:15.418 00:01:15.418 Message: 00:01:15.418 =============== 00:01:15.418 Drivers Enabled 00:01:15.418 =============== 00:01:15.418 00:01:15.418 common: 00:01:15.418 00:01:15.418 bus: 00:01:15.418 pci, vdev, 00:01:15.418 mempool: 00:01:15.418 ring, 00:01:15.418 dma: 00:01:15.418 00:01:15.418 net: 00:01:15.418 00:01:15.418 crypto: 00:01:15.418 00:01:15.418 compress: 00:01:15.418 00:01:15.418 vdpa: 00:01:15.418 00:01:15.418 00:01:15.418 Message: 00:01:15.418 ================= 00:01:15.418 Content Skipped 00:01:15.418 ================= 00:01:15.418 00:01:15.418 apps: 00:01:15.418 dumpcap: explicitly disabled via build config 00:01:15.418 graph: explicitly disabled via build config 00:01:15.418 pdump: explicitly disabled via build config 00:01:15.418 proc-info: explicitly disabled via build config 00:01:15.418 test-acl: explicitly disabled via build config 00:01:15.418 test-bbdev: explicitly disabled via build config 00:01:15.418 test-cmdline: explicitly disabled via build config 00:01:15.418 test-compress-perf: explicitly disabled via build config 00:01:15.418 test-crypto-perf: explicitly disabled via build config 00:01:15.418 test-dma-perf: explicitly disabled via build config 00:01:15.418 test-eventdev: explicitly disabled via build config 00:01:15.418 test-fib: explicitly disabled via build config 00:01:15.418 test-flow-perf: explicitly disabled via build config 00:01:15.418 test-gpudev: explicitly disabled via build config 00:01:15.419 test-mldev: explicitly disabled via build config 00:01:15.419 test-pipeline: explicitly disabled via build config 00:01:15.419 test-pmd: explicitly disabled via build config 00:01:15.419 test-regex: explicitly disabled via build config 00:01:15.419 test-sad: explicitly disabled via build config 00:01:15.419 test-security-perf: explicitly disabled via build config 00:01:15.419 00:01:15.419 libs: 00:01:15.419 metrics: explicitly disabled via build config 00:01:15.419 acl: explicitly disabled via build config 00:01:15.419 bbdev: explicitly disabled via build config 00:01:15.419 bitratestats: explicitly disabled via build config 00:01:15.419 bpf: explicitly disabled via build config 00:01:15.419 cfgfile: explicitly disabled via build config 00:01:15.419 distributor: explicitly disabled via build config 00:01:15.419 efd: explicitly disabled via build config 00:01:15.419 eventdev: explicitly disabled via build config 00:01:15.419 dispatcher: explicitly disabled via build config 00:01:15.419 gpudev: explicitly disabled via build config 00:01:15.419 gro: explicitly disabled via build config 00:01:15.419 gso: explicitly disabled via build config 00:01:15.419 ip_frag: explicitly disabled via build config 00:01:15.419 jobstats: explicitly disabled via build config 00:01:15.419 latencystats: explicitly disabled via build config 00:01:15.419 lpm: explicitly disabled via build config 00:01:15.419 member: explicitly disabled via build config 00:01:15.419 pcapng: explicitly disabled via build config 00:01:15.419 rawdev: explicitly disabled via build config 00:01:15.419 regexdev: explicitly disabled via build config 00:01:15.419 mldev: explicitly disabled via build config 00:01:15.419 rib: explicitly disabled via build config 00:01:15.419 sched: explicitly disabled via build config 00:01:15.419 stack: explicitly disabled via build config 00:01:15.419 ipsec: explicitly disabled via build config 00:01:15.419 pdcp: explicitly disabled via build config 00:01:15.419 fib: explicitly disabled via build config 00:01:15.419 port: explicitly disabled via build config 00:01:15.419 pdump: explicitly disabled via build config 00:01:15.419 table: explicitly disabled via build config 00:01:15.419 pipeline: explicitly disabled via build config 00:01:15.419 graph: explicitly disabled via build config 00:01:15.419 node: explicitly disabled via build config 00:01:15.419 00:01:15.419 drivers: 00:01:15.419 common/cpt: not in enabled drivers build config 00:01:15.419 common/dpaax: not in enabled drivers build config 00:01:15.419 common/iavf: not in enabled drivers build config 00:01:15.419 common/idpf: not in enabled drivers build config 00:01:15.419 common/mvep: not in enabled drivers build config 00:01:15.419 common/octeontx: not in enabled drivers build config 00:01:15.419 bus/auxiliary: not in enabled drivers build config 00:01:15.419 bus/cdx: not in enabled drivers build config 00:01:15.419 bus/dpaa: not in enabled drivers build config 00:01:15.419 bus/fslmc: not in enabled drivers build config 00:01:15.419 bus/ifpga: not in enabled drivers build config 00:01:15.419 bus/platform: not in enabled drivers build config 00:01:15.419 bus/vmbus: not in enabled drivers build config 00:01:15.419 common/cnxk: not in enabled drivers build config 00:01:15.419 common/mlx5: not in enabled drivers build config 00:01:15.419 common/nfp: not in enabled drivers build config 00:01:15.419 common/qat: not in enabled drivers build config 00:01:15.419 common/sfc_efx: not in enabled drivers build config 00:01:15.419 mempool/bucket: not in enabled drivers build config 00:01:15.419 mempool/cnxk: not in enabled drivers build config 00:01:15.419 mempool/dpaa: not in enabled drivers build config 00:01:15.419 mempool/dpaa2: not in enabled drivers build config 00:01:15.419 mempool/octeontx: not in enabled drivers build config 00:01:15.419 mempool/stack: not in enabled drivers build config 00:01:15.419 dma/cnxk: not in enabled drivers build config 00:01:15.419 dma/dpaa: not in enabled drivers build config 00:01:15.419 dma/dpaa2: not in enabled drivers build config 00:01:15.419 dma/hisilicon: not in enabled drivers build config 00:01:15.419 dma/idxd: not in enabled drivers build config 00:01:15.419 dma/ioat: not in enabled drivers build config 00:01:15.419 dma/skeleton: not in enabled drivers build config 00:01:15.419 net/af_packet: not in enabled drivers build config 00:01:15.419 net/af_xdp: not in enabled drivers build config 00:01:15.419 net/ark: not in enabled drivers build config 00:01:15.419 net/atlantic: not in enabled drivers build config 00:01:15.419 net/avp: not in enabled drivers build config 00:01:15.419 net/axgbe: not in enabled drivers build config 00:01:15.419 net/bnx2x: not in enabled drivers build config 00:01:15.419 net/bnxt: not in enabled drivers build config 00:01:15.419 net/bonding: not in enabled drivers build config 00:01:15.419 net/cnxk: not in enabled drivers build config 00:01:15.419 net/cpfl: not in enabled drivers build config 00:01:15.419 net/cxgbe: not in enabled drivers build config 00:01:15.419 net/dpaa: not in enabled drivers build config 00:01:15.419 net/dpaa2: not in enabled drivers build config 00:01:15.419 net/e1000: not in enabled drivers build config 00:01:15.419 net/ena: not in enabled drivers build config 00:01:15.419 net/enetc: not in enabled drivers build config 00:01:15.419 net/enetfec: not in enabled drivers build config 00:01:15.419 net/enic: not in enabled drivers build config 00:01:15.419 net/failsafe: not in enabled drivers build config 00:01:15.419 net/fm10k: not in enabled drivers build config 00:01:15.419 net/gve: not in enabled drivers build config 00:01:15.419 net/hinic: not in enabled drivers build config 00:01:15.419 net/hns3: not in enabled drivers build config 00:01:15.419 net/i40e: not in enabled drivers build config 00:01:15.419 net/iavf: not in enabled drivers build config 00:01:15.419 net/ice: not in enabled drivers build config 00:01:15.419 net/idpf: not in enabled drivers build config 00:01:15.419 net/igc: not in enabled drivers build config 00:01:15.419 net/ionic: not in enabled drivers build config 00:01:15.419 net/ipn3ke: not in enabled drivers build config 00:01:15.419 net/ixgbe: not in enabled drivers build config 00:01:15.419 net/mana: not in enabled drivers build config 00:01:15.419 net/memif: not in enabled drivers build config 00:01:15.419 net/mlx4: not in enabled drivers build config 00:01:15.419 net/mlx5: not in enabled drivers build config 00:01:15.419 net/mvneta: not in enabled drivers build config 00:01:15.419 net/mvpp2: not in enabled drivers build config 00:01:15.419 net/netvsc: not in enabled drivers build config 00:01:15.419 net/nfb: not in enabled drivers build config 00:01:15.419 net/nfp: not in enabled drivers build config 00:01:15.419 net/ngbe: not in enabled drivers build config 00:01:15.419 net/null: not in enabled drivers build config 00:01:15.419 net/octeontx: not in enabled drivers build config 00:01:15.419 net/octeon_ep: not in enabled drivers build config 00:01:15.419 net/pcap: not in enabled drivers build config 00:01:15.419 net/pfe: not in enabled drivers build config 00:01:15.419 net/qede: not in enabled drivers build config 00:01:15.419 net/ring: not in enabled drivers build config 00:01:15.419 net/sfc: not in enabled drivers build config 00:01:15.419 net/softnic: not in enabled drivers build config 00:01:15.419 net/tap: not in enabled drivers build config 00:01:15.419 net/thunderx: not in enabled drivers build config 00:01:15.419 net/txgbe: not in enabled drivers build config 00:01:15.419 net/vdev_netvsc: not in enabled drivers build config 00:01:15.419 net/vhost: not in enabled drivers build config 00:01:15.419 net/virtio: not in enabled drivers build config 00:01:15.419 net/vmxnet3: not in enabled drivers build config 00:01:15.419 raw/*: missing internal dependency, "rawdev" 00:01:15.419 crypto/armv8: not in enabled drivers build config 00:01:15.419 crypto/bcmfs: not in enabled drivers build config 00:01:15.419 crypto/caam_jr: not in enabled drivers build config 00:01:15.419 crypto/ccp: not in enabled drivers build config 00:01:15.419 crypto/cnxk: not in enabled drivers build config 00:01:15.419 crypto/dpaa_sec: not in enabled drivers build config 00:01:15.419 crypto/dpaa2_sec: not in enabled drivers build config 00:01:15.419 crypto/ipsec_mb: not in enabled drivers build config 00:01:15.419 crypto/mlx5: not in enabled drivers build config 00:01:15.419 crypto/mvsam: not in enabled drivers build config 00:01:15.419 crypto/nitrox: not in enabled drivers build config 00:01:15.419 crypto/null: not in enabled drivers build config 00:01:15.419 crypto/octeontx: not in enabled drivers build config 00:01:15.419 crypto/openssl: not in enabled drivers build config 00:01:15.419 crypto/scheduler: not in enabled drivers build config 00:01:15.419 crypto/uadk: not in enabled drivers build config 00:01:15.419 crypto/virtio: not in enabled drivers build config 00:01:15.419 compress/isal: not in enabled drivers build config 00:01:15.419 compress/mlx5: not in enabled drivers build config 00:01:15.419 compress/octeontx: not in enabled drivers build config 00:01:15.419 compress/zlib: not in enabled drivers build config 00:01:15.419 regex/*: missing internal dependency, "regexdev" 00:01:15.419 ml/*: missing internal dependency, "mldev" 00:01:15.419 vdpa/ifc: not in enabled drivers build config 00:01:15.419 vdpa/mlx5: not in enabled drivers build config 00:01:15.419 vdpa/nfp: not in enabled drivers build config 00:01:15.419 vdpa/sfc: not in enabled drivers build config 00:01:15.419 event/*: missing internal dependency, "eventdev" 00:01:15.419 baseband/*: missing internal dependency, "bbdev" 00:01:15.419 gpu/*: missing internal dependency, "gpudev" 00:01:15.419 00:01:15.419 00:01:15.678 Build targets in project: 85 00:01:15.678 00:01:15.678 DPDK 23.11.0 00:01:15.678 00:01:15.678 User defined options 00:01:15.678 buildtype : debug 00:01:15.678 default_library : shared 00:01:15.678 libdir : lib 00:01:15.678 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:15.678 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:15.678 c_link_args : 00:01:15.678 cpu_instruction_set: native 00:01:15.678 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:15.678 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:15.678 enable_docs : false 00:01:15.678 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:15.678 enable_kmods : false 00:01:15.678 tests : false 00:01:15.678 00:01:15.678 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:16.251 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:16.251 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:16.251 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:16.251 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:16.251 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:16.251 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:16.251 [6/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:16.251 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:16.251 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:16.251 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:16.251 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:16.251 [11/265] Linking static target lib/librte_kvargs.a 00:01:16.251 [12/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:16.251 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:16.513 [14/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:16.513 [15/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:16.513 [16/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:16.513 [17/265] Linking static target lib/librte_log.a 00:01:16.513 [18/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:16.513 [19/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:16.513 [20/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:16.776 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:17.038 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.038 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:17.301 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:17.301 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:17.301 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:17.301 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:17.301 [28/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:17.301 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:17.301 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:17.301 [31/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:17.301 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:17.301 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:17.301 [34/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:17.301 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:17.301 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:17.301 [37/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:17.301 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:17.301 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:17.301 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:17.301 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:17.301 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:17.301 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:17.301 [44/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:17.301 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:17.301 [46/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:17.301 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:17.301 [48/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:17.301 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:17.301 [50/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:17.301 [51/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:17.301 [52/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:17.301 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:17.301 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:17.301 [55/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:17.301 [56/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:17.301 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:17.301 [58/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:17.301 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:17.301 [60/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:17.301 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:17.301 [62/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:17.301 [63/265] Linking static target lib/librte_telemetry.a 00:01:17.565 [64/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.565 [65/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:17.565 [66/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:17.565 [67/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:17.565 [68/265] Linking target lib/librte_log.so.24.0 00:01:17.565 [69/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:17.565 [70/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:17.565 [71/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:17.565 [72/265] Linking static target lib/librte_pci.a 00:01:17.565 [73/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:17.565 [74/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:17.826 [75/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:17.826 [76/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:17.826 [77/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:17.826 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:17.826 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:17.826 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:17.826 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:17.826 [82/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:17.826 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:17.826 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:17.826 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:17.826 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:17.826 [87/265] Linking target lib/librte_kvargs.so.24.0 00:01:17.826 [88/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:18.088 [89/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:18.088 [90/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:18.089 [91/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:18.089 [92/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:18.089 [93/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:18.089 [94/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:18.089 [95/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:18.089 [96/265] Linking static target lib/librte_ring.a 00:01:18.089 [97/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:18.089 [98/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:18.089 [99/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:18.354 [100/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.354 [101/265] Linking static target lib/librte_meter.a 00:01:18.354 [102/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:18.354 [103/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:18.354 [104/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:18.354 [105/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:18.354 [106/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:18.354 [107/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:18.354 [108/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:18.354 [109/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:18.354 [110/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:18.354 [111/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:18.354 [112/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:18.354 [113/265] Linking static target lib/librte_eal.a 00:01:18.354 [114/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:18.354 [115/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.354 [116/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:18.354 [117/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:18.354 [118/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:18.354 [119/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:18.354 [120/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:18.354 [121/265] Linking static target lib/librte_rcu.a 00:01:18.619 [122/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:18.619 [123/265] Linking target lib/librte_telemetry.so.24.0 00:01:18.619 [124/265] Linking static target lib/librte_mempool.a 00:01:18.619 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:18.619 [126/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:18.619 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:18.619 [128/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:18.619 [129/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:18.619 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:18.619 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:18.619 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:18.619 [133/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:18.887 [134/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:18.887 [135/265] Linking static target lib/librte_cmdline.a 00:01:18.887 [136/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:18.887 [137/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:18.887 [138/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.887 [139/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.887 [140/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:18.887 [141/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:18.887 [142/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:18.887 [143/265] Linking static target lib/librte_net.a 00:01:18.887 [144/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:18.887 [145/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:18.887 [146/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:18.887 [147/265] Linking static target lib/librte_timer.a 00:01:19.149 [148/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:19.149 [149/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:19.149 [150/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.149 [151/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:19.149 [152/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:19.149 [153/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:19.149 [154/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.149 [155/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:19.149 [156/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:19.409 [157/265] Linking static target lib/librte_dmadev.a 00:01:19.409 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:19.409 [159/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:19.409 [160/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:19.409 [161/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:19.409 [162/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.409 [163/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:19.409 [164/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.409 [165/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:19.409 [166/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:19.409 [167/265] Linking static target lib/librte_compressdev.a 00:01:19.409 [168/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:19.667 [169/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:19.667 [170/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:19.667 [171/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:19.667 [172/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:19.667 [173/265] Linking static target lib/librte_hash.a 00:01:19.667 [174/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:19.667 [175/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:19.667 [176/265] Linking static target lib/librte_power.a 00:01:19.667 [177/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:19.667 [178/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:19.667 [179/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:19.667 [180/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:19.667 [181/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.667 [182/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:19.667 [183/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:19.667 [184/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.667 [185/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:19.926 [186/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:19.926 [187/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:19.926 [188/265] Linking static target lib/librte_reorder.a 00:01:19.926 [189/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:19.926 [190/265] Linking static target lib/librte_mbuf.a 00:01:19.926 [191/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:19.926 [192/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:19.926 [193/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:19.926 [194/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:19.926 [195/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:19.926 [196/265] Linking static target drivers/librte_bus_vdev.a 00:01:19.926 [197/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:19.926 [198/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:19.926 [199/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:19.926 [200/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:19.926 [201/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.926 [202/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:19.926 [203/265] Linking static target lib/librte_security.a 00:01:20.185 [204/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.185 [205/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:20.185 [206/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.185 [207/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.185 [208/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:20.185 [209/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.185 [210/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:20.185 [211/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:20.185 [212/265] Linking static target drivers/librte_bus_pci.a 00:01:20.185 [213/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:20.185 [214/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:20.185 [215/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:20.185 [216/265] Linking static target drivers/librte_mempool_ring.a 00:01:20.444 [217/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.444 [218/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.444 [219/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:20.444 [220/265] Linking static target lib/librte_ethdev.a 00:01:20.702 [221/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:20.702 [222/265] Linking static target lib/librte_cryptodev.a 00:01:20.702 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.636 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.012 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:24.913 [226/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.913 [227/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.913 [228/265] Linking target lib/librte_eal.so.24.0 00:01:24.913 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:24.913 [230/265] Linking target lib/librte_ring.so.24.0 00:01:24.913 [231/265] Linking target lib/librte_meter.so.24.0 00:01:24.913 [232/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:24.913 [233/265] Linking target lib/librte_timer.so.24.0 00:01:24.913 [234/265] Linking target lib/librte_pci.so.24.0 00:01:24.913 [235/265] Linking target lib/librte_dmadev.so.24.0 00:01:24.913 [236/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:24.913 [237/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:24.913 [238/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:24.913 [239/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:24.913 [240/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:24.913 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:24.913 [242/265] Linking target lib/librte_mempool.so.24.0 00:01:24.913 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:25.177 [244/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:25.177 [245/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:25.177 [246/265] Linking target lib/librte_mbuf.so.24.0 00:01:25.177 [247/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:25.178 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:25.178 [249/265] Linking target lib/librte_reorder.so.24.0 00:01:25.178 [250/265] Linking target lib/librte_compressdev.so.24.0 00:01:25.178 [251/265] Linking target lib/librte_net.so.24.0 00:01:25.178 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:01:25.441 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:25.441 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:25.441 [255/265] Linking target lib/librte_hash.so.24.0 00:01:25.441 [256/265] Linking target lib/librte_cmdline.so.24.0 00:01:25.441 [257/265] Linking target lib/librte_security.so.24.0 00:01:25.441 [258/265] Linking target lib/librte_ethdev.so.24.0 00:01:25.699 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:25.699 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:25.699 [261/265] Linking target lib/librte_power.so.24.0 00:01:28.236 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:28.236 [263/265] Linking static target lib/librte_vhost.a 00:01:29.170 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.170 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:29.170 INFO: autodetecting backend as ninja 00:01:29.170 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:01:30.105 CC lib/ut_mock/mock.o 00:01:30.105 CC lib/log/log.o 00:01:30.105 CC lib/log/log_flags.o 00:01:30.105 CC lib/log/log_deprecated.o 00:01:30.105 CC lib/ut/ut.o 00:01:30.364 LIB libspdk_ut_mock.a 00:01:30.364 LIB libspdk_log.a 00:01:30.364 SO libspdk_ut_mock.so.5.0 00:01:30.364 LIB libspdk_ut.a 00:01:30.364 SO libspdk_log.so.6.1 00:01:30.364 SO libspdk_ut.so.1.0 00:01:30.364 SYMLINK libspdk_ut_mock.so 00:01:30.364 SYMLINK libspdk_ut.so 00:01:30.364 SYMLINK libspdk_log.so 00:01:30.622 CC lib/ioat/ioat.o 00:01:30.622 CC lib/util/base64.o 00:01:30.622 CXX lib/trace_parser/trace.o 00:01:30.622 CC lib/dma/dma.o 00:01:30.622 CC lib/util/bit_array.o 00:01:30.623 CC lib/util/cpuset.o 00:01:30.623 CC lib/util/crc16.o 00:01:30.623 CC lib/util/crc32.o 00:01:30.623 CC lib/util/crc32c.o 00:01:30.623 CC lib/util/crc32_ieee.o 00:01:30.623 CC lib/util/crc64.o 00:01:30.623 CC lib/util/dif.o 00:01:30.623 CC lib/util/fd.o 00:01:30.623 CC lib/util/file.o 00:01:30.623 CC lib/util/hexlify.o 00:01:30.623 CC lib/util/iov.o 00:01:30.623 CC lib/util/math.o 00:01:30.623 CC lib/util/pipe.o 00:01:30.623 CC lib/util/strerror_tls.o 00:01:30.623 CC lib/util/string.o 00:01:30.623 CC lib/util/uuid.o 00:01:30.623 CC lib/util/fd_group.o 00:01:30.623 CC lib/util/xor.o 00:01:30.623 CC lib/util/zipf.o 00:01:30.623 CC lib/vfio_user/host/vfio_user_pci.o 00:01:30.623 CC lib/vfio_user/host/vfio_user.o 00:01:30.623 LIB libspdk_dma.a 00:01:30.623 SO libspdk_dma.so.3.0 00:01:30.881 SYMLINK libspdk_dma.so 00:01:30.881 LIB libspdk_ioat.a 00:01:30.881 SO libspdk_ioat.so.6.0 00:01:30.881 LIB libspdk_vfio_user.a 00:01:30.881 SO libspdk_vfio_user.so.4.0 00:01:30.881 SYMLINK libspdk_ioat.so 00:01:30.881 SYMLINK libspdk_vfio_user.so 00:01:31.137 LIB libspdk_util.a 00:01:31.137 SO libspdk_util.so.8.0 00:01:31.137 SYMLINK libspdk_util.so 00:01:31.393 CC lib/idxd/idxd.o 00:01:31.393 CC lib/rdma/common.o 00:01:31.393 CC lib/env_dpdk/env.o 00:01:31.393 CC lib/json/json_parse.o 00:01:31.393 CC lib/conf/conf.o 00:01:31.393 CC lib/rdma/rdma_verbs.o 00:01:31.393 CC lib/vmd/vmd.o 00:01:31.393 CC lib/env_dpdk/memory.o 00:01:31.393 CC lib/idxd/idxd_user.o 00:01:31.393 CC lib/json/json_util.o 00:01:31.393 CC lib/idxd/idxd_kernel.o 00:01:31.393 CC lib/env_dpdk/pci.o 00:01:31.393 CC lib/json/json_write.o 00:01:31.393 CC lib/vmd/led.o 00:01:31.393 CC lib/env_dpdk/init.o 00:01:31.393 CC lib/env_dpdk/threads.o 00:01:31.393 CC lib/env_dpdk/pci_ioat.o 00:01:31.393 CC lib/env_dpdk/pci_virtio.o 00:01:31.393 CC lib/env_dpdk/pci_vmd.o 00:01:31.393 CC lib/env_dpdk/pci_idxd.o 00:01:31.393 CC lib/env_dpdk/pci_event.o 00:01:31.393 CC lib/env_dpdk/sigbus_handler.o 00:01:31.394 CC lib/env_dpdk/pci_dpdk.o 00:01:31.394 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:31.394 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:31.394 LIB libspdk_trace_parser.a 00:01:31.394 SO libspdk_trace_parser.so.4.0 00:01:31.651 SYMLINK libspdk_trace_parser.so 00:01:31.651 LIB libspdk_rdma.a 00:01:31.651 LIB libspdk_json.a 00:01:31.651 SO libspdk_rdma.so.5.0 00:01:31.651 LIB libspdk_conf.a 00:01:31.651 SO libspdk_json.so.5.1 00:01:31.651 SO libspdk_conf.so.5.0 00:01:31.651 SYMLINK libspdk_rdma.so 00:01:31.651 SYMLINK libspdk_json.so 00:01:31.651 SYMLINK libspdk_conf.so 00:01:31.910 CC lib/jsonrpc/jsonrpc_server.o 00:01:31.910 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:31.910 CC lib/jsonrpc/jsonrpc_client.o 00:01:31.910 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:31.910 LIB libspdk_idxd.a 00:01:31.910 SO libspdk_idxd.so.11.0 00:01:31.910 SYMLINK libspdk_idxd.so 00:01:31.910 LIB libspdk_vmd.a 00:01:31.910 SO libspdk_vmd.so.5.0 00:01:32.168 SYMLINK libspdk_vmd.so 00:01:32.168 LIB libspdk_jsonrpc.a 00:01:32.168 SO libspdk_jsonrpc.so.5.1 00:01:32.168 SYMLINK libspdk_jsonrpc.so 00:01:32.168 CC lib/rpc/rpc.o 00:01:32.427 LIB libspdk_rpc.a 00:01:32.427 SO libspdk_rpc.so.5.0 00:01:32.427 SYMLINK libspdk_rpc.so 00:01:32.685 CC lib/sock/sock.o 00:01:32.685 CC lib/sock/sock_rpc.o 00:01:32.685 CC lib/trace/trace.o 00:01:32.685 CC lib/notify/notify.o 00:01:32.685 CC lib/trace/trace_flags.o 00:01:32.685 CC lib/notify/notify_rpc.o 00:01:32.685 CC lib/trace/trace_rpc.o 00:01:32.685 LIB libspdk_notify.a 00:01:32.944 SO libspdk_notify.so.5.0 00:01:32.944 LIB libspdk_trace.a 00:01:32.944 SYMLINK libspdk_notify.so 00:01:32.944 SO libspdk_trace.so.9.0 00:01:32.944 SYMLINK libspdk_trace.so 00:01:32.944 LIB libspdk_sock.a 00:01:32.944 SO libspdk_sock.so.8.0 00:01:32.944 CC lib/thread/thread.o 00:01:32.944 CC lib/thread/iobuf.o 00:01:33.203 SYMLINK libspdk_sock.so 00:01:33.203 CC lib/nvme/nvme_ctrlr_cmd.o 00:01:33.203 CC lib/nvme/nvme_ctrlr.o 00:01:33.203 CC lib/nvme/nvme_fabric.o 00:01:33.203 CC lib/nvme/nvme_ns_cmd.o 00:01:33.203 CC lib/nvme/nvme_ns.o 00:01:33.203 CC lib/nvme/nvme_pcie_common.o 00:01:33.203 CC lib/nvme/nvme_pcie.o 00:01:33.203 CC lib/nvme/nvme_qpair.o 00:01:33.203 CC lib/nvme/nvme.o 00:01:33.203 CC lib/nvme/nvme_quirks.o 00:01:33.203 CC lib/nvme/nvme_transport.o 00:01:33.203 CC lib/nvme/nvme_discovery.o 00:01:33.203 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:01:33.203 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:01:33.203 CC lib/nvme/nvme_tcp.o 00:01:33.203 CC lib/nvme/nvme_opal.o 00:01:33.203 CC lib/nvme/nvme_io_msg.o 00:01:33.203 CC lib/nvme/nvme_poll_group.o 00:01:33.203 CC lib/nvme/nvme_zns.o 00:01:33.203 CC lib/nvme/nvme_cuse.o 00:01:33.203 CC lib/nvme/nvme_vfio_user.o 00:01:33.203 CC lib/nvme/nvme_rdma.o 00:01:33.462 LIB libspdk_env_dpdk.a 00:01:33.462 SO libspdk_env_dpdk.so.13.0 00:01:33.721 SYMLINK libspdk_env_dpdk.so 00:01:34.658 LIB libspdk_thread.a 00:01:34.658 SO libspdk_thread.so.9.0 00:01:34.658 SYMLINK libspdk_thread.so 00:01:34.916 CC lib/blob/blobstore.o 00:01:34.916 CC lib/blob/request.o 00:01:34.916 CC lib/virtio/virtio.o 00:01:34.916 CC lib/blob/zeroes.o 00:01:34.916 CC lib/virtio/virtio_vhost_user.o 00:01:34.916 CC lib/blob/blob_bs_dev.o 00:01:34.916 CC lib/virtio/virtio_vfio_user.o 00:01:34.916 CC lib/virtio/virtio_pci.o 00:01:34.916 CC lib/init/json_config.o 00:01:34.916 CC lib/accel/accel.o 00:01:34.916 CC lib/accel/accel_rpc.o 00:01:34.916 CC lib/init/subsystem.o 00:01:34.916 CC lib/accel/accel_sw.o 00:01:34.916 CC lib/init/subsystem_rpc.o 00:01:34.916 CC lib/init/rpc.o 00:01:35.174 LIB libspdk_init.a 00:01:35.174 SO libspdk_init.so.4.0 00:01:35.175 SYMLINK libspdk_init.so 00:01:35.175 LIB libspdk_virtio.a 00:01:35.175 SO libspdk_virtio.so.6.0 00:01:35.175 SYMLINK libspdk_virtio.so 00:01:35.175 CC lib/event/app.o 00:01:35.175 CC lib/event/reactor.o 00:01:35.175 CC lib/event/log_rpc.o 00:01:35.175 CC lib/event/app_rpc.o 00:01:35.175 CC lib/event/scheduler_static.o 00:01:35.432 LIB libspdk_nvme.a 00:01:35.691 SO libspdk_nvme.so.12.0 00:01:35.691 LIB libspdk_event.a 00:01:35.691 SO libspdk_event.so.12.0 00:01:35.691 SYMLINK libspdk_event.so 00:01:35.691 SYMLINK libspdk_nvme.so 00:01:35.949 LIB libspdk_accel.a 00:01:35.949 SO libspdk_accel.so.14.0 00:01:35.949 SYMLINK libspdk_accel.so 00:01:36.207 CC lib/bdev/bdev.o 00:01:36.207 CC lib/bdev/bdev_rpc.o 00:01:36.207 CC lib/bdev/part.o 00:01:36.207 CC lib/bdev/bdev_zone.o 00:01:36.207 CC lib/bdev/scsi_nvme.o 00:01:37.583 LIB libspdk_blob.a 00:01:37.583 SO libspdk_blob.so.10.1 00:01:37.583 SYMLINK libspdk_blob.so 00:01:37.842 CC lib/lvol/lvol.o 00:01:37.842 CC lib/blobfs/blobfs.o 00:01:37.842 CC lib/blobfs/tree.o 00:01:38.786 LIB libspdk_blobfs.a 00:01:38.786 SO libspdk_blobfs.so.9.0 00:01:38.786 LIB libspdk_bdev.a 00:01:38.786 SO libspdk_bdev.so.14.0 00:01:38.786 SYMLINK libspdk_blobfs.so 00:01:38.786 LIB libspdk_lvol.a 00:01:38.786 SO libspdk_lvol.so.9.1 00:01:38.786 SYMLINK libspdk_bdev.so 00:01:38.786 SYMLINK libspdk_lvol.so 00:01:38.786 CC lib/nvmf/ctrlr.o 00:01:38.786 CC lib/ublk/ublk.o 00:01:38.786 CC lib/nvmf/ctrlr_discovery.o 00:01:38.786 CC lib/ublk/ublk_rpc.o 00:01:38.786 CC lib/nbd/nbd.o 00:01:38.786 CC lib/nvmf/ctrlr_bdev.o 00:01:38.786 CC lib/nbd/nbd_rpc.o 00:01:38.786 CC lib/nvmf/subsystem.o 00:01:38.786 CC lib/ftl/ftl_core.o 00:01:38.786 CC lib/nvmf/nvmf.o 00:01:38.786 CC lib/ftl/ftl_init.o 00:01:38.786 CC lib/scsi/dev.o 00:01:38.786 CC lib/nvmf/nvmf_rpc.o 00:01:38.786 CC lib/ftl/ftl_layout.o 00:01:38.786 CC lib/nvmf/transport.o 00:01:38.786 CC lib/ftl/ftl_debug.o 00:01:38.786 CC lib/nvmf/tcp.o 00:01:38.786 CC lib/ftl/ftl_io.o 00:01:38.786 CC lib/scsi/port.o 00:01:38.786 CC lib/nvmf/rdma.o 00:01:38.786 CC lib/scsi/lun.o 00:01:38.786 CC lib/ftl/ftl_sb.o 00:01:38.786 CC lib/scsi/scsi.o 00:01:38.786 CC lib/scsi/scsi_bdev.o 00:01:38.786 CC lib/ftl/ftl_l2p_flat.o 00:01:38.786 CC lib/ftl/ftl_l2p.o 00:01:38.786 CC lib/scsi/scsi_pr.o 00:01:38.787 CC lib/ftl/ftl_nv_cache.o 00:01:38.787 CC lib/scsi/scsi_rpc.o 00:01:38.787 CC lib/ftl/ftl_band.o 00:01:38.787 CC lib/scsi/task.o 00:01:38.787 CC lib/ftl/ftl_band_ops.o 00:01:38.787 CC lib/ftl/ftl_writer.o 00:01:38.787 CC lib/ftl/ftl_rq.o 00:01:38.787 CC lib/ftl/ftl_reloc.o 00:01:38.787 CC lib/ftl/ftl_l2p_cache.o 00:01:38.787 CC lib/ftl/ftl_p2l.o 00:01:38.787 CC lib/ftl/mngt/ftl_mngt.o 00:01:38.787 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:01:38.787 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:01:38.787 CC lib/ftl/mngt/ftl_mngt_startup.o 00:01:38.787 CC lib/ftl/mngt/ftl_mngt_md.o 00:01:38.787 CC lib/ftl/mngt/ftl_mngt_misc.o 00:01:38.787 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:01:38.787 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:01:38.787 CC lib/ftl/mngt/ftl_mngt_band.o 00:01:38.787 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:01:38.787 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:01:39.049 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:01:39.049 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:01:39.049 CC lib/ftl/utils/ftl_conf.o 00:01:39.049 CC lib/ftl/utils/ftl_md.o 00:01:39.049 CC lib/ftl/utils/ftl_mempool.o 00:01:39.308 CC lib/ftl/utils/ftl_bitmap.o 00:01:39.308 CC lib/ftl/utils/ftl_property.o 00:01:39.308 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:01:39.308 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:01:39.308 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:01:39.308 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:01:39.308 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:01:39.308 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:01:39.308 CC lib/ftl/upgrade/ftl_sb_v3.o 00:01:39.308 CC lib/ftl/upgrade/ftl_sb_v5.o 00:01:39.308 CC lib/ftl/nvc/ftl_nvc_dev.o 00:01:39.308 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:01:39.308 CC lib/ftl/base/ftl_base_dev.o 00:01:39.308 CC lib/ftl/base/ftl_base_bdev.o 00:01:39.308 CC lib/ftl/ftl_trace.o 00:01:39.566 LIB libspdk_nbd.a 00:01:39.566 SO libspdk_nbd.so.6.0 00:01:39.566 SYMLINK libspdk_nbd.so 00:01:39.566 LIB libspdk_scsi.a 00:01:39.824 SO libspdk_scsi.so.8.0 00:01:39.824 LIB libspdk_ublk.a 00:01:39.824 SO libspdk_ublk.so.2.0 00:01:39.824 SYMLINK libspdk_scsi.so 00:01:39.824 SYMLINK libspdk_ublk.so 00:01:39.824 CC lib/iscsi/conn.o 00:01:39.824 CC lib/vhost/vhost.o 00:01:39.824 CC lib/iscsi/init_grp.o 00:01:39.824 CC lib/vhost/vhost_rpc.o 00:01:39.824 CC lib/iscsi/iscsi.o 00:01:39.824 CC lib/vhost/vhost_scsi.o 00:01:39.824 CC lib/iscsi/md5.o 00:01:39.824 CC lib/vhost/vhost_blk.o 00:01:39.824 CC lib/iscsi/param.o 00:01:39.824 CC lib/vhost/rte_vhost_user.o 00:01:39.824 CC lib/iscsi/portal_grp.o 00:01:39.824 CC lib/iscsi/tgt_node.o 00:01:39.824 CC lib/iscsi/iscsi_subsystem.o 00:01:39.824 CC lib/iscsi/iscsi_rpc.o 00:01:39.824 CC lib/iscsi/task.o 00:01:40.083 LIB libspdk_ftl.a 00:01:40.341 SO libspdk_ftl.so.8.0 00:01:40.599 SYMLINK libspdk_ftl.so 00:01:41.166 LIB libspdk_vhost.a 00:01:41.166 SO libspdk_vhost.so.7.1 00:01:41.166 SYMLINK libspdk_vhost.so 00:01:41.425 LIB libspdk_iscsi.a 00:01:41.425 LIB libspdk_nvmf.a 00:01:41.425 SO libspdk_iscsi.so.7.0 00:01:41.425 SO libspdk_nvmf.so.17.0 00:01:41.425 SYMLINK libspdk_iscsi.so 00:01:41.425 SYMLINK libspdk_nvmf.so 00:01:41.683 CC module/env_dpdk/env_dpdk_rpc.o 00:01:41.683 CC module/accel/error/accel_error.o 00:01:41.683 CC module/accel/ioat/accel_ioat.o 00:01:41.683 CC module/accel/dsa/accel_dsa.o 00:01:41.683 CC module/accel/error/accel_error_rpc.o 00:01:41.683 CC module/accel/ioat/accel_ioat_rpc.o 00:01:41.683 CC module/accel/dsa/accel_dsa_rpc.o 00:01:41.683 CC module/blob/bdev/blob_bdev.o 00:01:41.683 CC module/accel/iaa/accel_iaa.o 00:01:41.683 CC module/scheduler/gscheduler/gscheduler.o 00:01:41.683 CC module/accel/iaa/accel_iaa_rpc.o 00:01:41.683 CC module/scheduler/dynamic/scheduler_dynamic.o 00:01:41.683 CC module/sock/posix/posix.o 00:01:41.683 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:01:41.941 LIB libspdk_env_dpdk_rpc.a 00:01:41.941 SO libspdk_env_dpdk_rpc.so.5.0 00:01:41.941 SYMLINK libspdk_env_dpdk_rpc.so 00:01:41.941 LIB libspdk_scheduler_gscheduler.a 00:01:41.941 LIB libspdk_scheduler_dpdk_governor.a 00:01:41.941 SO libspdk_scheduler_gscheduler.so.3.0 00:01:41.941 SO libspdk_scheduler_dpdk_governor.so.3.0 00:01:41.941 LIB libspdk_accel_error.a 00:01:41.941 LIB libspdk_accel_ioat.a 00:01:41.941 LIB libspdk_scheduler_dynamic.a 00:01:41.941 SO libspdk_accel_error.so.1.0 00:01:41.941 LIB libspdk_accel_iaa.a 00:01:41.941 SO libspdk_scheduler_dynamic.so.3.0 00:01:41.941 SO libspdk_accel_ioat.so.5.0 00:01:41.941 SYMLINK libspdk_scheduler_gscheduler.so 00:01:41.941 SYMLINK libspdk_scheduler_dpdk_governor.so 00:01:41.941 SO libspdk_accel_iaa.so.2.0 00:01:41.942 LIB libspdk_accel_dsa.a 00:01:41.942 SYMLINK libspdk_accel_error.so 00:01:41.942 SYMLINK libspdk_scheduler_dynamic.so 00:01:41.942 SYMLINK libspdk_accel_ioat.so 00:01:41.942 SO libspdk_accel_dsa.so.4.0 00:01:41.942 LIB libspdk_blob_bdev.a 00:01:41.942 SYMLINK libspdk_accel_iaa.so 00:01:41.942 SO libspdk_blob_bdev.so.10.1 00:01:42.202 SYMLINK libspdk_accel_dsa.so 00:01:42.202 SYMLINK libspdk_blob_bdev.so 00:01:42.202 CC module/bdev/malloc/bdev_malloc.o 00:01:42.202 CC module/bdev/null/bdev_null.o 00:01:42.202 CC module/bdev/lvol/vbdev_lvol.o 00:01:42.202 CC module/bdev/delay/vbdev_delay.o 00:01:42.202 CC module/bdev/gpt/gpt.o 00:01:42.202 CC module/bdev/null/bdev_null_rpc.o 00:01:42.202 CC module/bdev/malloc/bdev_malloc_rpc.o 00:01:42.202 CC module/bdev/nvme/bdev_nvme.o 00:01:42.202 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:01:42.202 CC module/bdev/error/vbdev_error.o 00:01:42.202 CC module/bdev/zone_block/vbdev_zone_block.o 00:01:42.202 CC module/bdev/raid/bdev_raid.o 00:01:42.202 CC module/bdev/delay/vbdev_delay_rpc.o 00:01:42.202 CC module/bdev/nvme/bdev_nvme_rpc.o 00:01:42.202 CC module/bdev/raid/bdev_raid_rpc.o 00:01:42.202 CC module/bdev/gpt/vbdev_gpt.o 00:01:42.202 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:01:42.202 CC module/bdev/nvme/nvme_rpc.o 00:01:42.202 CC module/bdev/error/vbdev_error_rpc.o 00:01:42.202 CC module/bdev/split/vbdev_split.o 00:01:42.202 CC module/bdev/virtio/bdev_virtio_scsi.o 00:01:42.202 CC module/bdev/raid/bdev_raid_sb.o 00:01:42.202 CC module/bdev/nvme/bdev_mdns_client.o 00:01:42.202 CC module/bdev/raid/raid0.o 00:01:42.202 CC module/bdev/raid/raid1.o 00:01:42.202 CC module/bdev/iscsi/bdev_iscsi.o 00:01:42.202 CC module/bdev/nvme/vbdev_opal.o 00:01:42.202 CC module/bdev/virtio/bdev_virtio_rpc.o 00:01:42.202 CC module/bdev/raid/concat.o 00:01:42.202 CC module/bdev/virtio/bdev_virtio_blk.o 00:01:42.202 CC module/bdev/split/vbdev_split_rpc.o 00:01:42.202 CC module/bdev/passthru/vbdev_passthru.o 00:01:42.202 CC module/bdev/ftl/bdev_ftl.o 00:01:42.202 CC module/bdev/aio/bdev_aio.o 00:01:42.202 CC module/bdev/nvme/vbdev_opal_rpc.o 00:01:42.202 CC module/bdev/aio/bdev_aio_rpc.o 00:01:42.202 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:01:42.202 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:01:42.202 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:01:42.202 CC module/bdev/ftl/bdev_ftl_rpc.o 00:01:42.202 CC module/blobfs/bdev/blobfs_bdev.o 00:01:42.202 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:01:42.769 LIB libspdk_sock_posix.a 00:01:42.769 LIB libspdk_blobfs_bdev.a 00:01:42.769 SO libspdk_sock_posix.so.5.0 00:01:42.769 SO libspdk_blobfs_bdev.so.5.0 00:01:42.769 SYMLINK libspdk_blobfs_bdev.so 00:01:42.769 SYMLINK libspdk_sock_posix.so 00:01:42.770 LIB libspdk_bdev_null.a 00:01:42.770 LIB libspdk_bdev_split.a 00:01:42.770 SO libspdk_bdev_null.so.5.0 00:01:42.770 SO libspdk_bdev_split.so.5.0 00:01:42.770 LIB libspdk_bdev_gpt.a 00:01:42.770 LIB libspdk_bdev_error.a 00:01:42.770 LIB libspdk_bdev_ftl.a 00:01:42.770 SYMLINK libspdk_bdev_split.so 00:01:42.770 SYMLINK libspdk_bdev_null.so 00:01:42.770 SO libspdk_bdev_gpt.so.5.0 00:01:42.770 SO libspdk_bdev_error.so.5.0 00:01:42.770 LIB libspdk_bdev_malloc.a 00:01:42.770 SO libspdk_bdev_ftl.so.5.0 00:01:42.770 LIB libspdk_bdev_passthru.a 00:01:42.770 LIB libspdk_bdev_iscsi.a 00:01:42.770 SO libspdk_bdev_malloc.so.5.0 00:01:42.770 LIB libspdk_bdev_aio.a 00:01:42.770 SO libspdk_bdev_passthru.so.5.0 00:01:42.770 SYMLINK libspdk_bdev_gpt.so 00:01:42.770 SO libspdk_bdev_iscsi.so.5.0 00:01:42.770 SYMLINK libspdk_bdev_error.so 00:01:42.770 SO libspdk_bdev_aio.so.5.0 00:01:42.770 LIB libspdk_bdev_zone_block.a 00:01:42.770 SYMLINK libspdk_bdev_ftl.so 00:01:42.770 LIB libspdk_bdev_delay.a 00:01:42.770 SO libspdk_bdev_zone_block.so.5.0 00:01:42.770 SYMLINK libspdk_bdev_passthru.so 00:01:42.770 SYMLINK libspdk_bdev_malloc.so 00:01:42.770 SO libspdk_bdev_delay.so.5.0 00:01:42.770 SYMLINK libspdk_bdev_iscsi.so 00:01:43.092 SYMLINK libspdk_bdev_aio.so 00:01:43.092 SYMLINK libspdk_bdev_zone_block.so 00:01:43.092 SYMLINK libspdk_bdev_delay.so 00:01:43.092 LIB libspdk_bdev_lvol.a 00:01:43.092 LIB libspdk_bdev_virtio.a 00:01:43.092 SO libspdk_bdev_lvol.so.5.0 00:01:43.092 SO libspdk_bdev_virtio.so.5.0 00:01:43.092 SYMLINK libspdk_bdev_lvol.so 00:01:43.092 SYMLINK libspdk_bdev_virtio.so 00:01:43.387 LIB libspdk_bdev_raid.a 00:01:43.387 SO libspdk_bdev_raid.so.5.0 00:01:43.387 SYMLINK libspdk_bdev_raid.so 00:01:44.764 LIB libspdk_bdev_nvme.a 00:01:44.764 SO libspdk_bdev_nvme.so.6.0 00:01:44.764 SYMLINK libspdk_bdev_nvme.so 00:01:44.764 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:01:44.764 CC module/event/subsystems/iobuf/iobuf.o 00:01:44.764 CC module/event/subsystems/sock/sock.o 00:01:44.764 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:01:44.764 CC module/event/subsystems/vmd/vmd.o 00:01:44.764 CC module/event/subsystems/scheduler/scheduler.o 00:01:44.764 CC module/event/subsystems/vmd/vmd_rpc.o 00:01:45.023 LIB libspdk_event_sock.a 00:01:45.023 LIB libspdk_event_vhost_blk.a 00:01:45.023 LIB libspdk_event_vmd.a 00:01:45.023 LIB libspdk_event_scheduler.a 00:01:45.023 LIB libspdk_event_iobuf.a 00:01:45.023 SO libspdk_event_sock.so.4.0 00:01:45.023 SO libspdk_event_vhost_blk.so.2.0 00:01:45.023 SO libspdk_event_scheduler.so.3.0 00:01:45.023 SO libspdk_event_vmd.so.5.0 00:01:45.023 SO libspdk_event_iobuf.so.2.0 00:01:45.023 SYMLINK libspdk_event_sock.so 00:01:45.023 SYMLINK libspdk_event_vhost_blk.so 00:01:45.023 SYMLINK libspdk_event_scheduler.so 00:01:45.023 SYMLINK libspdk_event_vmd.so 00:01:45.023 SYMLINK libspdk_event_iobuf.so 00:01:45.279 CC module/event/subsystems/accel/accel.o 00:01:45.279 LIB libspdk_event_accel.a 00:01:45.279 SO libspdk_event_accel.so.5.0 00:01:45.538 SYMLINK libspdk_event_accel.so 00:01:45.538 CC module/event/subsystems/bdev/bdev.o 00:01:45.797 LIB libspdk_event_bdev.a 00:01:45.797 SO libspdk_event_bdev.so.5.0 00:01:45.797 SYMLINK libspdk_event_bdev.so 00:01:45.797 CC module/event/subsystems/scsi/scsi.o 00:01:45.797 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:01:45.797 CC module/event/subsystems/ublk/ublk.o 00:01:45.797 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:01:45.797 CC module/event/subsystems/nbd/nbd.o 00:01:46.054 LIB libspdk_event_nbd.a 00:01:46.054 LIB libspdk_event_ublk.a 00:01:46.054 LIB libspdk_event_scsi.a 00:01:46.054 SO libspdk_event_nbd.so.5.0 00:01:46.054 SO libspdk_event_ublk.so.2.0 00:01:46.054 SO libspdk_event_scsi.so.5.0 00:01:46.054 SYMLINK libspdk_event_nbd.so 00:01:46.054 SYMLINK libspdk_event_ublk.so 00:01:46.054 SYMLINK libspdk_event_scsi.so 00:01:46.054 LIB libspdk_event_nvmf.a 00:01:46.054 SO libspdk_event_nvmf.so.5.0 00:01:46.310 SYMLINK libspdk_event_nvmf.so 00:01:46.310 CC module/event/subsystems/iscsi/iscsi.o 00:01:46.310 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:01:46.310 LIB libspdk_event_vhost_scsi.a 00:01:46.310 LIB libspdk_event_iscsi.a 00:01:46.310 SO libspdk_event_vhost_scsi.so.2.0 00:01:46.311 SO libspdk_event_iscsi.so.5.0 00:01:46.569 SYMLINK libspdk_event_vhost_scsi.so 00:01:46.569 SYMLINK libspdk_event_iscsi.so 00:01:46.569 SO libspdk.so.5.0 00:01:46.569 SYMLINK libspdk.so 00:01:46.569 CC app/trace_record/trace_record.o 00:01:46.569 CC app/spdk_nvme_perf/perf.o 00:01:46.569 CXX app/trace/trace.o 00:01:46.569 CC app/spdk_top/spdk_top.o 00:01:46.569 CC app/spdk_lspci/spdk_lspci.o 00:01:46.831 CC app/spdk_nvme_identify/identify.o 00:01:46.831 CC test/rpc_client/rpc_client_test.o 00:01:46.831 TEST_HEADER include/spdk/accel.h 00:01:46.831 TEST_HEADER include/spdk/accel_module.h 00:01:46.831 CC app/spdk_nvme_discover/discovery_aer.o 00:01:46.831 TEST_HEADER include/spdk/assert.h 00:01:46.831 TEST_HEADER include/spdk/barrier.h 00:01:46.831 TEST_HEADER include/spdk/base64.h 00:01:46.831 TEST_HEADER include/spdk/bdev.h 00:01:46.831 TEST_HEADER include/spdk/bdev_module.h 00:01:46.831 TEST_HEADER include/spdk/bdev_zone.h 00:01:46.831 TEST_HEADER include/spdk/bit_array.h 00:01:46.831 TEST_HEADER include/spdk/bit_pool.h 00:01:46.831 TEST_HEADER include/spdk/blob_bdev.h 00:01:46.831 TEST_HEADER include/spdk/blobfs_bdev.h 00:01:46.831 TEST_HEADER include/spdk/blobfs.h 00:01:46.831 TEST_HEADER include/spdk/blob.h 00:01:46.831 TEST_HEADER include/spdk/conf.h 00:01:46.831 TEST_HEADER include/spdk/config.h 00:01:46.831 CC app/spdk_dd/spdk_dd.o 00:01:46.831 TEST_HEADER include/spdk/cpuset.h 00:01:46.831 TEST_HEADER include/spdk/crc16.h 00:01:46.831 CC examples/interrupt_tgt/interrupt_tgt.o 00:01:46.831 TEST_HEADER include/spdk/crc32.h 00:01:46.831 CC app/nvmf_tgt/nvmf_main.o 00:01:46.831 TEST_HEADER include/spdk/crc64.h 00:01:46.831 CC app/vhost/vhost.o 00:01:46.831 TEST_HEADER include/spdk/dif.h 00:01:46.831 CC app/iscsi_tgt/iscsi_tgt.o 00:01:46.831 TEST_HEADER include/spdk/dma.h 00:01:46.831 TEST_HEADER include/spdk/endian.h 00:01:46.831 CC examples/idxd/perf/perf.o 00:01:46.831 CC examples/nvme/reconnect/reconnect.o 00:01:46.831 TEST_HEADER include/spdk/env_dpdk.h 00:01:46.831 CC examples/nvme/hello_world/hello_world.o 00:01:46.831 CC examples/nvme/abort/abort.o 00:01:46.831 CC examples/nvme/arbitration/arbitration.o 00:01:46.831 TEST_HEADER include/spdk/env.h 00:01:46.831 CC examples/sock/hello_world/hello_sock.o 00:01:46.831 CC examples/nvme/hotplug/hotplug.o 00:01:46.831 CC examples/ioat/verify/verify.o 00:01:46.831 CC test/event/event_perf/event_perf.o 00:01:46.831 CC examples/nvme/cmb_copy/cmb_copy.o 00:01:46.831 TEST_HEADER include/spdk/event.h 00:01:46.831 CC examples/nvme/nvme_manage/nvme_manage.o 00:01:46.831 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:01:46.831 CC examples/ioat/perf/perf.o 00:01:46.831 CC examples/accel/perf/accel_perf.o 00:01:46.831 CC test/app/histogram_perf/histogram_perf.o 00:01:46.831 CC examples/vmd/lsvmd/lsvmd.o 00:01:46.831 CC examples/util/zipf/zipf.o 00:01:46.831 TEST_HEADER include/spdk/fd_group.h 00:01:46.831 CC app/fio/nvme/fio_plugin.o 00:01:46.831 CC app/spdk_tgt/spdk_tgt.o 00:01:46.831 CC test/nvme/aer/aer.o 00:01:46.831 TEST_HEADER include/spdk/fd.h 00:01:46.831 CC test/thread/poller_perf/poller_perf.o 00:01:46.831 TEST_HEADER include/spdk/file.h 00:01:46.831 TEST_HEADER include/spdk/ftl.h 00:01:46.831 TEST_HEADER include/spdk/gpt_spec.h 00:01:46.831 TEST_HEADER include/spdk/hexlify.h 00:01:46.831 TEST_HEADER include/spdk/histogram_data.h 00:01:46.831 TEST_HEADER include/spdk/idxd.h 00:01:46.831 TEST_HEADER include/spdk/idxd_spec.h 00:01:46.831 TEST_HEADER include/spdk/init.h 00:01:46.831 TEST_HEADER include/spdk/ioat.h 00:01:46.831 TEST_HEADER include/spdk/ioat_spec.h 00:01:46.831 CC examples/blob/cli/blobcli.o 00:01:46.831 CC test/blobfs/mkfs/mkfs.o 00:01:46.831 CC examples/blob/hello_world/hello_blob.o 00:01:46.831 TEST_HEADER include/spdk/iscsi_spec.h 00:01:46.831 CC examples/thread/thread/thread_ex.o 00:01:46.831 CC test/accel/dif/dif.o 00:01:46.831 TEST_HEADER include/spdk/json.h 00:01:46.831 CC test/bdev/bdevio/bdevio.o 00:01:46.831 TEST_HEADER include/spdk/jsonrpc.h 00:01:46.831 CC examples/nvmf/nvmf/nvmf.o 00:01:46.831 TEST_HEADER include/spdk/likely.h 00:01:46.831 CC examples/bdev/hello_world/hello_bdev.o 00:01:46.831 CC test/dma/test_dma/test_dma.o 00:01:46.831 TEST_HEADER include/spdk/log.h 00:01:46.831 TEST_HEADER include/spdk/lvol.h 00:01:46.831 TEST_HEADER include/spdk/memory.h 00:01:46.831 TEST_HEADER include/spdk/mmio.h 00:01:46.831 TEST_HEADER include/spdk/nbd.h 00:01:46.831 TEST_HEADER include/spdk/notify.h 00:01:46.831 CC test/app/bdev_svc/bdev_svc.o 00:01:46.831 TEST_HEADER include/spdk/nvme.h 00:01:46.831 TEST_HEADER include/spdk/nvme_intel.h 00:01:46.831 CC test/lvol/esnap/esnap.o 00:01:46.831 TEST_HEADER include/spdk/nvme_ocssd.h 00:01:46.831 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:01:46.831 CC test/env/mem_callbacks/mem_callbacks.o 00:01:46.831 TEST_HEADER include/spdk/nvme_spec.h 00:01:46.831 TEST_HEADER include/spdk/nvme_zns.h 00:01:46.831 TEST_HEADER include/spdk/nvmf_cmd.h 00:01:46.831 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:01:46.831 TEST_HEADER include/spdk/nvmf.h 00:01:46.831 TEST_HEADER include/spdk/nvmf_spec.h 00:01:46.831 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:01:46.831 TEST_HEADER include/spdk/nvmf_transport.h 00:01:46.831 TEST_HEADER include/spdk/opal.h 00:01:46.831 TEST_HEADER include/spdk/opal_spec.h 00:01:46.831 TEST_HEADER include/spdk/pci_ids.h 00:01:46.831 TEST_HEADER include/spdk/pipe.h 00:01:46.831 TEST_HEADER include/spdk/queue.h 00:01:46.832 TEST_HEADER include/spdk/reduce.h 00:01:46.832 TEST_HEADER include/spdk/rpc.h 00:01:46.832 TEST_HEADER include/spdk/scheduler.h 00:01:47.092 TEST_HEADER include/spdk/scsi.h 00:01:47.092 LINK spdk_lspci 00:01:47.092 TEST_HEADER include/spdk/scsi_spec.h 00:01:47.092 TEST_HEADER include/spdk/sock.h 00:01:47.092 TEST_HEADER include/spdk/stdinc.h 00:01:47.092 TEST_HEADER include/spdk/string.h 00:01:47.092 TEST_HEADER include/spdk/thread.h 00:01:47.092 TEST_HEADER include/spdk/trace.h 00:01:47.092 TEST_HEADER include/spdk/trace_parser.h 00:01:47.092 TEST_HEADER include/spdk/tree.h 00:01:47.092 TEST_HEADER include/spdk/ublk.h 00:01:47.092 TEST_HEADER include/spdk/util.h 00:01:47.092 TEST_HEADER include/spdk/uuid.h 00:01:47.092 TEST_HEADER include/spdk/version.h 00:01:47.092 TEST_HEADER include/spdk/vfio_user_pci.h 00:01:47.092 TEST_HEADER include/spdk/vfio_user_spec.h 00:01:47.092 TEST_HEADER include/spdk/vhost.h 00:01:47.092 TEST_HEADER include/spdk/vmd.h 00:01:47.092 TEST_HEADER include/spdk/xor.h 00:01:47.092 TEST_HEADER include/spdk/zipf.h 00:01:47.092 CXX test/cpp_headers/accel.o 00:01:47.092 LINK lsvmd 00:01:47.092 LINK rpc_client_test 00:01:47.092 LINK histogram_perf 00:01:47.092 LINK event_perf 00:01:47.092 LINK spdk_nvme_discover 00:01:47.092 LINK zipf 00:01:47.092 LINK interrupt_tgt 00:01:47.092 LINK nvmf_tgt 00:01:47.092 LINK poller_perf 00:01:47.092 LINK vhost 00:01:47.092 LINK cmb_copy 00:01:47.092 LINK pmr_persistence 00:01:47.092 LINK spdk_trace_record 00:01:47.092 LINK iscsi_tgt 00:01:47.355 LINK ioat_perf 00:01:47.356 LINK hello_world 00:01:47.356 LINK verify 00:01:47.356 LINK spdk_tgt 00:01:47.356 LINK bdev_svc 00:01:47.356 LINK hotplug 00:01:47.356 LINK mkfs 00:01:47.356 LINK hello_sock 00:01:47.356 LINK hello_blob 00:01:47.356 LINK thread 00:01:47.356 LINK hello_bdev 00:01:47.356 LINK aer 00:01:47.356 CC test/event/reactor/reactor.o 00:01:47.356 CXX test/cpp_headers/accel_module.o 00:01:47.356 LINK reconnect 00:01:47.356 LINK idxd_perf 00:01:47.356 LINK nvmf 00:01:47.356 LINK arbitration 00:01:47.356 CXX test/cpp_headers/assert.o 00:01:47.356 LINK spdk_dd 00:01:47.356 CC examples/vmd/led/led.o 00:01:47.615 CC test/nvme/reset/reset.o 00:01:47.615 LINK spdk_trace 00:01:47.615 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:01:47.615 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:01:47.615 LINK abort 00:01:47.615 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:01:47.615 CXX test/cpp_headers/barrier.o 00:01:47.615 CC app/fio/bdev/fio_plugin.o 00:01:47.615 CXX test/cpp_headers/base64.o 00:01:47.615 CC test/env/vtophys/vtophys.o 00:01:47.615 LINK dif 00:01:47.615 CC test/event/reactor_perf/reactor_perf.o 00:01:47.616 CXX test/cpp_headers/bdev.o 00:01:47.616 CC test/app/jsoncat/jsoncat.o 00:01:47.616 LINK test_dma 00:01:47.616 CXX test/cpp_headers/bdev_module.o 00:01:47.616 CC test/app/stub/stub.o 00:01:47.616 CC examples/bdev/bdevperf/bdevperf.o 00:01:47.616 LINK bdevio 00:01:47.616 LINK accel_perf 00:01:47.616 CC test/nvme/e2edp/nvme_dp.o 00:01:47.616 CC test/nvme/sgl/sgl.o 00:01:47.616 CXX test/cpp_headers/bdev_zone.o 00:01:47.616 LINK reactor 00:01:47.616 LINK nvme_fuzz 00:01:47.616 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:01:47.616 CXX test/cpp_headers/bit_array.o 00:01:47.876 LINK nvme_manage 00:01:47.876 CXX test/cpp_headers/bit_pool.o 00:01:47.876 LINK led 00:01:47.876 CC test/env/memory/memory_ut.o 00:01:47.876 CC test/event/app_repeat/app_repeat.o 00:01:47.876 CC test/nvme/overhead/overhead.o 00:01:47.876 LINK blobcli 00:01:47.876 CXX test/cpp_headers/blob_bdev.o 00:01:47.876 CC test/env/pci/pci_ut.o 00:01:47.876 LINK spdk_nvme 00:01:47.876 CC test/nvme/startup/startup.o 00:01:47.876 CC test/nvme/err_injection/err_injection.o 00:01:47.876 CC test/nvme/reserve/reserve.o 00:01:47.876 CC test/nvme/simple_copy/simple_copy.o 00:01:47.876 LINK vtophys 00:01:47.876 LINK jsoncat 00:01:47.876 LINK reactor_perf 00:01:47.876 CC test/nvme/connect_stress/connect_stress.o 00:01:47.876 CC test/event/scheduler/scheduler.o 00:01:47.876 CXX test/cpp_headers/blobfs_bdev.o 00:01:47.876 CC test/nvme/boot_partition/boot_partition.o 00:01:47.876 CC test/nvme/compliance/nvme_compliance.o 00:01:47.876 CC test/nvme/fused_ordering/fused_ordering.o 00:01:47.876 LINK stub 00:01:47.876 CXX test/cpp_headers/blobfs.o 00:01:47.876 CXX test/cpp_headers/blob.o 00:01:47.876 CXX test/cpp_headers/conf.o 00:01:48.137 CXX test/cpp_headers/config.o 00:01:48.137 LINK reset 00:01:48.137 CC test/nvme/doorbell_aers/doorbell_aers.o 00:01:48.137 CXX test/cpp_headers/cpuset.o 00:01:48.138 CXX test/cpp_headers/crc16.o 00:01:48.138 CXX test/cpp_headers/crc32.o 00:01:48.138 CXX test/cpp_headers/crc64.o 00:01:48.138 CXX test/cpp_headers/dif.o 00:01:48.138 LINK env_dpdk_post_init 00:01:48.138 CXX test/cpp_headers/dma.o 00:01:48.138 LINK app_repeat 00:01:48.138 CXX test/cpp_headers/endian.o 00:01:48.138 CC test/nvme/fdp/fdp.o 00:01:48.138 CXX test/cpp_headers/env_dpdk.o 00:01:48.138 CC test/nvme/cuse/cuse.o 00:01:48.138 LINK mem_callbacks 00:01:48.138 CXX test/cpp_headers/env.o 00:01:48.138 LINK nvme_dp 00:01:48.138 CXX test/cpp_headers/event.o 00:01:48.138 CXX test/cpp_headers/fd_group.o 00:01:48.138 CXX test/cpp_headers/fd.o 00:01:48.138 LINK spdk_nvme_perf 00:01:48.138 LINK sgl 00:01:48.138 LINK startup 00:01:48.138 CXX test/cpp_headers/file.o 00:01:48.138 CXX test/cpp_headers/ftl.o 00:01:48.138 LINK err_injection 00:01:48.138 LINK connect_stress 00:01:48.398 CXX test/cpp_headers/gpt_spec.o 00:01:48.398 LINK spdk_nvme_identify 00:01:48.398 LINK reserve 00:01:48.398 LINK boot_partition 00:01:48.398 CXX test/cpp_headers/hexlify.o 00:01:48.398 LINK vhost_fuzz 00:01:48.398 CXX test/cpp_headers/histogram_data.o 00:01:48.398 CXX test/cpp_headers/idxd.o 00:01:48.398 LINK overhead 00:01:48.398 CXX test/cpp_headers/idxd_spec.o 00:01:48.398 LINK simple_copy 00:01:48.398 CXX test/cpp_headers/init.o 00:01:48.398 CXX test/cpp_headers/ioat.o 00:01:48.398 LINK scheduler 00:01:48.398 CXX test/cpp_headers/ioat_spec.o 00:01:48.398 LINK fused_ordering 00:01:48.398 LINK spdk_top 00:01:48.398 CXX test/cpp_headers/iscsi_spec.o 00:01:48.398 CXX test/cpp_headers/json.o 00:01:48.398 LINK doorbell_aers 00:01:48.398 CXX test/cpp_headers/jsonrpc.o 00:01:48.398 CXX test/cpp_headers/likely.o 00:01:48.398 CXX test/cpp_headers/log.o 00:01:48.398 CXX test/cpp_headers/lvol.o 00:01:48.398 CXX test/cpp_headers/memory.o 00:01:48.398 CXX test/cpp_headers/mmio.o 00:01:48.398 CXX test/cpp_headers/nbd.o 00:01:48.398 CXX test/cpp_headers/notify.o 00:01:48.398 CXX test/cpp_headers/nvme.o 00:01:48.398 LINK spdk_bdev 00:01:48.398 CXX test/cpp_headers/nvme_intel.o 00:01:48.398 CXX test/cpp_headers/nvme_ocssd.o 00:01:48.398 CXX test/cpp_headers/nvme_ocssd_spec.o 00:01:48.660 CXX test/cpp_headers/nvme_zns.o 00:01:48.660 CXX test/cpp_headers/nvme_spec.o 00:01:48.660 CXX test/cpp_headers/nvmf_cmd.o 00:01:48.661 CXX test/cpp_headers/nvmf_fc_spec.o 00:01:48.661 CXX test/cpp_headers/nvmf.o 00:01:48.661 CXX test/cpp_headers/nvmf_spec.o 00:01:48.661 LINK nvme_compliance 00:01:48.661 LINK pci_ut 00:01:48.661 CXX test/cpp_headers/nvmf_transport.o 00:01:48.661 CXX test/cpp_headers/opal.o 00:01:48.661 CXX test/cpp_headers/opal_spec.o 00:01:48.661 CXX test/cpp_headers/pci_ids.o 00:01:48.661 CXX test/cpp_headers/pipe.o 00:01:48.661 CXX test/cpp_headers/queue.o 00:01:48.661 CXX test/cpp_headers/reduce.o 00:01:48.661 CXX test/cpp_headers/rpc.o 00:01:48.661 CXX test/cpp_headers/scheduler.o 00:01:48.661 CXX test/cpp_headers/scsi.o 00:01:48.661 CXX test/cpp_headers/scsi_spec.o 00:01:48.661 CXX test/cpp_headers/sock.o 00:01:48.661 CXX test/cpp_headers/stdinc.o 00:01:48.661 CXX test/cpp_headers/string.o 00:01:48.661 CXX test/cpp_headers/thread.o 00:01:48.661 LINK fdp 00:01:48.661 CXX test/cpp_headers/trace.o 00:01:48.661 CXX test/cpp_headers/trace_parser.o 00:01:48.661 CXX test/cpp_headers/tree.o 00:01:48.661 CXX test/cpp_headers/ublk.o 00:01:48.661 CXX test/cpp_headers/util.o 00:01:48.661 CXX test/cpp_headers/uuid.o 00:01:48.661 CXX test/cpp_headers/version.o 00:01:48.661 CXX test/cpp_headers/vfio_user_pci.o 00:01:48.661 CXX test/cpp_headers/vfio_user_spec.o 00:01:48.661 CXX test/cpp_headers/vhost.o 00:01:48.661 CXX test/cpp_headers/vmd.o 00:01:48.922 CXX test/cpp_headers/xor.o 00:01:48.923 CXX test/cpp_headers/zipf.o 00:01:48.923 LINK bdevperf 00:01:49.490 LINK memory_ut 00:01:49.490 LINK cuse 00:01:49.749 LINK iscsi_fuzz 00:01:53.034 LINK esnap 00:01:53.292 00:01:53.292 real 0m46.507s 00:01:53.292 user 9m38.999s 00:01:53.292 sys 2m10.085s 00:01:53.292 11:26:13 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:53.292 11:26:13 -- common/autotest_common.sh@10 -- $ set +x 00:01:53.293 ************************************ 00:01:53.293 END TEST make 00:01:53.293 ************************************ 00:01:53.293 11:26:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:01:53.293 11:26:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:01:53.293 11:26:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:01:53.293 11:26:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:01:53.293 11:26:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:01:53.293 11:26:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:01:53.293 11:26:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:01:53.293 11:26:13 -- scripts/common.sh@335 -- # IFS=.-: 00:01:53.293 11:26:13 -- scripts/common.sh@335 -- # read -ra ver1 00:01:53.293 11:26:13 -- scripts/common.sh@336 -- # IFS=.-: 00:01:53.293 11:26:13 -- scripts/common.sh@336 -- # read -ra ver2 00:01:53.293 11:26:13 -- scripts/common.sh@337 -- # local 'op=<' 00:01:53.293 11:26:13 -- scripts/common.sh@339 -- # ver1_l=2 00:01:53.293 11:26:13 -- scripts/common.sh@340 -- # ver2_l=1 00:01:53.293 11:26:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:01:53.293 11:26:13 -- scripts/common.sh@343 -- # case "$op" in 00:01:53.293 11:26:13 -- scripts/common.sh@344 -- # : 1 00:01:53.293 11:26:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:01:53.293 11:26:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:53.293 11:26:13 -- scripts/common.sh@364 -- # decimal 1 00:01:53.293 11:26:13 -- scripts/common.sh@352 -- # local d=1 00:01:53.293 11:26:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:01:53.293 11:26:13 -- scripts/common.sh@354 -- # echo 1 00:01:53.293 11:26:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:01:53.293 11:26:13 -- scripts/common.sh@365 -- # decimal 2 00:01:53.293 11:26:13 -- scripts/common.sh@352 -- # local d=2 00:01:53.293 11:26:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:01:53.293 11:26:13 -- scripts/common.sh@354 -- # echo 2 00:01:53.293 11:26:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:01:53.293 11:26:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:01:53.293 11:26:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:01:53.293 11:26:13 -- scripts/common.sh@367 -- # return 0 00:01:53.293 11:26:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:01:53.293 11:26:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:01:53.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:53.293 --rc genhtml_branch_coverage=1 00:01:53.293 --rc genhtml_function_coverage=1 00:01:53.293 --rc genhtml_legend=1 00:01:53.293 --rc geninfo_all_blocks=1 00:01:53.293 --rc geninfo_unexecuted_blocks=1 00:01:53.293 00:01:53.293 ' 00:01:53.293 11:26:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:01:53.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:53.293 --rc genhtml_branch_coverage=1 00:01:53.293 --rc genhtml_function_coverage=1 00:01:53.293 --rc genhtml_legend=1 00:01:53.293 --rc geninfo_all_blocks=1 00:01:53.293 --rc geninfo_unexecuted_blocks=1 00:01:53.293 00:01:53.293 ' 00:01:53.293 11:26:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:01:53.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:53.293 --rc genhtml_branch_coverage=1 00:01:53.293 --rc genhtml_function_coverage=1 00:01:53.293 --rc genhtml_legend=1 00:01:53.293 --rc geninfo_all_blocks=1 00:01:53.293 --rc geninfo_unexecuted_blocks=1 00:01:53.293 00:01:53.293 ' 00:01:53.293 11:26:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:01:53.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:53.293 --rc genhtml_branch_coverage=1 00:01:53.293 --rc genhtml_function_coverage=1 00:01:53.293 --rc genhtml_legend=1 00:01:53.293 --rc geninfo_all_blocks=1 00:01:53.293 --rc geninfo_unexecuted_blocks=1 00:01:53.293 00:01:53.293 ' 00:01:53.293 11:26:13 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:01:53.293 11:26:13 -- nvmf/common.sh@7 -- # uname -s 00:01:53.552 11:26:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:01:53.552 11:26:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:01:53.552 11:26:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:01:53.552 11:26:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:01:53.552 11:26:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:01:53.552 11:26:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:01:53.552 11:26:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:01:53.552 11:26:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:01:53.552 11:26:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:01:53.552 11:26:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:01:53.552 11:26:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:01:53.552 11:26:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:01:53.552 11:26:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:01:53.552 11:26:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:01:53.552 11:26:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:01:53.552 11:26:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:53.552 11:26:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:01:53.552 11:26:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:53.552 11:26:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:53.552 11:26:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:53.552 11:26:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:53.552 11:26:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:53.552 11:26:13 -- paths/export.sh@5 -- # export PATH 00:01:53.552 11:26:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:53.552 11:26:13 -- nvmf/common.sh@46 -- # : 0 00:01:53.552 11:26:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:01:53.552 11:26:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:01:53.552 11:26:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:01:53.552 11:26:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:01:53.552 11:26:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:01:53.552 11:26:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:01:53.552 11:26:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:01:53.552 11:26:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:01:53.552 11:26:13 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:01:53.552 11:26:13 -- spdk/autotest.sh@32 -- # uname -s 00:01:53.552 11:26:13 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:01:53.552 11:26:13 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:01:53.552 11:26:13 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:01:53.552 11:26:13 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:01:53.552 11:26:13 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:01:53.552 11:26:13 -- spdk/autotest.sh@44 -- # modprobe nbd 00:01:53.552 11:26:13 -- spdk/autotest.sh@46 -- # type -P udevadm 00:01:53.552 11:26:13 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:01:53.552 11:26:13 -- spdk/autotest.sh@48 -- # udevadm_pid=3651325 00:01:53.552 11:26:13 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:01:53.553 11:26:13 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:53.553 11:26:13 -- spdk/autotest.sh@54 -- # echo 3651327 00:01:53.553 11:26:13 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:53.553 11:26:13 -- spdk/autotest.sh@56 -- # echo 3651328 00:01:53.553 11:26:13 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:53.553 11:26:13 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:01:53.553 11:26:13 -- spdk/autotest.sh@60 -- # echo 3651329 00:01:53.553 11:26:13 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:01:53.553 11:26:13 -- spdk/autotest.sh@62 -- # echo 3651330 00:01:53.553 11:26:13 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:01:53.553 11:26:13 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:01:53.553 11:26:13 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:01:53.553 11:26:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:01:53.553 11:26:13 -- common/autotest_common.sh@10 -- # set +x 00:01:53.553 11:26:13 -- spdk/autotest.sh@70 -- # create_test_list 00:01:53.553 11:26:13 -- common/autotest_common.sh@746 -- # xtrace_disable 00:01:53.553 11:26:13 -- common/autotest_common.sh@10 -- # set +x 00:01:53.553 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:01:53.553 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:01:53.553 11:26:13 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:01:53.553 11:26:13 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:53.553 11:26:13 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:53.553 11:26:13 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:53.553 11:26:13 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:53.553 11:26:13 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:01:53.553 11:26:13 -- common/autotest_common.sh@1450 -- # uname 00:01:53.553 11:26:13 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:01:53.553 11:26:13 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:01:53.553 11:26:13 -- common/autotest_common.sh@1470 -- # uname 00:01:53.553 11:26:13 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:01:53.553 11:26:13 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:01:53.553 11:26:13 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:01:53.553 lcov: LCOV version 1.15 00:01:53.553 11:26:13 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:01:57.739 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:01:57.739 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:01:57.739 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:01:57.739 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:01:57.739 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:01:57.739 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:29.804 11:26:46 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:02:29.804 11:26:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:29.804 11:26:46 -- common/autotest_common.sh@10 -- # set +x 00:02:29.804 11:26:46 -- spdk/autotest.sh@89 -- # rm -f 00:02:29.804 11:26:46 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:29.804 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:02:29.804 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:02:29.804 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:02:29.804 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:02:29.804 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:02:29.804 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:02:29.804 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:02:29.804 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:02:29.804 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:02:29.804 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:02:29.804 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:02:29.804 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:02:29.804 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:02:29.804 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:02:29.804 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:02:29.804 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:02:29.804 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:02:29.804 11:26:47 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:02:29.804 11:26:47 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:29.804 11:26:47 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:29.804 11:26:47 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:29.804 11:26:47 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:29.804 11:26:47 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:29.804 11:26:47 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:29.804 11:26:47 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:29.804 11:26:47 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:29.804 11:26:47 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:02:29.804 11:26:47 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:02:29.804 11:26:47 -- spdk/autotest.sh@108 -- # grep -v p 00:02:29.804 11:26:47 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:02:29.804 11:26:47 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:02:29.804 11:26:47 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:02:29.804 11:26:47 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:02:29.804 11:26:47 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:29.804 No valid GPT data, bailing 00:02:29.804 11:26:47 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:29.804 11:26:47 -- scripts/common.sh@393 -- # pt= 00:02:29.804 11:26:47 -- scripts/common.sh@394 -- # return 1 00:02:29.804 11:26:47 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:29.804 1+0 records in 00:02:29.804 1+0 records out 00:02:29.804 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00224738 s, 467 MB/s 00:02:29.804 11:26:47 -- spdk/autotest.sh@116 -- # sync 00:02:29.804 11:26:47 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:29.804 11:26:47 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:29.804 11:26:47 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:29.804 11:26:49 -- spdk/autotest.sh@122 -- # uname -s 00:02:29.804 11:26:49 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:02:29.804 11:26:49 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:29.804 11:26:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:29.804 11:26:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:29.804 11:26:49 -- common/autotest_common.sh@10 -- # set +x 00:02:29.804 ************************************ 00:02:29.804 START TEST setup.sh 00:02:29.804 ************************************ 00:02:29.804 11:26:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:29.804 * Looking for test storage... 00:02:29.804 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:29.804 11:26:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:29.804 11:26:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:29.804 11:26:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:29.804 11:26:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:29.804 11:26:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:29.804 11:26:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:29.804 11:26:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:29.804 11:26:49 -- scripts/common.sh@335 -- # IFS=.-: 00:02:29.804 11:26:49 -- scripts/common.sh@335 -- # read -ra ver1 00:02:29.804 11:26:49 -- scripts/common.sh@336 -- # IFS=.-: 00:02:29.804 11:26:49 -- scripts/common.sh@336 -- # read -ra ver2 00:02:29.804 11:26:49 -- scripts/common.sh@337 -- # local 'op=<' 00:02:29.804 11:26:49 -- scripts/common.sh@339 -- # ver1_l=2 00:02:29.804 11:26:49 -- scripts/common.sh@340 -- # ver2_l=1 00:02:29.804 11:26:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:29.804 11:26:49 -- scripts/common.sh@343 -- # case "$op" in 00:02:29.804 11:26:49 -- scripts/common.sh@344 -- # : 1 00:02:29.804 11:26:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:29.804 11:26:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:29.804 11:26:49 -- scripts/common.sh@364 -- # decimal 1 00:02:29.804 11:26:49 -- scripts/common.sh@352 -- # local d=1 00:02:29.804 11:26:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:29.804 11:26:49 -- scripts/common.sh@354 -- # echo 1 00:02:29.804 11:26:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:29.804 11:26:49 -- scripts/common.sh@365 -- # decimal 2 00:02:29.804 11:26:49 -- scripts/common.sh@352 -- # local d=2 00:02:29.804 11:26:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:29.804 11:26:49 -- scripts/common.sh@354 -- # echo 2 00:02:29.804 11:26:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:29.804 11:26:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:29.804 11:26:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:29.804 11:26:49 -- scripts/common.sh@367 -- # return 0 00:02:29.804 11:26:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:29.804 11:26:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:29.804 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:29.804 --rc genhtml_branch_coverage=1 00:02:29.804 --rc genhtml_function_coverage=1 00:02:29.804 --rc genhtml_legend=1 00:02:29.804 --rc geninfo_all_blocks=1 00:02:29.804 --rc geninfo_unexecuted_blocks=1 00:02:29.804 00:02:29.804 ' 00:02:29.804 11:26:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:29.804 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:29.804 --rc genhtml_branch_coverage=1 00:02:29.804 --rc genhtml_function_coverage=1 00:02:29.804 --rc genhtml_legend=1 00:02:29.804 --rc geninfo_all_blocks=1 00:02:29.804 --rc geninfo_unexecuted_blocks=1 00:02:29.804 00:02:29.804 ' 00:02:29.804 11:26:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:29.804 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:29.804 --rc genhtml_branch_coverage=1 00:02:29.804 --rc genhtml_function_coverage=1 00:02:29.804 --rc genhtml_legend=1 00:02:29.804 --rc geninfo_all_blocks=1 00:02:29.804 --rc geninfo_unexecuted_blocks=1 00:02:29.804 00:02:29.805 ' 00:02:29.805 11:26:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:29.805 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:29.805 --rc genhtml_branch_coverage=1 00:02:29.805 --rc genhtml_function_coverage=1 00:02:29.805 --rc genhtml_legend=1 00:02:29.805 --rc geninfo_all_blocks=1 00:02:29.805 --rc geninfo_unexecuted_blocks=1 00:02:29.805 00:02:29.805 ' 00:02:29.805 11:26:49 -- setup/test-setup.sh@10 -- # uname -s 00:02:29.805 11:26:49 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:29.805 11:26:49 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:29.805 11:26:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:29.805 11:26:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:29.805 11:26:49 -- common/autotest_common.sh@10 -- # set +x 00:02:29.805 ************************************ 00:02:29.805 START TEST acl 00:02:29.805 ************************************ 00:02:29.805 11:26:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:30.063 * Looking for test storage... 00:02:30.064 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:30.064 11:26:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:30.064 11:26:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:30.064 11:26:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:30.064 11:26:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:30.064 11:26:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:30.064 11:26:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:30.064 11:26:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:30.064 11:26:49 -- scripts/common.sh@335 -- # IFS=.-: 00:02:30.064 11:26:49 -- scripts/common.sh@335 -- # read -ra ver1 00:02:30.064 11:26:49 -- scripts/common.sh@336 -- # IFS=.-: 00:02:30.064 11:26:49 -- scripts/common.sh@336 -- # read -ra ver2 00:02:30.064 11:26:49 -- scripts/common.sh@337 -- # local 'op=<' 00:02:30.064 11:26:49 -- scripts/common.sh@339 -- # ver1_l=2 00:02:30.064 11:26:49 -- scripts/common.sh@340 -- # ver2_l=1 00:02:30.064 11:26:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:30.064 11:26:49 -- scripts/common.sh@343 -- # case "$op" in 00:02:30.064 11:26:49 -- scripts/common.sh@344 -- # : 1 00:02:30.064 11:26:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:30.064 11:26:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:30.064 11:26:49 -- scripts/common.sh@364 -- # decimal 1 00:02:30.064 11:26:49 -- scripts/common.sh@352 -- # local d=1 00:02:30.064 11:26:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:30.064 11:26:49 -- scripts/common.sh@354 -- # echo 1 00:02:30.064 11:26:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:30.064 11:26:49 -- scripts/common.sh@365 -- # decimal 2 00:02:30.064 11:26:49 -- scripts/common.sh@352 -- # local d=2 00:02:30.064 11:26:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:30.064 11:26:49 -- scripts/common.sh@354 -- # echo 2 00:02:30.064 11:26:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:30.064 11:26:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:30.064 11:26:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:30.064 11:26:49 -- scripts/common.sh@367 -- # return 0 00:02:30.064 11:26:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:30.064 11:26:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:30.064 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:30.064 --rc genhtml_branch_coverage=1 00:02:30.064 --rc genhtml_function_coverage=1 00:02:30.064 --rc genhtml_legend=1 00:02:30.064 --rc geninfo_all_blocks=1 00:02:30.064 --rc geninfo_unexecuted_blocks=1 00:02:30.064 00:02:30.064 ' 00:02:30.064 11:26:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:30.064 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:30.064 --rc genhtml_branch_coverage=1 00:02:30.064 --rc genhtml_function_coverage=1 00:02:30.064 --rc genhtml_legend=1 00:02:30.064 --rc geninfo_all_blocks=1 00:02:30.064 --rc geninfo_unexecuted_blocks=1 00:02:30.064 00:02:30.064 ' 00:02:30.064 11:26:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:30.064 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:30.064 --rc genhtml_branch_coverage=1 00:02:30.064 --rc genhtml_function_coverage=1 00:02:30.064 --rc genhtml_legend=1 00:02:30.064 --rc geninfo_all_blocks=1 00:02:30.064 --rc geninfo_unexecuted_blocks=1 00:02:30.064 00:02:30.064 ' 00:02:30.064 11:26:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:30.064 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:30.064 --rc genhtml_branch_coverage=1 00:02:30.064 --rc genhtml_function_coverage=1 00:02:30.064 --rc genhtml_legend=1 00:02:30.064 --rc geninfo_all_blocks=1 00:02:30.064 --rc geninfo_unexecuted_blocks=1 00:02:30.064 00:02:30.064 ' 00:02:30.064 11:26:49 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:30.064 11:26:49 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:30.064 11:26:49 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:30.064 11:26:49 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:30.064 11:26:49 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:30.064 11:26:49 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:30.064 11:26:49 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:30.064 11:26:49 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:30.064 11:26:49 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:30.064 11:26:49 -- setup/acl.sh@12 -- # devs=() 00:02:30.064 11:26:49 -- setup/acl.sh@12 -- # declare -a devs 00:02:30.064 11:26:49 -- setup/acl.sh@13 -- # drivers=() 00:02:30.064 11:26:49 -- setup/acl.sh@13 -- # declare -A drivers 00:02:30.064 11:26:49 -- setup/acl.sh@51 -- # setup reset 00:02:30.064 11:26:49 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:30.064 11:26:49 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:31.442 11:26:51 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:31.442 11:26:51 -- setup/acl.sh@16 -- # local dev driver 00:02:31.442 11:26:51 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.442 11:26:51 -- setup/acl.sh@15 -- # setup output status 00:02:31.442 11:26:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:31.442 11:26:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:02:32.817 Hugepages 00:02:32.817 node hugesize free / total 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 00:02:32.817 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # continue 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:32.817 11:26:52 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:02:32.817 11:26:52 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:32.817 11:26:52 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:32.817 11:26:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.817 11:26:52 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:32.817 11:26:52 -- setup/acl.sh@54 -- # run_test denied denied 00:02:32.817 11:26:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:32.817 11:26:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:32.817 11:26:52 -- common/autotest_common.sh@10 -- # set +x 00:02:32.817 ************************************ 00:02:32.817 START TEST denied 00:02:32.817 ************************************ 00:02:32.817 11:26:52 -- common/autotest_common.sh@1114 -- # denied 00:02:32.817 11:26:52 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:02:32.817 11:26:52 -- setup/acl.sh@38 -- # setup output config 00:02:32.817 11:26:52 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:02:32.817 11:26:52 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:32.817 11:26:52 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:34.194 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:02:34.194 11:26:54 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:02:34.194 11:26:54 -- setup/acl.sh@28 -- # local dev driver 00:02:34.194 11:26:54 -- setup/acl.sh@30 -- # for dev in "$@" 00:02:34.194 11:26:54 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:02:34.194 11:26:54 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:02:34.194 11:26:54 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:02:34.194 11:26:54 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:02:34.194 11:26:54 -- setup/acl.sh@41 -- # setup reset 00:02:34.194 11:26:54 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:34.194 11:26:54 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:36.740 00:02:36.740 real 0m3.964s 00:02:36.740 user 0m1.194s 00:02:36.740 sys 0m1.921s 00:02:36.740 11:26:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:36.740 11:26:56 -- common/autotest_common.sh@10 -- # set +x 00:02:36.740 ************************************ 00:02:36.740 END TEST denied 00:02:36.740 ************************************ 00:02:36.740 11:26:56 -- setup/acl.sh@55 -- # run_test allowed allowed 00:02:36.740 11:26:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:36.740 11:26:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:36.740 11:26:56 -- common/autotest_common.sh@10 -- # set +x 00:02:36.740 ************************************ 00:02:36.740 START TEST allowed 00:02:36.740 ************************************ 00:02:36.740 11:26:56 -- common/autotest_common.sh@1114 -- # allowed 00:02:36.740 11:26:56 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:02:36.740 11:26:56 -- setup/acl.sh@45 -- # setup output config 00:02:36.740 11:26:56 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:02:36.740 11:26:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:36.740 11:26:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:39.271 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:02:39.271 11:26:58 -- setup/acl.sh@47 -- # verify 00:02:39.271 11:26:58 -- setup/acl.sh@28 -- # local dev driver 00:02:39.271 11:26:58 -- setup/acl.sh@48 -- # setup reset 00:02:39.271 11:26:58 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:39.271 11:26:58 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:40.647 00:02:40.647 real 0m3.913s 00:02:40.647 user 0m1.034s 00:02:40.647 sys 0m1.764s 00:02:40.647 11:27:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:40.647 11:27:00 -- common/autotest_common.sh@10 -- # set +x 00:02:40.647 ************************************ 00:02:40.647 END TEST allowed 00:02:40.647 ************************************ 00:02:40.647 00:02:40.647 real 0m10.726s 00:02:40.647 user 0m3.373s 00:02:40.647 sys 0m5.482s 00:02:40.647 11:27:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:40.647 11:27:00 -- common/autotest_common.sh@10 -- # set +x 00:02:40.647 ************************************ 00:02:40.647 END TEST acl 00:02:40.647 ************************************ 00:02:40.647 11:27:00 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:02:40.647 11:27:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:40.647 11:27:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:40.647 11:27:00 -- common/autotest_common.sh@10 -- # set +x 00:02:40.647 ************************************ 00:02:40.647 START TEST hugepages 00:02:40.647 ************************************ 00:02:40.647 11:27:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:02:40.647 * Looking for test storage... 00:02:40.647 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:40.647 11:27:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:40.647 11:27:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:40.647 11:27:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:40.647 11:27:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:40.647 11:27:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:40.647 11:27:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:40.647 11:27:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:40.647 11:27:00 -- scripts/common.sh@335 -- # IFS=.-: 00:02:40.647 11:27:00 -- scripts/common.sh@335 -- # read -ra ver1 00:02:40.647 11:27:00 -- scripts/common.sh@336 -- # IFS=.-: 00:02:40.647 11:27:00 -- scripts/common.sh@336 -- # read -ra ver2 00:02:40.647 11:27:00 -- scripts/common.sh@337 -- # local 'op=<' 00:02:40.647 11:27:00 -- scripts/common.sh@339 -- # ver1_l=2 00:02:40.647 11:27:00 -- scripts/common.sh@340 -- # ver2_l=1 00:02:40.647 11:27:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:40.647 11:27:00 -- scripts/common.sh@343 -- # case "$op" in 00:02:40.647 11:27:00 -- scripts/common.sh@344 -- # : 1 00:02:40.647 11:27:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:40.647 11:27:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:40.647 11:27:00 -- scripts/common.sh@364 -- # decimal 1 00:02:40.647 11:27:00 -- scripts/common.sh@352 -- # local d=1 00:02:40.647 11:27:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:40.908 11:27:00 -- scripts/common.sh@354 -- # echo 1 00:02:40.908 11:27:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:40.908 11:27:00 -- scripts/common.sh@365 -- # decimal 2 00:02:40.908 11:27:00 -- scripts/common.sh@352 -- # local d=2 00:02:40.908 11:27:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:40.908 11:27:00 -- scripts/common.sh@354 -- # echo 2 00:02:40.908 11:27:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:40.908 11:27:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:40.908 11:27:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:40.908 11:27:00 -- scripts/common.sh@367 -- # return 0 00:02:40.908 11:27:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:40.908 11:27:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:40.908 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:40.908 --rc genhtml_branch_coverage=1 00:02:40.908 --rc genhtml_function_coverage=1 00:02:40.908 --rc genhtml_legend=1 00:02:40.908 --rc geninfo_all_blocks=1 00:02:40.908 --rc geninfo_unexecuted_blocks=1 00:02:40.908 00:02:40.908 ' 00:02:40.908 11:27:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:40.908 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:40.908 --rc genhtml_branch_coverage=1 00:02:40.908 --rc genhtml_function_coverage=1 00:02:40.908 --rc genhtml_legend=1 00:02:40.908 --rc geninfo_all_blocks=1 00:02:40.908 --rc geninfo_unexecuted_blocks=1 00:02:40.908 00:02:40.908 ' 00:02:40.908 11:27:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:40.908 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:40.908 --rc genhtml_branch_coverage=1 00:02:40.908 --rc genhtml_function_coverage=1 00:02:40.908 --rc genhtml_legend=1 00:02:40.908 --rc geninfo_all_blocks=1 00:02:40.908 --rc geninfo_unexecuted_blocks=1 00:02:40.908 00:02:40.908 ' 00:02:40.908 11:27:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:40.908 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:40.908 --rc genhtml_branch_coverage=1 00:02:40.908 --rc genhtml_function_coverage=1 00:02:40.908 --rc genhtml_legend=1 00:02:40.908 --rc geninfo_all_blocks=1 00:02:40.908 --rc geninfo_unexecuted_blocks=1 00:02:40.908 00:02:40.908 ' 00:02:40.908 11:27:00 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:02:40.908 11:27:00 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:02:40.908 11:27:00 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:02:40.908 11:27:00 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:02:40.908 11:27:00 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:02:40.908 11:27:00 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:02:40.908 11:27:00 -- setup/common.sh@17 -- # local get=Hugepagesize 00:02:40.908 11:27:00 -- setup/common.sh@18 -- # local node= 00:02:40.908 11:27:00 -- setup/common.sh@19 -- # local var val 00:02:40.908 11:27:00 -- setup/common.sh@20 -- # local mem_f mem 00:02:40.908 11:27:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:40.908 11:27:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:40.908 11:27:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:40.908 11:27:00 -- setup/common.sh@28 -- # mapfile -t mem 00:02:40.908 11:27:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:40.908 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.908 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.908 11:27:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42991548 kB' 'MemAvailable: 46762968 kB' 'Buffers: 2708 kB' 'Cached: 10741740 kB' 'SwapCached: 0 kB' 'Active: 7464988 kB' 'Inactive: 3764112 kB' 'Active(anon): 7064508 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 488196 kB' 'Mapped: 212352 kB' 'Shmem: 6579856 kB' 'KReclaimable: 200812 kB' 'Slab: 741440 kB' 'SReclaimable: 200812 kB' 'SUnreclaim: 540628 kB' 'KernelStack: 12928 kB' 'PageTables: 8752 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559276 kB' 'Committed_AS: 8142852 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198172 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:40.908 11:27:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.908 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.908 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.908 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.908 11:27:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.908 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.908 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.908 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.908 11:27:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.908 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.908 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.908 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.908 11:27:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.908 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.908 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.908 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.909 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.909 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.910 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.910 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.910 11:27:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.910 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.910 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.910 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.910 11:27:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.910 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.910 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.910 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.910 11:27:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.910 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.910 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.910 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.910 11:27:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.910 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.910 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.910 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.910 11:27:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.910 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.910 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.910 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.910 11:27:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.910 11:27:00 -- setup/common.sh@32 -- # continue 00:02:40.910 11:27:00 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.910 11:27:00 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.910 11:27:00 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.910 11:27:00 -- setup/common.sh@33 -- # echo 2048 00:02:40.910 11:27:00 -- setup/common.sh@33 -- # return 0 00:02:40.910 11:27:00 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:02:40.910 11:27:00 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:02:40.910 11:27:00 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:02:40.910 11:27:00 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:02:40.910 11:27:00 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:02:40.910 11:27:00 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:02:40.910 11:27:00 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:02:40.910 11:27:00 -- setup/hugepages.sh@207 -- # get_nodes 00:02:40.910 11:27:00 -- setup/hugepages.sh@27 -- # local node 00:02:40.910 11:27:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:40.910 11:27:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:02:40.910 11:27:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:40.910 11:27:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:40.910 11:27:00 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:40.910 11:27:00 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:40.910 11:27:00 -- setup/hugepages.sh@208 -- # clear_hp 00:02:40.910 11:27:00 -- setup/hugepages.sh@37 -- # local node hp 00:02:40.910 11:27:00 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:40.910 11:27:00 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:40.910 11:27:00 -- setup/hugepages.sh@41 -- # echo 0 00:02:40.910 11:27:00 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:40.910 11:27:00 -- setup/hugepages.sh@41 -- # echo 0 00:02:40.910 11:27:00 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:40.910 11:27:00 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:40.910 11:27:00 -- setup/hugepages.sh@41 -- # echo 0 00:02:40.910 11:27:00 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:40.910 11:27:00 -- setup/hugepages.sh@41 -- # echo 0 00:02:40.910 11:27:00 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:40.910 11:27:00 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:40.910 11:27:00 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:02:40.910 11:27:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:40.910 11:27:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:40.910 11:27:00 -- common/autotest_common.sh@10 -- # set +x 00:02:40.910 ************************************ 00:02:40.910 START TEST default_setup 00:02:40.910 ************************************ 00:02:40.910 11:27:00 -- common/autotest_common.sh@1114 -- # default_setup 00:02:40.910 11:27:00 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:02:40.910 11:27:00 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:40.910 11:27:00 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:40.910 11:27:00 -- setup/hugepages.sh@51 -- # shift 00:02:40.910 11:27:00 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:40.910 11:27:00 -- setup/hugepages.sh@52 -- # local node_ids 00:02:40.910 11:27:00 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:40.910 11:27:00 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:40.910 11:27:00 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:40.910 11:27:00 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:40.910 11:27:00 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:40.910 11:27:00 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:40.910 11:27:00 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:40.910 11:27:00 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:40.910 11:27:00 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:40.910 11:27:00 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:40.910 11:27:00 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:40.910 11:27:00 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:40.910 11:27:00 -- setup/hugepages.sh@73 -- # return 0 00:02:40.910 11:27:00 -- setup/hugepages.sh@137 -- # setup output 00:02:40.910 11:27:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:40.910 11:27:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:41.846 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:02:41.846 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:02:41.846 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:02:42.105 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:02:42.105 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:02:42.105 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:02:42.105 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:02:42.105 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:02:42.105 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:02:42.105 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:02:42.105 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:02:42.105 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:02:42.105 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:02:42.105 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:02:42.105 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:02:42.105 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:02:43.042 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:02:43.042 11:27:03 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:02:43.042 11:27:03 -- setup/hugepages.sh@89 -- # local node 00:02:43.042 11:27:03 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:43.042 11:27:03 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:43.042 11:27:03 -- setup/hugepages.sh@92 -- # local surp 00:02:43.042 11:27:03 -- setup/hugepages.sh@93 -- # local resv 00:02:43.042 11:27:03 -- setup/hugepages.sh@94 -- # local anon 00:02:43.042 11:27:03 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:43.042 11:27:03 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:43.042 11:27:03 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:43.042 11:27:03 -- setup/common.sh@18 -- # local node= 00:02:43.042 11:27:03 -- setup/common.sh@19 -- # local var val 00:02:43.042 11:27:03 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.042 11:27:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.042 11:27:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:43.042 11:27:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:43.042 11:27:03 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.042 11:27:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45112792 kB' 'MemAvailable: 48884196 kB' 'Buffers: 2708 kB' 'Cached: 10741836 kB' 'SwapCached: 0 kB' 'Active: 7468264 kB' 'Inactive: 3764112 kB' 'Active(anon): 7067784 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491256 kB' 'Mapped: 211968 kB' 'Shmem: 6579952 kB' 'KReclaimable: 200780 kB' 'Slab: 741328 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540548 kB' 'KernelStack: 13104 kB' 'PageTables: 9292 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8147852 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198508 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.042 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.042 11:27:03 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.043 11:27:03 -- setup/common.sh@33 -- # echo 0 00:02:43.043 11:27:03 -- setup/common.sh@33 -- # return 0 00:02:43.043 11:27:03 -- setup/hugepages.sh@97 -- # anon=0 00:02:43.043 11:27:03 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:43.043 11:27:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:43.043 11:27:03 -- setup/common.sh@18 -- # local node= 00:02:43.043 11:27:03 -- setup/common.sh@19 -- # local var val 00:02:43.043 11:27:03 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.043 11:27:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.043 11:27:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:43.043 11:27:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:43.043 11:27:03 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.043 11:27:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45123000 kB' 'MemAvailable: 48894404 kB' 'Buffers: 2708 kB' 'Cached: 10741836 kB' 'SwapCached: 0 kB' 'Active: 7467664 kB' 'Inactive: 3764112 kB' 'Active(anon): 7067184 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490688 kB' 'Mapped: 211908 kB' 'Shmem: 6579952 kB' 'KReclaimable: 200780 kB' 'Slab: 741404 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540624 kB' 'KernelStack: 13008 kB' 'PageTables: 8836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8147864 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198428 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.043 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.043 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.044 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.044 11:27:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.305 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.305 11:27:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.305 11:27:03 -- setup/common.sh@33 -- # echo 0 00:02:43.305 11:27:03 -- setup/common.sh@33 -- # return 0 00:02:43.305 11:27:03 -- setup/hugepages.sh@99 -- # surp=0 00:02:43.305 11:27:03 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:43.305 11:27:03 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:43.305 11:27:03 -- setup/common.sh@18 -- # local node= 00:02:43.305 11:27:03 -- setup/common.sh@19 -- # local var val 00:02:43.305 11:27:03 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.305 11:27:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.306 11:27:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:43.306 11:27:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:43.306 11:27:03 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.306 11:27:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45123588 kB' 'MemAvailable: 48894992 kB' 'Buffers: 2708 kB' 'Cached: 10741848 kB' 'SwapCached: 0 kB' 'Active: 7465960 kB' 'Inactive: 3764112 kB' 'Active(anon): 7065480 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 488860 kB' 'Mapped: 211940 kB' 'Shmem: 6579964 kB' 'KReclaimable: 200780 kB' 'Slab: 741388 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540608 kB' 'KernelStack: 12896 kB' 'PageTables: 8540 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8147880 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198428 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.306 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.306 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.307 11:27:03 -- setup/common.sh@33 -- # echo 0 00:02:43.307 11:27:03 -- setup/common.sh@33 -- # return 0 00:02:43.307 11:27:03 -- setup/hugepages.sh@100 -- # resv=0 00:02:43.307 11:27:03 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:43.307 nr_hugepages=1024 00:02:43.307 11:27:03 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:43.307 resv_hugepages=0 00:02:43.307 11:27:03 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:43.307 surplus_hugepages=0 00:02:43.307 11:27:03 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:43.307 anon_hugepages=0 00:02:43.307 11:27:03 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:43.307 11:27:03 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:43.307 11:27:03 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:43.307 11:27:03 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:43.307 11:27:03 -- setup/common.sh@18 -- # local node= 00:02:43.307 11:27:03 -- setup/common.sh@19 -- # local var val 00:02:43.307 11:27:03 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.307 11:27:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.307 11:27:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:43.307 11:27:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:43.307 11:27:03 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.307 11:27:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45132464 kB' 'MemAvailable: 48903868 kB' 'Buffers: 2708 kB' 'Cached: 10741864 kB' 'SwapCached: 0 kB' 'Active: 7466260 kB' 'Inactive: 3764112 kB' 'Active(anon): 7065780 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489160 kB' 'Mapped: 211940 kB' 'Shmem: 6579980 kB' 'KReclaimable: 200780 kB' 'Slab: 741356 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540576 kB' 'KernelStack: 12880 kB' 'PageTables: 8448 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8147896 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198428 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.307 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.307 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.308 11:27:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.308 11:27:03 -- setup/common.sh@33 -- # echo 1024 00:02:43.308 11:27:03 -- setup/common.sh@33 -- # return 0 00:02:43.308 11:27:03 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:43.308 11:27:03 -- setup/hugepages.sh@112 -- # get_nodes 00:02:43.308 11:27:03 -- setup/hugepages.sh@27 -- # local node 00:02:43.308 11:27:03 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:43.308 11:27:03 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:43.308 11:27:03 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:43.308 11:27:03 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:43.308 11:27:03 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:43.308 11:27:03 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:43.308 11:27:03 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:43.308 11:27:03 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:43.308 11:27:03 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:43.308 11:27:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:43.308 11:27:03 -- setup/common.sh@18 -- # local node=0 00:02:43.308 11:27:03 -- setup/common.sh@19 -- # local var val 00:02:43.308 11:27:03 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.308 11:27:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.308 11:27:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:43.308 11:27:03 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:43.308 11:27:03 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.308 11:27:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.308 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26431728 kB' 'MemUsed: 6394128 kB' 'SwapCached: 0 kB' 'Active: 2822880 kB' 'Inactive: 177232 kB' 'Active(anon): 2666156 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 177232 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2641904 kB' 'Mapped: 113364 kB' 'AnonPages: 361488 kB' 'Shmem: 2307948 kB' 'KernelStack: 7384 kB' 'PageTables: 4916 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 119464 kB' 'Slab: 452732 kB' 'SReclaimable: 119464 kB' 'SUnreclaim: 333268 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.309 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.309 11:27:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.310 11:27:03 -- setup/common.sh@32 -- # continue 00:02:43.310 11:27:03 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.310 11:27:03 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.310 11:27:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.310 11:27:03 -- setup/common.sh@33 -- # echo 0 00:02:43.310 11:27:03 -- setup/common.sh@33 -- # return 0 00:02:43.310 11:27:03 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:43.310 11:27:03 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:43.310 11:27:03 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:43.310 11:27:03 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:43.310 11:27:03 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:43.310 node0=1024 expecting 1024 00:02:43.310 11:27:03 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:43.310 00:02:43.310 real 0m2.427s 00:02:43.310 user 0m0.634s 00:02:43.310 sys 0m0.868s 00:02:43.310 11:27:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:43.310 11:27:03 -- common/autotest_common.sh@10 -- # set +x 00:02:43.310 ************************************ 00:02:43.310 END TEST default_setup 00:02:43.310 ************************************ 00:02:43.310 11:27:03 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:02:43.310 11:27:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:43.310 11:27:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:43.310 11:27:03 -- common/autotest_common.sh@10 -- # set +x 00:02:43.310 ************************************ 00:02:43.310 START TEST per_node_1G_alloc 00:02:43.310 ************************************ 00:02:43.310 11:27:03 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:02:43.310 11:27:03 -- setup/hugepages.sh@143 -- # local IFS=, 00:02:43.310 11:27:03 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:02:43.310 11:27:03 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:43.310 11:27:03 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:02:43.310 11:27:03 -- setup/hugepages.sh@51 -- # shift 00:02:43.310 11:27:03 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:02:43.310 11:27:03 -- setup/hugepages.sh@52 -- # local node_ids 00:02:43.310 11:27:03 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:43.310 11:27:03 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:43.310 11:27:03 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:02:43.310 11:27:03 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:02:43.310 11:27:03 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:43.310 11:27:03 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:43.310 11:27:03 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:43.310 11:27:03 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:43.310 11:27:03 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:43.310 11:27:03 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:02:43.310 11:27:03 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:43.310 11:27:03 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:43.310 11:27:03 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:43.310 11:27:03 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:43.310 11:27:03 -- setup/hugepages.sh@73 -- # return 0 00:02:43.310 11:27:03 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:02:43.310 11:27:03 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:02:43.310 11:27:03 -- setup/hugepages.sh@146 -- # setup output 00:02:43.310 11:27:03 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:43.310 11:27:03 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:44.319 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:44.319 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:44.319 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:44.581 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:44.581 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:44.581 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:44.581 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:44.581 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:44.581 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:44.581 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:44.581 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:44.581 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:44.581 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:44.581 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:44.581 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:44.581 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:44.581 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:44.581 11:27:04 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:02:44.581 11:27:04 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:02:44.581 11:27:04 -- setup/hugepages.sh@89 -- # local node 00:02:44.581 11:27:04 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:44.581 11:27:04 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:44.581 11:27:04 -- setup/hugepages.sh@92 -- # local surp 00:02:44.581 11:27:04 -- setup/hugepages.sh@93 -- # local resv 00:02:44.581 11:27:04 -- setup/hugepages.sh@94 -- # local anon 00:02:44.581 11:27:04 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:44.581 11:27:04 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:44.581 11:27:04 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:44.581 11:27:04 -- setup/common.sh@18 -- # local node= 00:02:44.581 11:27:04 -- setup/common.sh@19 -- # local var val 00:02:44.581 11:27:04 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.581 11:27:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.581 11:27:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:44.581 11:27:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:44.581 11:27:04 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.581 11:27:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45122784 kB' 'MemAvailable: 48894188 kB' 'Buffers: 2708 kB' 'Cached: 10741920 kB' 'SwapCached: 0 kB' 'Active: 7466936 kB' 'Inactive: 3764112 kB' 'Active(anon): 7066456 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489552 kB' 'Mapped: 211968 kB' 'Shmem: 6580036 kB' 'KReclaimable: 200780 kB' 'Slab: 741416 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540636 kB' 'KernelStack: 12896 kB' 'PageTables: 8496 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8148072 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198588 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.581 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.581 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.582 11:27:04 -- setup/common.sh@33 -- # echo 0 00:02:44.582 11:27:04 -- setup/common.sh@33 -- # return 0 00:02:44.582 11:27:04 -- setup/hugepages.sh@97 -- # anon=0 00:02:44.582 11:27:04 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:44.582 11:27:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:44.582 11:27:04 -- setup/common.sh@18 -- # local node= 00:02:44.582 11:27:04 -- setup/common.sh@19 -- # local var val 00:02:44.582 11:27:04 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.582 11:27:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.582 11:27:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:44.582 11:27:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:44.582 11:27:04 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.582 11:27:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45138980 kB' 'MemAvailable: 48910384 kB' 'Buffers: 2708 kB' 'Cached: 10741924 kB' 'SwapCached: 0 kB' 'Active: 7466992 kB' 'Inactive: 3764112 kB' 'Active(anon): 7066512 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489568 kB' 'Mapped: 211972 kB' 'Shmem: 6580040 kB' 'KReclaimable: 200780 kB' 'Slab: 741384 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540604 kB' 'KernelStack: 12864 kB' 'PageTables: 8356 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8148084 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198556 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.582 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.582 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.583 11:27:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.583 11:27:04 -- setup/common.sh@33 -- # echo 0 00:02:44.583 11:27:04 -- setup/common.sh@33 -- # return 0 00:02:44.583 11:27:04 -- setup/hugepages.sh@99 -- # surp=0 00:02:44.583 11:27:04 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:44.583 11:27:04 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:44.583 11:27:04 -- setup/common.sh@18 -- # local node= 00:02:44.583 11:27:04 -- setup/common.sh@19 -- # local var val 00:02:44.583 11:27:04 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.583 11:27:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.583 11:27:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:44.583 11:27:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:44.583 11:27:04 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.583 11:27:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.583 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45139816 kB' 'MemAvailable: 48911220 kB' 'Buffers: 2708 kB' 'Cached: 10741936 kB' 'SwapCached: 0 kB' 'Active: 7466768 kB' 'Inactive: 3764112 kB' 'Active(anon): 7066288 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489380 kB' 'Mapped: 211944 kB' 'Shmem: 6580052 kB' 'KReclaimable: 200780 kB' 'Slab: 741472 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540692 kB' 'KernelStack: 12928 kB' 'PageTables: 8536 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8148096 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198540 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.584 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.584 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.585 11:27:04 -- setup/common.sh@33 -- # echo 0 00:02:44.585 11:27:04 -- setup/common.sh@33 -- # return 0 00:02:44.585 11:27:04 -- setup/hugepages.sh@100 -- # resv=0 00:02:44.585 11:27:04 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:44.585 nr_hugepages=1024 00:02:44.585 11:27:04 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:44.585 resv_hugepages=0 00:02:44.585 11:27:04 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:44.585 surplus_hugepages=0 00:02:44.585 11:27:04 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:44.585 anon_hugepages=0 00:02:44.585 11:27:04 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:44.585 11:27:04 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:44.585 11:27:04 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:44.585 11:27:04 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:44.585 11:27:04 -- setup/common.sh@18 -- # local node= 00:02:44.585 11:27:04 -- setup/common.sh@19 -- # local var val 00:02:44.585 11:27:04 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.585 11:27:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.585 11:27:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:44.585 11:27:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:44.585 11:27:04 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.585 11:27:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45139592 kB' 'MemAvailable: 48910996 kB' 'Buffers: 2708 kB' 'Cached: 10741940 kB' 'SwapCached: 0 kB' 'Active: 7466496 kB' 'Inactive: 3764112 kB' 'Active(anon): 7066016 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489108 kB' 'Mapped: 211944 kB' 'Shmem: 6580056 kB' 'KReclaimable: 200780 kB' 'Slab: 741472 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540692 kB' 'KernelStack: 12928 kB' 'PageTables: 8536 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8148112 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198540 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.585 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.585 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.586 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.586 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.587 11:27:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.587 11:27:04 -- setup/common.sh@33 -- # echo 1024 00:02:44.587 11:27:04 -- setup/common.sh@33 -- # return 0 00:02:44.587 11:27:04 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:44.587 11:27:04 -- setup/hugepages.sh@112 -- # get_nodes 00:02:44.587 11:27:04 -- setup/hugepages.sh@27 -- # local node 00:02:44.587 11:27:04 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:44.587 11:27:04 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:44.587 11:27:04 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:44.587 11:27:04 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:44.846 11:27:04 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:44.846 11:27:04 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:44.846 11:27:04 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:44.846 11:27:04 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:44.846 11:27:04 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:44.846 11:27:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:44.846 11:27:04 -- setup/common.sh@18 -- # local node=0 00:02:44.846 11:27:04 -- setup/common.sh@19 -- # local var val 00:02:44.846 11:27:04 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.846 11:27:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.846 11:27:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:44.846 11:27:04 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:44.846 11:27:04 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.846 11:27:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27481848 kB' 'MemUsed: 5344008 kB' 'SwapCached: 0 kB' 'Active: 2822608 kB' 'Inactive: 177232 kB' 'Active(anon): 2665884 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 177232 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2641976 kB' 'Mapped: 113368 kB' 'AnonPages: 361016 kB' 'Shmem: 2308020 kB' 'KernelStack: 7368 kB' 'PageTables: 4828 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 119464 kB' 'Slab: 452828 kB' 'SReclaimable: 119464 kB' 'SUnreclaim: 333364 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.846 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.846 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@33 -- # echo 0 00:02:44.847 11:27:04 -- setup/common.sh@33 -- # return 0 00:02:44.847 11:27:04 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:44.847 11:27:04 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:44.847 11:27:04 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:44.847 11:27:04 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:44.847 11:27:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:44.847 11:27:04 -- setup/common.sh@18 -- # local node=1 00:02:44.847 11:27:04 -- setup/common.sh@19 -- # local var val 00:02:44.847 11:27:04 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.847 11:27:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.847 11:27:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:44.847 11:27:04 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:44.847 11:27:04 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.847 11:27:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 17656988 kB' 'MemUsed: 10052804 kB' 'SwapCached: 0 kB' 'Active: 4644152 kB' 'Inactive: 3586880 kB' 'Active(anon): 4400396 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3586880 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8102700 kB' 'Mapped: 98576 kB' 'AnonPages: 128332 kB' 'Shmem: 4272064 kB' 'KernelStack: 5544 kB' 'PageTables: 3664 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 81316 kB' 'Slab: 288644 kB' 'SReclaimable: 81316 kB' 'SUnreclaim: 207328 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.847 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.847 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # continue 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.848 11:27:04 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.848 11:27:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.848 11:27:04 -- setup/common.sh@33 -- # echo 0 00:02:44.848 11:27:04 -- setup/common.sh@33 -- # return 0 00:02:44.848 11:27:04 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:44.848 11:27:04 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:44.848 11:27:04 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:44.848 11:27:04 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:44.848 11:27:04 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:44.848 node0=512 expecting 512 00:02:44.848 11:27:04 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:44.848 11:27:04 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:44.848 11:27:04 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:44.848 11:27:04 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:44.848 node1=512 expecting 512 00:02:44.848 11:27:04 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:44.848 00:02:44.848 real 0m1.469s 00:02:44.848 user 0m0.639s 00:02:44.848 sys 0m0.797s 00:02:44.848 11:27:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:44.848 11:27:04 -- common/autotest_common.sh@10 -- # set +x 00:02:44.848 ************************************ 00:02:44.848 END TEST per_node_1G_alloc 00:02:44.848 ************************************ 00:02:44.848 11:27:04 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:02:44.848 11:27:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:44.848 11:27:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:44.848 11:27:04 -- common/autotest_common.sh@10 -- # set +x 00:02:44.848 ************************************ 00:02:44.848 START TEST even_2G_alloc 00:02:44.848 ************************************ 00:02:44.848 11:27:04 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:02:44.848 11:27:04 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:02:44.848 11:27:04 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:44.848 11:27:04 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:44.848 11:27:04 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:44.848 11:27:04 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:44.848 11:27:04 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:44.848 11:27:04 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:44.848 11:27:04 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:44.848 11:27:04 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:44.848 11:27:04 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:44.848 11:27:04 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:44.848 11:27:04 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:44.848 11:27:04 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:44.848 11:27:04 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:44.848 11:27:04 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:44.848 11:27:04 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:44.848 11:27:04 -- setup/hugepages.sh@83 -- # : 512 00:02:44.848 11:27:04 -- setup/hugepages.sh@84 -- # : 1 00:02:44.848 11:27:04 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:44.848 11:27:04 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:44.848 11:27:04 -- setup/hugepages.sh@83 -- # : 0 00:02:44.848 11:27:04 -- setup/hugepages.sh@84 -- # : 0 00:02:44.848 11:27:04 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:44.848 11:27:04 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:02:44.848 11:27:04 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:02:44.848 11:27:04 -- setup/hugepages.sh@153 -- # setup output 00:02:44.848 11:27:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:44.848 11:27:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:46.230 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:46.230 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:46.230 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:46.230 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:46.230 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:46.230 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:46.230 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:46.230 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:46.230 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:46.230 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:46.230 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:46.230 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:46.230 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:46.230 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:46.230 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:46.230 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:46.230 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:46.230 11:27:06 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:02:46.230 11:27:06 -- setup/hugepages.sh@89 -- # local node 00:02:46.230 11:27:06 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:46.230 11:27:06 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:46.230 11:27:06 -- setup/hugepages.sh@92 -- # local surp 00:02:46.230 11:27:06 -- setup/hugepages.sh@93 -- # local resv 00:02:46.230 11:27:06 -- setup/hugepages.sh@94 -- # local anon 00:02:46.230 11:27:06 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:46.230 11:27:06 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:46.230 11:27:06 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:46.230 11:27:06 -- setup/common.sh@18 -- # local node= 00:02:46.230 11:27:06 -- setup/common.sh@19 -- # local var val 00:02:46.230 11:27:06 -- setup/common.sh@20 -- # local mem_f mem 00:02:46.230 11:27:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:46.230 11:27:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:46.230 11:27:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:46.230 11:27:06 -- setup/common.sh@28 -- # mapfile -t mem 00:02:46.230 11:27:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45119920 kB' 'MemAvailable: 48891324 kB' 'Buffers: 2708 kB' 'Cached: 10742016 kB' 'SwapCached: 0 kB' 'Active: 7470248 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069768 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 492936 kB' 'Mapped: 212004 kB' 'Shmem: 6580132 kB' 'KReclaimable: 200780 kB' 'Slab: 741956 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 541176 kB' 'KernelStack: 12976 kB' 'PageTables: 8696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8154608 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198556 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.230 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.230 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.231 11:27:06 -- setup/common.sh@33 -- # echo 0 00:02:46.231 11:27:06 -- setup/common.sh@33 -- # return 0 00:02:46.231 11:27:06 -- setup/hugepages.sh@97 -- # anon=0 00:02:46.231 11:27:06 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:46.231 11:27:06 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:46.231 11:27:06 -- setup/common.sh@18 -- # local node= 00:02:46.231 11:27:06 -- setup/common.sh@19 -- # local var val 00:02:46.231 11:27:06 -- setup/common.sh@20 -- # local mem_f mem 00:02:46.231 11:27:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:46.231 11:27:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:46.231 11:27:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:46.231 11:27:06 -- setup/common.sh@28 -- # mapfile -t mem 00:02:46.231 11:27:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45122752 kB' 'MemAvailable: 48894156 kB' 'Buffers: 2708 kB' 'Cached: 10742020 kB' 'SwapCached: 0 kB' 'Active: 7473704 kB' 'Inactive: 3764112 kB' 'Active(anon): 7073224 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 496440 kB' 'Mapped: 212012 kB' 'Shmem: 6580136 kB' 'KReclaimable: 200780 kB' 'Slab: 741964 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 541184 kB' 'KernelStack: 12912 kB' 'PageTables: 8536 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8154424 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198512 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.231 11:27:06 -- setup/common.sh@33 -- # echo 0 00:02:46.231 11:27:06 -- setup/common.sh@33 -- # return 0 00:02:46.231 11:27:06 -- setup/hugepages.sh@99 -- # surp=0 00:02:46.231 11:27:06 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:46.231 11:27:06 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:46.231 11:27:06 -- setup/common.sh@18 -- # local node= 00:02:46.231 11:27:06 -- setup/common.sh@19 -- # local var val 00:02:46.231 11:27:06 -- setup/common.sh@20 -- # local mem_f mem 00:02:46.231 11:27:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:46.231 11:27:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:46.231 11:27:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:46.231 11:27:06 -- setup/common.sh@28 -- # mapfile -t mem 00:02:46.231 11:27:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.231 11:27:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45122476 kB' 'MemAvailable: 48893880 kB' 'Buffers: 2708 kB' 'Cached: 10742028 kB' 'SwapCached: 0 kB' 'Active: 7472520 kB' 'Inactive: 3764112 kB' 'Active(anon): 7072040 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495192 kB' 'Mapped: 211964 kB' 'Shmem: 6580144 kB' 'KReclaimable: 200780 kB' 'Slab: 742008 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 541228 kB' 'KernelStack: 12944 kB' 'PageTables: 8564 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8154440 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198512 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.231 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.231 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.232 11:27:06 -- setup/common.sh@33 -- # echo 0 00:02:46.232 11:27:06 -- setup/common.sh@33 -- # return 0 00:02:46.232 11:27:06 -- setup/hugepages.sh@100 -- # resv=0 00:02:46.232 11:27:06 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:46.232 nr_hugepages=1024 00:02:46.232 11:27:06 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:46.232 resv_hugepages=0 00:02:46.232 11:27:06 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:46.232 surplus_hugepages=0 00:02:46.232 11:27:06 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:46.232 anon_hugepages=0 00:02:46.232 11:27:06 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:46.232 11:27:06 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:46.232 11:27:06 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:46.232 11:27:06 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:46.232 11:27:06 -- setup/common.sh@18 -- # local node= 00:02:46.232 11:27:06 -- setup/common.sh@19 -- # local var val 00:02:46.232 11:27:06 -- setup/common.sh@20 -- # local mem_f mem 00:02:46.232 11:27:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:46.232 11:27:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:46.232 11:27:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:46.232 11:27:06 -- setup/common.sh@28 -- # mapfile -t mem 00:02:46.232 11:27:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45123648 kB' 'MemAvailable: 48895052 kB' 'Buffers: 2708 kB' 'Cached: 10742044 kB' 'SwapCached: 0 kB' 'Active: 7466864 kB' 'Inactive: 3764112 kB' 'Active(anon): 7066384 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489520 kB' 'Mapped: 211964 kB' 'Shmem: 6580160 kB' 'KReclaimable: 200780 kB' 'Slab: 742008 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 541228 kB' 'KernelStack: 12944 kB' 'PageTables: 8564 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8148136 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198508 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.232 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.232 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.233 11:27:06 -- setup/common.sh@33 -- # echo 1024 00:02:46.233 11:27:06 -- setup/common.sh@33 -- # return 0 00:02:46.233 11:27:06 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:46.233 11:27:06 -- setup/hugepages.sh@112 -- # get_nodes 00:02:46.233 11:27:06 -- setup/hugepages.sh@27 -- # local node 00:02:46.233 11:27:06 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:46.233 11:27:06 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:46.233 11:27:06 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:46.233 11:27:06 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:46.233 11:27:06 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:46.233 11:27:06 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:46.233 11:27:06 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:46.233 11:27:06 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:46.233 11:27:06 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:46.233 11:27:06 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:46.233 11:27:06 -- setup/common.sh@18 -- # local node=0 00:02:46.233 11:27:06 -- setup/common.sh@19 -- # local var val 00:02:46.233 11:27:06 -- setup/common.sh@20 -- # local mem_f mem 00:02:46.233 11:27:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:46.233 11:27:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:46.233 11:27:06 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:46.233 11:27:06 -- setup/common.sh@28 -- # mapfile -t mem 00:02:46.233 11:27:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27473088 kB' 'MemUsed: 5352768 kB' 'SwapCached: 0 kB' 'Active: 2826056 kB' 'Inactive: 177232 kB' 'Active(anon): 2669332 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 177232 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2642016 kB' 'Mapped: 113376 kB' 'AnonPages: 364460 kB' 'Shmem: 2308060 kB' 'KernelStack: 7384 kB' 'PageTables: 4872 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 119464 kB' 'Slab: 453096 kB' 'SReclaimable: 119464 kB' 'SUnreclaim: 333632 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.233 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.233 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@33 -- # echo 0 00:02:46.234 11:27:06 -- setup/common.sh@33 -- # return 0 00:02:46.234 11:27:06 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:46.234 11:27:06 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:46.234 11:27:06 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:46.234 11:27:06 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:46.234 11:27:06 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:46.234 11:27:06 -- setup/common.sh@18 -- # local node=1 00:02:46.234 11:27:06 -- setup/common.sh@19 -- # local var val 00:02:46.234 11:27:06 -- setup/common.sh@20 -- # local mem_f mem 00:02:46.234 11:27:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:46.234 11:27:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:46.234 11:27:06 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:46.234 11:27:06 -- setup/common.sh@28 -- # mapfile -t mem 00:02:46.234 11:27:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 17651484 kB' 'MemUsed: 10058308 kB' 'SwapCached: 0 kB' 'Active: 4644164 kB' 'Inactive: 3586880 kB' 'Active(anon): 4400408 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3586880 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8102764 kB' 'Mapped: 98576 kB' 'AnonPages: 128356 kB' 'Shmem: 4272128 kB' 'KernelStack: 5512 kB' 'PageTables: 3536 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 81316 kB' 'Slab: 288912 kB' 'SReclaimable: 81316 kB' 'SUnreclaim: 207596 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # continue 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.234 11:27:06 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.234 11:27:06 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.234 11:27:06 -- setup/common.sh@33 -- # echo 0 00:02:46.234 11:27:06 -- setup/common.sh@33 -- # return 0 00:02:46.234 11:27:06 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:46.234 11:27:06 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:46.234 11:27:06 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:46.234 11:27:06 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:46.234 11:27:06 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:46.234 node0=512 expecting 512 00:02:46.234 11:27:06 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:46.234 11:27:06 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:46.234 11:27:06 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:46.234 11:27:06 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:46.234 node1=512 expecting 512 00:02:46.234 11:27:06 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:46.234 00:02:46.234 real 0m1.533s 00:02:46.234 user 0m0.641s 00:02:46.234 sys 0m0.860s 00:02:46.234 11:27:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:46.234 11:27:06 -- common/autotest_common.sh@10 -- # set +x 00:02:46.234 ************************************ 00:02:46.234 END TEST even_2G_alloc 00:02:46.234 ************************************ 00:02:46.234 11:27:06 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:02:46.234 11:27:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:46.234 11:27:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:46.234 11:27:06 -- common/autotest_common.sh@10 -- # set +x 00:02:46.234 ************************************ 00:02:46.234 START TEST odd_alloc 00:02:46.234 ************************************ 00:02:46.234 11:27:06 -- common/autotest_common.sh@1114 -- # odd_alloc 00:02:46.234 11:27:06 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:02:46.234 11:27:06 -- setup/hugepages.sh@49 -- # local size=2098176 00:02:46.234 11:27:06 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:46.234 11:27:06 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:46.234 11:27:06 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:02:46.234 11:27:06 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:46.234 11:27:06 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:46.234 11:27:06 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:46.234 11:27:06 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:02:46.234 11:27:06 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:46.234 11:27:06 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:46.234 11:27:06 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:46.234 11:27:06 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:46.234 11:27:06 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:46.234 11:27:06 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:46.234 11:27:06 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:46.234 11:27:06 -- setup/hugepages.sh@83 -- # : 513 00:02:46.234 11:27:06 -- setup/hugepages.sh@84 -- # : 1 00:02:46.234 11:27:06 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:46.234 11:27:06 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:02:46.234 11:27:06 -- setup/hugepages.sh@83 -- # : 0 00:02:46.234 11:27:06 -- setup/hugepages.sh@84 -- # : 0 00:02:46.234 11:27:06 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:46.234 11:27:06 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:02:46.234 11:27:06 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:02:46.234 11:27:06 -- setup/hugepages.sh@160 -- # setup output 00:02:46.234 11:27:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:46.234 11:27:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:47.621 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:47.621 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:47.621 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:47.621 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:47.621 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:47.621 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:47.621 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:47.621 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:47.621 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:47.621 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:47.621 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:47.621 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:47.621 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:47.621 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:47.621 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:47.621 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:47.621 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:47.621 11:27:07 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:02:47.621 11:27:07 -- setup/hugepages.sh@89 -- # local node 00:02:47.621 11:27:07 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:47.621 11:27:07 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:47.621 11:27:07 -- setup/hugepages.sh@92 -- # local surp 00:02:47.621 11:27:07 -- setup/hugepages.sh@93 -- # local resv 00:02:47.621 11:27:07 -- setup/hugepages.sh@94 -- # local anon 00:02:47.621 11:27:07 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:47.621 11:27:07 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:47.621 11:27:07 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:47.621 11:27:07 -- setup/common.sh@18 -- # local node= 00:02:47.621 11:27:07 -- setup/common.sh@19 -- # local var val 00:02:47.621 11:27:07 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.621 11:27:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.621 11:27:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.621 11:27:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.621 11:27:07 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.621 11:27:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45134096 kB' 'MemAvailable: 48905500 kB' 'Buffers: 2708 kB' 'Cached: 10742104 kB' 'SwapCached: 0 kB' 'Active: 7466984 kB' 'Inactive: 3764112 kB' 'Active(anon): 7066504 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489544 kB' 'Mapped: 210724 kB' 'Shmem: 6580220 kB' 'KReclaimable: 200780 kB' 'Slab: 741604 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540824 kB' 'KernelStack: 13248 kB' 'PageTables: 9488 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 8139616 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198652 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.621 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.621 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.622 11:27:07 -- setup/common.sh@33 -- # echo 0 00:02:47.622 11:27:07 -- setup/common.sh@33 -- # return 0 00:02:47.622 11:27:07 -- setup/hugepages.sh@97 -- # anon=0 00:02:47.622 11:27:07 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:47.622 11:27:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:47.622 11:27:07 -- setup/common.sh@18 -- # local node= 00:02:47.622 11:27:07 -- setup/common.sh@19 -- # local var val 00:02:47.622 11:27:07 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.622 11:27:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.622 11:27:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.622 11:27:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.622 11:27:07 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.622 11:27:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45132952 kB' 'MemAvailable: 48904356 kB' 'Buffers: 2708 kB' 'Cached: 10742104 kB' 'SwapCached: 0 kB' 'Active: 7467968 kB' 'Inactive: 3764112 kB' 'Active(anon): 7067488 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490460 kB' 'Mapped: 210808 kB' 'Shmem: 6580220 kB' 'KReclaimable: 200780 kB' 'Slab: 741564 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540784 kB' 'KernelStack: 13248 kB' 'PageTables: 9328 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 8139628 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198620 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.622 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.622 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.623 11:27:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.623 11:27:07 -- setup/common.sh@33 -- # echo 0 00:02:47.623 11:27:07 -- setup/common.sh@33 -- # return 0 00:02:47.623 11:27:07 -- setup/hugepages.sh@99 -- # surp=0 00:02:47.623 11:27:07 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:47.623 11:27:07 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:47.623 11:27:07 -- setup/common.sh@18 -- # local node= 00:02:47.623 11:27:07 -- setup/common.sh@19 -- # local var val 00:02:47.623 11:27:07 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.623 11:27:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.623 11:27:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.623 11:27:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.623 11:27:07 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.623 11:27:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.623 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45132636 kB' 'MemAvailable: 48904040 kB' 'Buffers: 2708 kB' 'Cached: 10742116 kB' 'SwapCached: 0 kB' 'Active: 7467344 kB' 'Inactive: 3764112 kB' 'Active(anon): 7066864 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489772 kB' 'Mapped: 210792 kB' 'Shmem: 6580232 kB' 'KReclaimable: 200780 kB' 'Slab: 741564 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540784 kB' 'KernelStack: 13056 kB' 'PageTables: 9164 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 8135616 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198636 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.624 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.624 11:27:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.625 11:27:07 -- setup/common.sh@33 -- # echo 0 00:02:47.625 11:27:07 -- setup/common.sh@33 -- # return 0 00:02:47.625 11:27:07 -- setup/hugepages.sh@100 -- # resv=0 00:02:47.625 11:27:07 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:02:47.625 nr_hugepages=1025 00:02:47.625 11:27:07 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:47.625 resv_hugepages=0 00:02:47.625 11:27:07 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:47.625 surplus_hugepages=0 00:02:47.625 11:27:07 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:47.625 anon_hugepages=0 00:02:47.625 11:27:07 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:47.625 11:27:07 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:02:47.625 11:27:07 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:47.625 11:27:07 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:47.625 11:27:07 -- setup/common.sh@18 -- # local node= 00:02:47.625 11:27:07 -- setup/common.sh@19 -- # local var val 00:02:47.625 11:27:07 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.625 11:27:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.625 11:27:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.625 11:27:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.625 11:27:07 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.625 11:27:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45132480 kB' 'MemAvailable: 48903884 kB' 'Buffers: 2708 kB' 'Cached: 10742132 kB' 'SwapCached: 0 kB' 'Active: 7465980 kB' 'Inactive: 3764112 kB' 'Active(anon): 7065500 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 488380 kB' 'Mapped: 210776 kB' 'Shmem: 6580248 kB' 'KReclaimable: 200780 kB' 'Slab: 741536 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540756 kB' 'KernelStack: 12848 kB' 'PageTables: 8052 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 8135628 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198476 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.625 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.625 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.626 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.626 11:27:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.626 11:27:07 -- setup/common.sh@33 -- # echo 1025 00:02:47.626 11:27:07 -- setup/common.sh@33 -- # return 0 00:02:47.626 11:27:07 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:47.626 11:27:07 -- setup/hugepages.sh@112 -- # get_nodes 00:02:47.626 11:27:07 -- setup/hugepages.sh@27 -- # local node 00:02:47.626 11:27:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:47.626 11:27:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:47.626 11:27:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:47.626 11:27:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:02:47.626 11:27:07 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:47.626 11:27:07 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:47.626 11:27:07 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:47.626 11:27:07 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:47.626 11:27:07 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:47.626 11:27:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:47.626 11:27:07 -- setup/common.sh@18 -- # local node=0 00:02:47.626 11:27:07 -- setup/common.sh@19 -- # local var val 00:02:47.626 11:27:07 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.627 11:27:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.627 11:27:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:47.627 11:27:07 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:47.627 11:27:07 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.627 11:27:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27489348 kB' 'MemUsed: 5336508 kB' 'SwapCached: 0 kB' 'Active: 2827848 kB' 'Inactive: 177232 kB' 'Active(anon): 2671124 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 177232 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2642012 kB' 'Mapped: 112400 kB' 'AnonPages: 366216 kB' 'Shmem: 2308056 kB' 'KernelStack: 7368 kB' 'PageTables: 4756 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 119464 kB' 'Slab: 452708 kB' 'SReclaimable: 119464 kB' 'SUnreclaim: 333244 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.627 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.627 11:27:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.627 11:27:07 -- setup/common.sh@33 -- # echo 0 00:02:47.628 11:27:07 -- setup/common.sh@33 -- # return 0 00:02:47.628 11:27:07 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:47.628 11:27:07 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:47.628 11:27:07 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:47.628 11:27:07 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:47.628 11:27:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:47.628 11:27:07 -- setup/common.sh@18 -- # local node=1 00:02:47.628 11:27:07 -- setup/common.sh@19 -- # local var val 00:02:47.628 11:27:07 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.628 11:27:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.628 11:27:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:47.628 11:27:07 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:47.628 11:27:07 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.628 11:27:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 17642880 kB' 'MemUsed: 10066912 kB' 'SwapCached: 0 kB' 'Active: 4638224 kB' 'Inactive: 3586880 kB' 'Active(anon): 4394468 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3586880 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8102856 kB' 'Mapped: 98368 kB' 'AnonPages: 122332 kB' 'Shmem: 4272220 kB' 'KernelStack: 5544 kB' 'PageTables: 3476 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 81316 kB' 'Slab: 288836 kB' 'SReclaimable: 81316 kB' 'SUnreclaim: 207520 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.628 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.628 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.629 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.629 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.629 11:27:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.629 11:27:07 -- setup/common.sh@32 -- # continue 00:02:47.629 11:27:07 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.629 11:27:07 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.629 11:27:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.629 11:27:07 -- setup/common.sh@33 -- # echo 0 00:02:47.629 11:27:07 -- setup/common.sh@33 -- # return 0 00:02:47.629 11:27:07 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:47.629 11:27:07 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:47.629 11:27:07 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:47.629 11:27:07 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:47.629 11:27:07 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:02:47.629 node0=512 expecting 513 00:02:47.629 11:27:07 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:47.629 11:27:07 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:47.629 11:27:07 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:47.629 11:27:07 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:02:47.629 node1=513 expecting 512 00:02:47.629 11:27:07 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:02:47.629 00:02:47.629 real 0m1.402s 00:02:47.629 user 0m0.590s 00:02:47.629 sys 0m0.777s 00:02:47.629 11:27:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:47.629 11:27:07 -- common/autotest_common.sh@10 -- # set +x 00:02:47.629 ************************************ 00:02:47.629 END TEST odd_alloc 00:02:47.629 ************************************ 00:02:47.888 11:27:07 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:02:47.889 11:27:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:47.889 11:27:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:47.889 11:27:07 -- common/autotest_common.sh@10 -- # set +x 00:02:47.889 ************************************ 00:02:47.889 START TEST custom_alloc 00:02:47.889 ************************************ 00:02:47.889 11:27:07 -- common/autotest_common.sh@1114 -- # custom_alloc 00:02:47.889 11:27:07 -- setup/hugepages.sh@167 -- # local IFS=, 00:02:47.889 11:27:07 -- setup/hugepages.sh@169 -- # local node 00:02:47.889 11:27:07 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:02:47.889 11:27:07 -- setup/hugepages.sh@170 -- # local nodes_hp 00:02:47.889 11:27:07 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:02:47.889 11:27:07 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:02:47.889 11:27:07 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:47.889 11:27:07 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:47.889 11:27:07 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:47.889 11:27:07 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:47.889 11:27:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:47.889 11:27:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:47.889 11:27:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:47.889 11:27:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:47.889 11:27:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:47.889 11:27:07 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:47.889 11:27:07 -- setup/hugepages.sh@83 -- # : 256 00:02:47.889 11:27:07 -- setup/hugepages.sh@84 -- # : 1 00:02:47.889 11:27:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:47.889 11:27:07 -- setup/hugepages.sh@83 -- # : 0 00:02:47.889 11:27:07 -- setup/hugepages.sh@84 -- # : 0 00:02:47.889 11:27:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:02:47.889 11:27:07 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:02:47.889 11:27:07 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:47.889 11:27:07 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:47.889 11:27:07 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:47.889 11:27:07 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:47.889 11:27:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:47.889 11:27:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:47.889 11:27:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:47.889 11:27:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:47.889 11:27:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:47.889 11:27:07 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:47.889 11:27:07 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:47.889 11:27:07 -- setup/hugepages.sh@78 -- # return 0 00:02:47.889 11:27:07 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:02:47.889 11:27:07 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:47.889 11:27:07 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:47.889 11:27:07 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:47.889 11:27:07 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:47.889 11:27:07 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:02:47.889 11:27:07 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:47.889 11:27:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:47.889 11:27:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:47.889 11:27:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:47.889 11:27:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:47.889 11:27:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:47.889 11:27:07 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:02:47.889 11:27:07 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:47.889 11:27:07 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:47.889 11:27:07 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:47.889 11:27:07 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:02:47.889 11:27:07 -- setup/hugepages.sh@78 -- # return 0 00:02:47.889 11:27:07 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:02:47.889 11:27:07 -- setup/hugepages.sh@187 -- # setup output 00:02:47.889 11:27:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:47.889 11:27:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:49.272 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:49.272 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:49.272 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:49.272 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:49.272 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:49.272 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:49.272 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:49.272 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:49.272 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:49.272 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:49.272 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:49.272 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:49.272 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:49.272 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:49.272 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:49.272 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:49.272 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:49.272 11:27:09 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:02:49.272 11:27:09 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:02:49.272 11:27:09 -- setup/hugepages.sh@89 -- # local node 00:02:49.272 11:27:09 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:49.272 11:27:09 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:49.272 11:27:09 -- setup/hugepages.sh@92 -- # local surp 00:02:49.272 11:27:09 -- setup/hugepages.sh@93 -- # local resv 00:02:49.272 11:27:09 -- setup/hugepages.sh@94 -- # local anon 00:02:49.272 11:27:09 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:49.272 11:27:09 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:49.272 11:27:09 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:49.272 11:27:09 -- setup/common.sh@18 -- # local node= 00:02:49.272 11:27:09 -- setup/common.sh@19 -- # local var val 00:02:49.272 11:27:09 -- setup/common.sh@20 -- # local mem_f mem 00:02:49.272 11:27:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:49.272 11:27:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:49.272 11:27:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:49.272 11:27:09 -- setup/common.sh@28 -- # mapfile -t mem 00:02:49.272 11:27:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.272 11:27:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 44049812 kB' 'MemAvailable: 47821216 kB' 'Buffers: 2708 kB' 'Cached: 10742192 kB' 'SwapCached: 0 kB' 'Active: 7460596 kB' 'Inactive: 3764112 kB' 'Active(anon): 7060116 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482692 kB' 'Mapped: 210620 kB' 'Shmem: 6580308 kB' 'KReclaimable: 200780 kB' 'Slab: 741300 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540520 kB' 'KernelStack: 12960 kB' 'PageTables: 8316 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 8127552 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198504 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.272 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.272 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.273 11:27:09 -- setup/common.sh@33 -- # echo 0 00:02:49.273 11:27:09 -- setup/common.sh@33 -- # return 0 00:02:49.273 11:27:09 -- setup/hugepages.sh@97 -- # anon=0 00:02:49.273 11:27:09 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:49.273 11:27:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:49.273 11:27:09 -- setup/common.sh@18 -- # local node= 00:02:49.273 11:27:09 -- setup/common.sh@19 -- # local var val 00:02:49.273 11:27:09 -- setup/common.sh@20 -- # local mem_f mem 00:02:49.273 11:27:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:49.273 11:27:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:49.273 11:27:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:49.273 11:27:09 -- setup/common.sh@28 -- # mapfile -t mem 00:02:49.273 11:27:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.273 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.273 11:27:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 44053176 kB' 'MemAvailable: 47824580 kB' 'Buffers: 2708 kB' 'Cached: 10742204 kB' 'SwapCached: 0 kB' 'Active: 7460392 kB' 'Inactive: 3764112 kB' 'Active(anon): 7059912 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482476 kB' 'Mapped: 210156 kB' 'Shmem: 6580320 kB' 'KReclaimable: 200780 kB' 'Slab: 741260 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540480 kB' 'KernelStack: 12928 kB' 'PageTables: 8156 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 8127564 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:49.273 11:27:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.274 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.274 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.275 11:27:09 -- setup/common.sh@33 -- # echo 0 00:02:49.275 11:27:09 -- setup/common.sh@33 -- # return 0 00:02:49.275 11:27:09 -- setup/hugepages.sh@99 -- # surp=0 00:02:49.275 11:27:09 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:49.275 11:27:09 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:49.275 11:27:09 -- setup/common.sh@18 -- # local node= 00:02:49.275 11:27:09 -- setup/common.sh@19 -- # local var val 00:02:49.275 11:27:09 -- setup/common.sh@20 -- # local mem_f mem 00:02:49.275 11:27:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:49.275 11:27:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:49.275 11:27:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:49.275 11:27:09 -- setup/common.sh@28 -- # mapfile -t mem 00:02:49.275 11:27:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 44053352 kB' 'MemAvailable: 47824756 kB' 'Buffers: 2708 kB' 'Cached: 10742220 kB' 'SwapCached: 0 kB' 'Active: 7459420 kB' 'Inactive: 3764112 kB' 'Active(anon): 7058940 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481920 kB' 'Mapped: 210068 kB' 'Shmem: 6580336 kB' 'KReclaimable: 200780 kB' 'Slab: 741260 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540480 kB' 'KernelStack: 12928 kB' 'PageTables: 8136 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 8127184 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.275 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.275 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.276 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.276 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.277 11:27:09 -- setup/common.sh@33 -- # echo 0 00:02:49.277 11:27:09 -- setup/common.sh@33 -- # return 0 00:02:49.277 11:27:09 -- setup/hugepages.sh@100 -- # resv=0 00:02:49.277 11:27:09 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:02:49.277 nr_hugepages=1536 00:02:49.277 11:27:09 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:49.277 resv_hugepages=0 00:02:49.277 11:27:09 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:49.277 surplus_hugepages=0 00:02:49.277 11:27:09 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:49.277 anon_hugepages=0 00:02:49.277 11:27:09 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:02:49.277 11:27:09 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:02:49.277 11:27:09 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:49.277 11:27:09 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:49.277 11:27:09 -- setup/common.sh@18 -- # local node= 00:02:49.277 11:27:09 -- setup/common.sh@19 -- # local var val 00:02:49.277 11:27:09 -- setup/common.sh@20 -- # local mem_f mem 00:02:49.277 11:27:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:49.277 11:27:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:49.277 11:27:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:49.277 11:27:09 -- setup/common.sh@28 -- # mapfile -t mem 00:02:49.277 11:27:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 44054072 kB' 'MemAvailable: 47825476 kB' 'Buffers: 2708 kB' 'Cached: 10742232 kB' 'SwapCached: 0 kB' 'Active: 7459832 kB' 'Inactive: 3764112 kB' 'Active(anon): 7059352 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482288 kB' 'Mapped: 210068 kB' 'Shmem: 6580348 kB' 'KReclaimable: 200780 kB' 'Slab: 741240 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540460 kB' 'KernelStack: 12928 kB' 'PageTables: 8136 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 8127592 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.277 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.277 11:27:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.278 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.278 11:27:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.279 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.279 11:27:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.279 11:27:09 -- setup/common.sh@33 -- # echo 1536 00:02:49.279 11:27:09 -- setup/common.sh@33 -- # return 0 00:02:49.279 11:27:09 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:02:49.279 11:27:09 -- setup/hugepages.sh@112 -- # get_nodes 00:02:49.279 11:27:09 -- setup/hugepages.sh@27 -- # local node 00:02:49.279 11:27:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:49.279 11:27:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:49.279 11:27:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:49.279 11:27:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:49.279 11:27:09 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:49.279 11:27:09 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:49.279 11:27:09 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:49.279 11:27:09 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:49.279 11:27:09 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:49.279 11:27:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:49.279 11:27:09 -- setup/common.sh@18 -- # local node=0 00:02:49.279 11:27:09 -- setup/common.sh@19 -- # local var val 00:02:49.279 11:27:09 -- setup/common.sh@20 -- # local mem_f mem 00:02:49.279 11:27:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:49.279 11:27:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:49.279 11:27:09 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:49.280 11:27:09 -- setup/common.sh@28 -- # mapfile -t mem 00:02:49.280 11:27:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27457792 kB' 'MemUsed: 5368064 kB' 'SwapCached: 0 kB' 'Active: 2821840 kB' 'Inactive: 177232 kB' 'Active(anon): 2665116 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 177232 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2642020 kB' 'Mapped: 112252 kB' 'AnonPages: 360220 kB' 'Shmem: 2308064 kB' 'KernelStack: 7384 kB' 'PageTables: 4608 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 119464 kB' 'Slab: 452524 kB' 'SReclaimable: 119464 kB' 'SUnreclaim: 333060 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.280 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.280 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@33 -- # echo 0 00:02:49.281 11:27:09 -- setup/common.sh@33 -- # return 0 00:02:49.281 11:27:09 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:49.281 11:27:09 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:49.281 11:27:09 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:49.281 11:27:09 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:49.281 11:27:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:49.281 11:27:09 -- setup/common.sh@18 -- # local node=1 00:02:49.281 11:27:09 -- setup/common.sh@19 -- # local var val 00:02:49.281 11:27:09 -- setup/common.sh@20 -- # local mem_f mem 00:02:49.281 11:27:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:49.281 11:27:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:49.281 11:27:09 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:49.281 11:27:09 -- setup/common.sh@28 -- # mapfile -t mem 00:02:49.281 11:27:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 16596392 kB' 'MemUsed: 11113400 kB' 'SwapCached: 0 kB' 'Active: 4637784 kB' 'Inactive: 3586880 kB' 'Active(anon): 4394028 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3586880 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8102924 kB' 'Mapped: 98172 kB' 'AnonPages: 121848 kB' 'Shmem: 4272288 kB' 'KernelStack: 5512 kB' 'PageTables: 3436 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 81316 kB' 'Slab: 288680 kB' 'SReclaimable: 81316 kB' 'SUnreclaim: 207364 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.281 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.281 11:27:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # continue 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.282 11:27:09 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.282 11:27:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.282 11:27:09 -- setup/common.sh@33 -- # echo 0 00:02:49.282 11:27:09 -- setup/common.sh@33 -- # return 0 00:02:49.282 11:27:09 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:49.282 11:27:09 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:49.282 11:27:09 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:49.282 11:27:09 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:49.282 11:27:09 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:49.282 node0=512 expecting 512 00:02:49.282 11:27:09 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:49.282 11:27:09 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:49.282 11:27:09 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:49.282 11:27:09 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:02:49.282 node1=1024 expecting 1024 00:02:49.282 11:27:09 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:02:49.282 00:02:49.282 real 0m1.532s 00:02:49.282 user 0m0.608s 00:02:49.282 sys 0m0.890s 00:02:49.282 11:27:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:49.282 11:27:09 -- common/autotest_common.sh@10 -- # set +x 00:02:49.282 ************************************ 00:02:49.282 END TEST custom_alloc 00:02:49.282 ************************************ 00:02:49.282 11:27:09 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:02:49.282 11:27:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:49.282 11:27:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:49.282 11:27:09 -- common/autotest_common.sh@10 -- # set +x 00:02:49.282 ************************************ 00:02:49.282 START TEST no_shrink_alloc 00:02:49.282 ************************************ 00:02:49.282 11:27:09 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:02:49.282 11:27:09 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:02:49.282 11:27:09 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:49.282 11:27:09 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:49.282 11:27:09 -- setup/hugepages.sh@51 -- # shift 00:02:49.282 11:27:09 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:49.282 11:27:09 -- setup/hugepages.sh@52 -- # local node_ids 00:02:49.282 11:27:09 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:49.282 11:27:09 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:49.282 11:27:09 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:49.283 11:27:09 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:49.283 11:27:09 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:49.283 11:27:09 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:49.283 11:27:09 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:49.283 11:27:09 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:49.283 11:27:09 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:49.283 11:27:09 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:49.283 11:27:09 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:49.283 11:27:09 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:49.283 11:27:09 -- setup/hugepages.sh@73 -- # return 0 00:02:49.283 11:27:09 -- setup/hugepages.sh@198 -- # setup output 00:02:49.283 11:27:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:49.283 11:27:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:50.662 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:50.662 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:50.662 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:50.662 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:50.662 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:50.662 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:50.662 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:50.662 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:50.662 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:50.662 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:50.662 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:50.662 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:50.662 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:50.662 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:50.662 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:50.662 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:50.662 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:50.662 11:27:10 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:02:50.662 11:27:10 -- setup/hugepages.sh@89 -- # local node 00:02:50.662 11:27:10 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:50.662 11:27:10 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:50.662 11:27:10 -- setup/hugepages.sh@92 -- # local surp 00:02:50.662 11:27:10 -- setup/hugepages.sh@93 -- # local resv 00:02:50.662 11:27:10 -- setup/hugepages.sh@94 -- # local anon 00:02:50.662 11:27:10 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:50.662 11:27:10 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:50.662 11:27:10 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:50.662 11:27:10 -- setup/common.sh@18 -- # local node= 00:02:50.662 11:27:10 -- setup/common.sh@19 -- # local var val 00:02:50.662 11:27:10 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.662 11:27:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.662 11:27:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.662 11:27:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.662 11:27:10 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.662 11:27:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45119244 kB' 'MemAvailable: 48890648 kB' 'Buffers: 2708 kB' 'Cached: 10742296 kB' 'SwapCached: 0 kB' 'Active: 7459536 kB' 'Inactive: 3764112 kB' 'Active(anon): 7059056 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481868 kB' 'Mapped: 210048 kB' 'Shmem: 6580412 kB' 'KReclaimable: 200780 kB' 'Slab: 740980 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540200 kB' 'KernelStack: 12848 kB' 'PageTables: 7836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8126096 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.662 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.662 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.663 11:27:10 -- setup/common.sh@33 -- # echo 0 00:02:50.663 11:27:10 -- setup/common.sh@33 -- # return 0 00:02:50.663 11:27:10 -- setup/hugepages.sh@97 -- # anon=0 00:02:50.663 11:27:10 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:50.663 11:27:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:50.663 11:27:10 -- setup/common.sh@18 -- # local node= 00:02:50.663 11:27:10 -- setup/common.sh@19 -- # local var val 00:02:50.663 11:27:10 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.663 11:27:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.663 11:27:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.663 11:27:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.663 11:27:10 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.663 11:27:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45119768 kB' 'MemAvailable: 48891172 kB' 'Buffers: 2708 kB' 'Cached: 10742300 kB' 'SwapCached: 0 kB' 'Active: 7460188 kB' 'Inactive: 3764112 kB' 'Active(anon): 7059708 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482504 kB' 'Mapped: 210124 kB' 'Shmem: 6580416 kB' 'KReclaimable: 200780 kB' 'Slab: 741012 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540232 kB' 'KernelStack: 12880 kB' 'PageTables: 7956 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8126108 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.663 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.663 11:27:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.664 11:27:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.664 11:27:10 -- setup/common.sh@33 -- # echo 0 00:02:50.664 11:27:10 -- setup/common.sh@33 -- # return 0 00:02:50.664 11:27:10 -- setup/hugepages.sh@99 -- # surp=0 00:02:50.664 11:27:10 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:50.664 11:27:10 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:50.664 11:27:10 -- setup/common.sh@18 -- # local node= 00:02:50.664 11:27:10 -- setup/common.sh@19 -- # local var val 00:02:50.664 11:27:10 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.664 11:27:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.664 11:27:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.664 11:27:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.664 11:27:10 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.664 11:27:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.664 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45121204 kB' 'MemAvailable: 48892608 kB' 'Buffers: 2708 kB' 'Cached: 10742300 kB' 'SwapCached: 0 kB' 'Active: 7459268 kB' 'Inactive: 3764112 kB' 'Active(anon): 7058788 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481512 kB' 'Mapped: 210000 kB' 'Shmem: 6580416 kB' 'KReclaimable: 200780 kB' 'Slab: 741012 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540232 kB' 'KernelStack: 12880 kB' 'PageTables: 7888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8126124 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.665 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.665 11:27:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.666 11:27:10 -- setup/common.sh@33 -- # echo 0 00:02:50.666 11:27:10 -- setup/common.sh@33 -- # return 0 00:02:50.666 11:27:10 -- setup/hugepages.sh@100 -- # resv=0 00:02:50.666 11:27:10 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:50.666 nr_hugepages=1024 00:02:50.666 11:27:10 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:50.666 resv_hugepages=0 00:02:50.666 11:27:10 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:50.666 surplus_hugepages=0 00:02:50.666 11:27:10 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:50.666 anon_hugepages=0 00:02:50.666 11:27:10 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:50.666 11:27:10 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:50.666 11:27:10 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:50.666 11:27:10 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:50.666 11:27:10 -- setup/common.sh@18 -- # local node= 00:02:50.666 11:27:10 -- setup/common.sh@19 -- # local var val 00:02:50.666 11:27:10 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.666 11:27:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.666 11:27:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.666 11:27:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.666 11:27:10 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.666 11:27:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45120700 kB' 'MemAvailable: 48892104 kB' 'Buffers: 2708 kB' 'Cached: 10742324 kB' 'SwapCached: 0 kB' 'Active: 7459144 kB' 'Inactive: 3764112 kB' 'Active(anon): 7058664 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481420 kB' 'Mapped: 210000 kB' 'Shmem: 6580440 kB' 'KReclaimable: 200780 kB' 'Slab: 741012 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540232 kB' 'KernelStack: 12896 kB' 'PageTables: 7932 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8126140 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.666 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.666 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.667 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.667 11:27:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.667 11:27:10 -- setup/common.sh@33 -- # echo 1024 00:02:50.667 11:27:10 -- setup/common.sh@33 -- # return 0 00:02:50.667 11:27:10 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:50.667 11:27:10 -- setup/hugepages.sh@112 -- # get_nodes 00:02:50.667 11:27:10 -- setup/hugepages.sh@27 -- # local node 00:02:50.667 11:27:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:50.667 11:27:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:50.667 11:27:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:50.667 11:27:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:50.667 11:27:10 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:50.667 11:27:10 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:50.667 11:27:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:50.667 11:27:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:50.667 11:27:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:50.667 11:27:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:50.667 11:27:10 -- setup/common.sh@18 -- # local node=0 00:02:50.667 11:27:10 -- setup/common.sh@19 -- # local var val 00:02:50.667 11:27:10 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.667 11:27:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.667 11:27:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:50.668 11:27:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:50.668 11:27:10 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.668 11:27:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26414904 kB' 'MemUsed: 6410952 kB' 'SwapCached: 0 kB' 'Active: 2819880 kB' 'Inactive: 177232 kB' 'Active(anon): 2663156 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 177232 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2642032 kB' 'Mapped: 112264 kB' 'AnonPages: 358176 kB' 'Shmem: 2308076 kB' 'KernelStack: 7336 kB' 'PageTables: 4380 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 119464 kB' 'Slab: 452288 kB' 'SReclaimable: 119464 kB' 'SUnreclaim: 332824 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # continue 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.668 11:27:10 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.668 11:27:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.668 11:27:10 -- setup/common.sh@33 -- # echo 0 00:02:50.668 11:27:10 -- setup/common.sh@33 -- # return 0 00:02:50.668 11:27:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:50.669 11:27:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:50.669 11:27:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:50.669 11:27:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:50.669 11:27:10 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:50.669 node0=1024 expecting 1024 00:02:50.669 11:27:10 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:50.669 11:27:10 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:02:50.669 11:27:10 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:02:50.669 11:27:10 -- setup/hugepages.sh@202 -- # setup output 00:02:50.669 11:27:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:50.669 11:27:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:52.043 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:52.043 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:52.043 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:52.043 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:52.043 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:52.043 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:52.043 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:52.043 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:52.043 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:52.043 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:52.043 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:52.043 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:52.043 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:52.043 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:52.043 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:52.043 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:52.043 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:52.043 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:02:52.043 11:27:11 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:02:52.044 11:27:11 -- setup/hugepages.sh@89 -- # local node 00:02:52.044 11:27:11 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:52.044 11:27:11 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:52.044 11:27:11 -- setup/hugepages.sh@92 -- # local surp 00:02:52.044 11:27:11 -- setup/hugepages.sh@93 -- # local resv 00:02:52.044 11:27:11 -- setup/hugepages.sh@94 -- # local anon 00:02:52.044 11:27:11 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:52.044 11:27:11 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:52.044 11:27:11 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:52.044 11:27:11 -- setup/common.sh@18 -- # local node= 00:02:52.044 11:27:11 -- setup/common.sh@19 -- # local var val 00:02:52.044 11:27:11 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.044 11:27:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.044 11:27:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:52.044 11:27:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:52.044 11:27:11 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.044 11:27:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45108804 kB' 'MemAvailable: 48880208 kB' 'Buffers: 2708 kB' 'Cached: 10742372 kB' 'SwapCached: 0 kB' 'Active: 7457916 kB' 'Inactive: 3764112 kB' 'Active(anon): 7057436 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480188 kB' 'Mapped: 210008 kB' 'Shmem: 6580488 kB' 'KReclaimable: 200780 kB' 'Slab: 740828 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540048 kB' 'KernelStack: 12896 kB' 'PageTables: 7940 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8126304 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.044 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.044 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.045 11:27:11 -- setup/common.sh@33 -- # echo 0 00:02:52.045 11:27:11 -- setup/common.sh@33 -- # return 0 00:02:52.045 11:27:11 -- setup/hugepages.sh@97 -- # anon=0 00:02:52.045 11:27:11 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:52.045 11:27:11 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:52.045 11:27:11 -- setup/common.sh@18 -- # local node= 00:02:52.045 11:27:11 -- setup/common.sh@19 -- # local var val 00:02:52.045 11:27:11 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.045 11:27:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.045 11:27:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:52.045 11:27:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:52.045 11:27:11 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.045 11:27:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45118484 kB' 'MemAvailable: 48889888 kB' 'Buffers: 2708 kB' 'Cached: 10742376 kB' 'SwapCached: 0 kB' 'Active: 7457884 kB' 'Inactive: 3764112 kB' 'Active(anon): 7057404 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480092 kB' 'Mapped: 210008 kB' 'Shmem: 6580492 kB' 'KReclaimable: 200780 kB' 'Slab: 740820 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540040 kB' 'KernelStack: 12832 kB' 'PageTables: 7732 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8126316 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.045 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.045 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.046 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.046 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.047 11:27:11 -- setup/common.sh@33 -- # echo 0 00:02:52.047 11:27:11 -- setup/common.sh@33 -- # return 0 00:02:52.047 11:27:11 -- setup/hugepages.sh@99 -- # surp=0 00:02:52.047 11:27:11 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:52.047 11:27:11 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:52.047 11:27:11 -- setup/common.sh@18 -- # local node= 00:02:52.047 11:27:11 -- setup/common.sh@19 -- # local var val 00:02:52.047 11:27:11 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.047 11:27:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.047 11:27:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:52.047 11:27:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:52.047 11:27:11 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.047 11:27:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45118852 kB' 'MemAvailable: 48890256 kB' 'Buffers: 2708 kB' 'Cached: 10742388 kB' 'SwapCached: 0 kB' 'Active: 7457936 kB' 'Inactive: 3764112 kB' 'Active(anon): 7057456 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480168 kB' 'Mapped: 210008 kB' 'Shmem: 6580504 kB' 'KReclaimable: 200780 kB' 'Slab: 740868 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540088 kB' 'KernelStack: 12912 kB' 'PageTables: 7932 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8126332 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.047 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.047 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.048 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.048 11:27:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.049 11:27:11 -- setup/common.sh@33 -- # echo 0 00:02:52.049 11:27:11 -- setup/common.sh@33 -- # return 0 00:02:52.049 11:27:11 -- setup/hugepages.sh@100 -- # resv=0 00:02:52.049 11:27:11 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:52.049 nr_hugepages=1024 00:02:52.049 11:27:11 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:52.049 resv_hugepages=0 00:02:52.049 11:27:11 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:52.049 surplus_hugepages=0 00:02:52.049 11:27:11 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:52.049 anon_hugepages=0 00:02:52.049 11:27:11 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:52.049 11:27:11 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:52.049 11:27:11 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:52.049 11:27:11 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:52.049 11:27:11 -- setup/common.sh@18 -- # local node= 00:02:52.049 11:27:11 -- setup/common.sh@19 -- # local var val 00:02:52.049 11:27:11 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.049 11:27:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.049 11:27:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:52.049 11:27:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:52.049 11:27:11 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.049 11:27:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45119868 kB' 'MemAvailable: 48891272 kB' 'Buffers: 2708 kB' 'Cached: 10742400 kB' 'SwapCached: 0 kB' 'Active: 7458384 kB' 'Inactive: 3764112 kB' 'Active(anon): 7057904 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480620 kB' 'Mapped: 210008 kB' 'Shmem: 6580516 kB' 'KReclaimable: 200780 kB' 'Slab: 740868 kB' 'SReclaimable: 200780 kB' 'SUnreclaim: 540088 kB' 'KernelStack: 12944 kB' 'PageTables: 8056 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8128884 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 36864 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2127452 kB' 'DirectMap2M: 15618048 kB' 'DirectMap1G: 52428800 kB' 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.049 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.049 11:27:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.050 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.050 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.051 11:27:11 -- setup/common.sh@33 -- # echo 1024 00:02:52.051 11:27:11 -- setup/common.sh@33 -- # return 0 00:02:52.051 11:27:11 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:52.051 11:27:11 -- setup/hugepages.sh@112 -- # get_nodes 00:02:52.051 11:27:11 -- setup/hugepages.sh@27 -- # local node 00:02:52.051 11:27:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:52.051 11:27:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:52.051 11:27:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:52.051 11:27:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:52.051 11:27:11 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:52.051 11:27:11 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:52.051 11:27:11 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:52.051 11:27:11 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:52.051 11:27:11 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:52.051 11:27:11 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:52.051 11:27:11 -- setup/common.sh@18 -- # local node=0 00:02:52.051 11:27:11 -- setup/common.sh@19 -- # local var val 00:02:52.051 11:27:11 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.051 11:27:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.051 11:27:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:52.051 11:27:11 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:52.051 11:27:11 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.051 11:27:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26422492 kB' 'MemUsed: 6403364 kB' 'SwapCached: 0 kB' 'Active: 2822252 kB' 'Inactive: 177232 kB' 'Active(anon): 2665528 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 177232 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2642036 kB' 'Mapped: 112272 kB' 'AnonPages: 360604 kB' 'Shmem: 2308080 kB' 'KernelStack: 7368 kB' 'PageTables: 4428 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 119464 kB' 'Slab: 452296 kB' 'SReclaimable: 119464 kB' 'SUnreclaim: 332832 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.051 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.051 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # continue 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.052 11:27:11 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.052 11:27:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.052 11:27:11 -- setup/common.sh@33 -- # echo 0 00:02:52.052 11:27:11 -- setup/common.sh@33 -- # return 0 00:02:52.052 11:27:11 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:52.052 11:27:11 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:52.052 11:27:11 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:52.052 11:27:11 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:52.052 11:27:11 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:52.052 node0=1024 expecting 1024 00:02:52.052 11:27:11 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:52.052 00:02:52.052 real 0m2.745s 00:02:52.052 user 0m1.102s 00:02:52.052 sys 0m1.569s 00:02:52.052 11:27:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:52.053 11:27:11 -- common/autotest_common.sh@10 -- # set +x 00:02:52.053 ************************************ 00:02:52.053 END TEST no_shrink_alloc 00:02:52.053 ************************************ 00:02:52.053 11:27:12 -- setup/hugepages.sh@217 -- # clear_hp 00:02:52.053 11:27:12 -- setup/hugepages.sh@37 -- # local node hp 00:02:52.053 11:27:12 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:52.053 11:27:12 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:52.053 11:27:12 -- setup/hugepages.sh@41 -- # echo 0 00:02:52.053 11:27:12 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:52.053 11:27:12 -- setup/hugepages.sh@41 -- # echo 0 00:02:52.053 11:27:12 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:52.053 11:27:12 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:52.053 11:27:12 -- setup/hugepages.sh@41 -- # echo 0 00:02:52.053 11:27:12 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:52.053 11:27:12 -- setup/hugepages.sh@41 -- # echo 0 00:02:52.053 11:27:12 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:52.053 11:27:12 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:52.053 00:02:52.053 real 0m11.452s 00:02:52.053 user 0m4.398s 00:02:52.053 sys 0m5.955s 00:02:52.053 11:27:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:52.053 11:27:12 -- common/autotest_common.sh@10 -- # set +x 00:02:52.053 ************************************ 00:02:52.053 END TEST hugepages 00:02:52.053 ************************************ 00:02:52.053 11:27:12 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:02:52.053 11:27:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:52.053 11:27:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:52.053 11:27:12 -- common/autotest_common.sh@10 -- # set +x 00:02:52.053 ************************************ 00:02:52.053 START TEST driver 00:02:52.053 ************************************ 00:02:52.053 11:27:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:02:52.053 * Looking for test storage... 00:02:52.053 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:52.053 11:27:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:52.311 11:27:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:52.311 11:27:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:52.311 11:27:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:52.311 11:27:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:52.311 11:27:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:52.311 11:27:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:52.311 11:27:12 -- scripts/common.sh@335 -- # IFS=.-: 00:02:52.311 11:27:12 -- scripts/common.sh@335 -- # read -ra ver1 00:02:52.311 11:27:12 -- scripts/common.sh@336 -- # IFS=.-: 00:02:52.311 11:27:12 -- scripts/common.sh@336 -- # read -ra ver2 00:02:52.311 11:27:12 -- scripts/common.sh@337 -- # local 'op=<' 00:02:52.311 11:27:12 -- scripts/common.sh@339 -- # ver1_l=2 00:02:52.311 11:27:12 -- scripts/common.sh@340 -- # ver2_l=1 00:02:52.311 11:27:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:52.311 11:27:12 -- scripts/common.sh@343 -- # case "$op" in 00:02:52.311 11:27:12 -- scripts/common.sh@344 -- # : 1 00:02:52.311 11:27:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:52.311 11:27:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:52.311 11:27:12 -- scripts/common.sh@364 -- # decimal 1 00:02:52.311 11:27:12 -- scripts/common.sh@352 -- # local d=1 00:02:52.311 11:27:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:52.311 11:27:12 -- scripts/common.sh@354 -- # echo 1 00:02:52.311 11:27:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:52.311 11:27:12 -- scripts/common.sh@365 -- # decimal 2 00:02:52.311 11:27:12 -- scripts/common.sh@352 -- # local d=2 00:02:52.311 11:27:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:52.311 11:27:12 -- scripts/common.sh@354 -- # echo 2 00:02:52.311 11:27:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:52.311 11:27:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:52.311 11:27:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:52.311 11:27:12 -- scripts/common.sh@367 -- # return 0 00:02:52.311 11:27:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:52.311 11:27:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:52.311 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:52.311 --rc genhtml_branch_coverage=1 00:02:52.311 --rc genhtml_function_coverage=1 00:02:52.311 --rc genhtml_legend=1 00:02:52.311 --rc geninfo_all_blocks=1 00:02:52.311 --rc geninfo_unexecuted_blocks=1 00:02:52.311 00:02:52.311 ' 00:02:52.311 11:27:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:52.311 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:52.311 --rc genhtml_branch_coverage=1 00:02:52.311 --rc genhtml_function_coverage=1 00:02:52.311 --rc genhtml_legend=1 00:02:52.311 --rc geninfo_all_blocks=1 00:02:52.311 --rc geninfo_unexecuted_blocks=1 00:02:52.311 00:02:52.311 ' 00:02:52.311 11:27:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:52.311 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:52.311 --rc genhtml_branch_coverage=1 00:02:52.311 --rc genhtml_function_coverage=1 00:02:52.311 --rc genhtml_legend=1 00:02:52.311 --rc geninfo_all_blocks=1 00:02:52.311 --rc geninfo_unexecuted_blocks=1 00:02:52.311 00:02:52.311 ' 00:02:52.311 11:27:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:52.311 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:52.311 --rc genhtml_branch_coverage=1 00:02:52.311 --rc genhtml_function_coverage=1 00:02:52.311 --rc genhtml_legend=1 00:02:52.311 --rc geninfo_all_blocks=1 00:02:52.311 --rc geninfo_unexecuted_blocks=1 00:02:52.311 00:02:52.311 ' 00:02:52.311 11:27:12 -- setup/driver.sh@68 -- # setup reset 00:02:52.311 11:27:12 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:52.311 11:27:12 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:54.842 11:27:14 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:02:54.842 11:27:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:54.842 11:27:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:54.842 11:27:14 -- common/autotest_common.sh@10 -- # set +x 00:02:54.842 ************************************ 00:02:54.842 START TEST guess_driver 00:02:54.842 ************************************ 00:02:54.842 11:27:14 -- common/autotest_common.sh@1114 -- # guess_driver 00:02:54.842 11:27:14 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:02:54.842 11:27:14 -- setup/driver.sh@47 -- # local fail=0 00:02:54.842 11:27:14 -- setup/driver.sh@49 -- # pick_driver 00:02:54.842 11:27:14 -- setup/driver.sh@36 -- # vfio 00:02:54.842 11:27:14 -- setup/driver.sh@21 -- # local iommu_grups 00:02:54.842 11:27:14 -- setup/driver.sh@22 -- # local unsafe_vfio 00:02:54.842 11:27:14 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:02:54.842 11:27:14 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:02:54.842 11:27:14 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:02:54.842 11:27:14 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:02:54.842 11:27:14 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:02:54.842 11:27:14 -- setup/driver.sh@14 -- # mod vfio_pci 00:02:54.842 11:27:14 -- setup/driver.sh@12 -- # dep vfio_pci 00:02:54.842 11:27:14 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:02:54.842 11:27:14 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:02:54.842 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:02:54.842 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:02:54.842 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:02:54.842 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:02:54.842 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:02:54.842 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:02:54.842 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:02:54.842 11:27:14 -- setup/driver.sh@30 -- # return 0 00:02:54.842 11:27:14 -- setup/driver.sh@37 -- # echo vfio-pci 00:02:54.842 11:27:14 -- setup/driver.sh@49 -- # driver=vfio-pci 00:02:54.842 11:27:14 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:02:54.842 11:27:14 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:02:54.842 Looking for driver=vfio-pci 00:02:54.842 11:27:14 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:54.842 11:27:14 -- setup/driver.sh@45 -- # setup output config 00:02:54.842 11:27:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:54.842 11:27:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.219 11:27:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.219 11:27:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.219 11:27:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.157 11:27:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.157 11:27:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.157 11:27:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.157 11:27:17 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:02:57.157 11:27:17 -- setup/driver.sh@65 -- # setup reset 00:02:57.157 11:27:17 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:57.157 11:27:17 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:59.690 00:02:59.690 real 0m4.861s 00:02:59.690 user 0m1.104s 00:02:59.690 sys 0m1.996s 00:02:59.690 11:27:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:59.690 11:27:19 -- common/autotest_common.sh@10 -- # set +x 00:02:59.690 ************************************ 00:02:59.690 END TEST guess_driver 00:02:59.690 ************************************ 00:02:59.690 00:02:59.690 real 0m7.482s 00:02:59.690 user 0m1.782s 00:02:59.690 sys 0m3.054s 00:02:59.690 11:27:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:59.690 11:27:19 -- common/autotest_common.sh@10 -- # set +x 00:02:59.690 ************************************ 00:02:59.690 END TEST driver 00:02:59.690 ************************************ 00:02:59.690 11:27:19 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:02:59.690 11:27:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:59.690 11:27:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:59.690 11:27:19 -- common/autotest_common.sh@10 -- # set +x 00:02:59.690 ************************************ 00:02:59.690 START TEST devices 00:02:59.690 ************************************ 00:02:59.690 11:27:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:02:59.690 * Looking for test storage... 00:02:59.690 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:59.690 11:27:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:59.690 11:27:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:59.690 11:27:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:59.690 11:27:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:59.690 11:27:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:59.690 11:27:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:59.690 11:27:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:59.690 11:27:19 -- scripts/common.sh@335 -- # IFS=.-: 00:02:59.690 11:27:19 -- scripts/common.sh@335 -- # read -ra ver1 00:02:59.690 11:27:19 -- scripts/common.sh@336 -- # IFS=.-: 00:02:59.690 11:27:19 -- scripts/common.sh@336 -- # read -ra ver2 00:02:59.690 11:27:19 -- scripts/common.sh@337 -- # local 'op=<' 00:02:59.690 11:27:19 -- scripts/common.sh@339 -- # ver1_l=2 00:02:59.690 11:27:19 -- scripts/common.sh@340 -- # ver2_l=1 00:02:59.690 11:27:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:59.690 11:27:19 -- scripts/common.sh@343 -- # case "$op" in 00:02:59.690 11:27:19 -- scripts/common.sh@344 -- # : 1 00:02:59.690 11:27:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:59.690 11:27:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:59.690 11:27:19 -- scripts/common.sh@364 -- # decimal 1 00:02:59.690 11:27:19 -- scripts/common.sh@352 -- # local d=1 00:02:59.690 11:27:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:59.690 11:27:19 -- scripts/common.sh@354 -- # echo 1 00:02:59.690 11:27:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:59.690 11:27:19 -- scripts/common.sh@365 -- # decimal 2 00:02:59.690 11:27:19 -- scripts/common.sh@352 -- # local d=2 00:02:59.690 11:27:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:59.690 11:27:19 -- scripts/common.sh@354 -- # echo 2 00:02:59.690 11:27:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:59.690 11:27:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:59.690 11:27:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:59.690 11:27:19 -- scripts/common.sh@367 -- # return 0 00:02:59.690 11:27:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:59.690 11:27:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:59.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:59.690 --rc genhtml_branch_coverage=1 00:02:59.690 --rc genhtml_function_coverage=1 00:02:59.690 --rc genhtml_legend=1 00:02:59.690 --rc geninfo_all_blocks=1 00:02:59.690 --rc geninfo_unexecuted_blocks=1 00:02:59.690 00:02:59.690 ' 00:02:59.690 11:27:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:59.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:59.690 --rc genhtml_branch_coverage=1 00:02:59.690 --rc genhtml_function_coverage=1 00:02:59.690 --rc genhtml_legend=1 00:02:59.690 --rc geninfo_all_blocks=1 00:02:59.690 --rc geninfo_unexecuted_blocks=1 00:02:59.690 00:02:59.690 ' 00:02:59.690 11:27:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:59.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:59.690 --rc genhtml_branch_coverage=1 00:02:59.690 --rc genhtml_function_coverage=1 00:02:59.690 --rc genhtml_legend=1 00:02:59.690 --rc geninfo_all_blocks=1 00:02:59.690 --rc geninfo_unexecuted_blocks=1 00:02:59.690 00:02:59.690 ' 00:02:59.690 11:27:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:59.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:59.690 --rc genhtml_branch_coverage=1 00:02:59.690 --rc genhtml_function_coverage=1 00:02:59.690 --rc genhtml_legend=1 00:02:59.690 --rc geninfo_all_blocks=1 00:02:59.690 --rc geninfo_unexecuted_blocks=1 00:02:59.690 00:02:59.690 ' 00:02:59.690 11:27:19 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:02:59.690 11:27:19 -- setup/devices.sh@192 -- # setup reset 00:02:59.690 11:27:19 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:59.690 11:27:19 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:01.591 11:27:21 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:01.591 11:27:21 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:01.591 11:27:21 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:01.591 11:27:21 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:01.591 11:27:21 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:01.591 11:27:21 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:01.591 11:27:21 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:01.591 11:27:21 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:01.591 11:27:21 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:01.591 11:27:21 -- setup/devices.sh@196 -- # blocks=() 00:03:01.591 11:27:21 -- setup/devices.sh@196 -- # declare -a blocks 00:03:01.591 11:27:21 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:01.591 11:27:21 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:01.591 11:27:21 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:01.591 11:27:21 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:01.591 11:27:21 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:01.591 11:27:21 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:01.591 11:27:21 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:01.591 11:27:21 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:01.591 11:27:21 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:01.592 11:27:21 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:01.592 11:27:21 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:01.592 No valid GPT data, bailing 00:03:01.592 11:27:21 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:01.592 11:27:21 -- scripts/common.sh@393 -- # pt= 00:03:01.592 11:27:21 -- scripts/common.sh@394 -- # return 1 00:03:01.592 11:27:21 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:01.592 11:27:21 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:01.592 11:27:21 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:01.592 11:27:21 -- setup/common.sh@80 -- # echo 1000204886016 00:03:01.592 11:27:21 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:01.592 11:27:21 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:01.592 11:27:21 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:01.592 11:27:21 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:01.592 11:27:21 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:01.592 11:27:21 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:01.592 11:27:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:01.592 11:27:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:01.592 11:27:21 -- common/autotest_common.sh@10 -- # set +x 00:03:01.592 ************************************ 00:03:01.592 START TEST nvme_mount 00:03:01.592 ************************************ 00:03:01.592 11:27:21 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:01.592 11:27:21 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:01.592 11:27:21 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:01.592 11:27:21 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:01.592 11:27:21 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:01.592 11:27:21 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:01.592 11:27:21 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:01.592 11:27:21 -- setup/common.sh@40 -- # local part_no=1 00:03:01.592 11:27:21 -- setup/common.sh@41 -- # local size=1073741824 00:03:01.592 11:27:21 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:01.592 11:27:21 -- setup/common.sh@44 -- # parts=() 00:03:01.592 11:27:21 -- setup/common.sh@44 -- # local parts 00:03:01.592 11:27:21 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:01.592 11:27:21 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:01.592 11:27:21 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:01.592 11:27:21 -- setup/common.sh@46 -- # (( part++ )) 00:03:01.592 11:27:21 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:01.592 11:27:21 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:01.592 11:27:21 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:01.592 11:27:21 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:02.157 Creating new GPT entries in memory. 00:03:02.157 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:02.157 other utilities. 00:03:02.157 11:27:22 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:02.157 11:27:22 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:02.157 11:27:22 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:02.157 11:27:22 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:02.157 11:27:22 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:03.536 Creating new GPT entries in memory. 00:03:03.536 The operation has completed successfully. 00:03:03.536 11:27:23 -- setup/common.sh@57 -- # (( part++ )) 00:03:03.536 11:27:23 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:03.536 11:27:23 -- setup/common.sh@62 -- # wait 3671988 00:03:03.536 11:27:23 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:03.536 11:27:23 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:03.536 11:27:23 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:03.536 11:27:23 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:03.536 11:27:23 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:03.536 11:27:23 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:03.536 11:27:23 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:03.536 11:27:23 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:03.536 11:27:23 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:03.536 11:27:23 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:03.536 11:27:23 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:03.536 11:27:23 -- setup/devices.sh@53 -- # local found=0 00:03:03.536 11:27:23 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:03.536 11:27:23 -- setup/devices.sh@56 -- # : 00:03:03.536 11:27:23 -- setup/devices.sh@59 -- # local pci status 00:03:03.536 11:27:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.536 11:27:23 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:03.536 11:27:23 -- setup/devices.sh@47 -- # setup output config 00:03:03.536 11:27:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:03.536 11:27:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:04.473 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.473 11:27:24 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:04.473 11:27:24 -- setup/devices.sh@63 -- # found=1 00:03:04.473 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.473 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.473 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.473 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.473 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.473 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.473 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.473 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.473 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.473 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.473 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.473 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.473 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.473 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.473 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.473 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.473 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.474 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.474 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.474 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.474 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.474 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.474 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.474 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.474 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.474 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.474 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.474 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.474 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.474 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.474 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.474 11:27:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.474 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.733 11:27:24 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:04.733 11:27:24 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:04.733 11:27:24 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:04.733 11:27:24 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:04.733 11:27:24 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:04.734 11:27:24 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:04.734 11:27:24 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:04.734 11:27:24 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:04.734 11:27:24 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:04.734 11:27:24 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:04.734 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:04.734 11:27:24 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:04.734 11:27:24 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:04.993 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:04.993 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:04.993 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:04.993 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:04.993 11:27:24 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:04.993 11:27:24 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:04.993 11:27:24 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:04.993 11:27:24 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:04.993 11:27:24 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:04.993 11:27:24 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:04.993 11:27:24 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:04.993 11:27:24 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:04.993 11:27:24 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:04.993 11:27:24 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:04.993 11:27:24 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:04.993 11:27:24 -- setup/devices.sh@53 -- # local found=0 00:03:04.993 11:27:24 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:04.993 11:27:24 -- setup/devices.sh@56 -- # : 00:03:04.993 11:27:24 -- setup/devices.sh@59 -- # local pci status 00:03:04.993 11:27:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.993 11:27:24 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:04.993 11:27:24 -- setup/devices.sh@47 -- # setup output config 00:03:04.993 11:27:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:04.993 11:27:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:06.368 11:27:25 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.368 11:27:25 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:06.368 11:27:25 -- setup/devices.sh@63 -- # found=1 00:03:06.368 11:27:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.368 11:27:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.368 11:27:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.368 11:27:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.368 11:27:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.368 11:27:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.368 11:27:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.368 11:27:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.368 11:27:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.368 11:27:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.368 11:27:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.368 11:27:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.369 11:27:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.369 11:27:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.369 11:27:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.369 11:27:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.369 11:27:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.369 11:27:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.369 11:27:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.369 11:27:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.369 11:27:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.369 11:27:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.369 11:27:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.369 11:27:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.369 11:27:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.369 11:27:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.369 11:27:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.369 11:27:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.369 11:27:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.369 11:27:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.369 11:27:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.369 11:27:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.369 11:27:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.369 11:27:26 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:06.369 11:27:26 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:06.369 11:27:26 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:06.369 11:27:26 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:06.369 11:27:26 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:06.369 11:27:26 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:06.369 11:27:26 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:06.369 11:27:26 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:06.369 11:27:26 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:06.369 11:27:26 -- setup/devices.sh@50 -- # local mount_point= 00:03:06.369 11:27:26 -- setup/devices.sh@51 -- # local test_file= 00:03:06.369 11:27:26 -- setup/devices.sh@53 -- # local found=0 00:03:06.369 11:27:26 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:06.369 11:27:26 -- setup/devices.sh@59 -- # local pci status 00:03:06.369 11:27:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.369 11:27:26 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:06.369 11:27:26 -- setup/devices.sh@47 -- # setup output config 00:03:06.369 11:27:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:06.369 11:27:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:07.743 11:27:27 -- setup/devices.sh@63 -- # found=1 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.743 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.743 11:27:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.744 11:27:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.744 11:27:27 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:07.744 11:27:27 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:07.744 11:27:27 -- setup/devices.sh@68 -- # return 0 00:03:07.744 11:27:27 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:07.744 11:27:27 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:07.744 11:27:27 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:07.744 11:27:27 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:07.744 11:27:27 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:07.744 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:07.744 00:03:07.744 real 0m6.452s 00:03:07.744 user 0m1.483s 00:03:07.744 sys 0m2.535s 00:03:07.744 11:27:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:07.744 11:27:27 -- common/autotest_common.sh@10 -- # set +x 00:03:07.744 ************************************ 00:03:07.744 END TEST nvme_mount 00:03:07.744 ************************************ 00:03:07.744 11:27:27 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:07.744 11:27:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:07.744 11:27:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:07.744 11:27:27 -- common/autotest_common.sh@10 -- # set +x 00:03:07.744 ************************************ 00:03:07.744 START TEST dm_mount 00:03:07.744 ************************************ 00:03:07.744 11:27:27 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:07.744 11:27:27 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:07.744 11:27:27 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:07.744 11:27:27 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:07.744 11:27:27 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:07.744 11:27:27 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:07.744 11:27:27 -- setup/common.sh@40 -- # local part_no=2 00:03:07.744 11:27:27 -- setup/common.sh@41 -- # local size=1073741824 00:03:07.744 11:27:27 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:07.744 11:27:27 -- setup/common.sh@44 -- # parts=() 00:03:07.744 11:27:27 -- setup/common.sh@44 -- # local parts 00:03:07.744 11:27:27 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:07.744 11:27:27 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:07.744 11:27:27 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:07.744 11:27:27 -- setup/common.sh@46 -- # (( part++ )) 00:03:07.744 11:27:27 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:07.744 11:27:27 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:07.744 11:27:27 -- setup/common.sh@46 -- # (( part++ )) 00:03:07.744 11:27:27 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:07.744 11:27:27 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:07.744 11:27:27 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:07.744 11:27:27 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:08.677 Creating new GPT entries in memory. 00:03:08.677 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:08.677 other utilities. 00:03:08.677 11:27:28 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:08.677 11:27:28 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:08.677 11:27:28 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:08.677 11:27:28 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:08.677 11:27:28 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:10.051 Creating new GPT entries in memory. 00:03:10.051 The operation has completed successfully. 00:03:10.051 11:27:29 -- setup/common.sh@57 -- # (( part++ )) 00:03:10.051 11:27:29 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:10.051 11:27:29 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:10.051 11:27:29 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:10.051 11:27:29 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:10.985 The operation has completed successfully. 00:03:10.985 11:27:30 -- setup/common.sh@57 -- # (( part++ )) 00:03:10.985 11:27:30 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:10.985 11:27:30 -- setup/common.sh@62 -- # wait 3674451 00:03:10.985 11:27:30 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:10.985 11:27:30 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:10.985 11:27:30 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:10.985 11:27:30 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:10.985 11:27:30 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:10.985 11:27:30 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:10.985 11:27:30 -- setup/devices.sh@161 -- # break 00:03:10.985 11:27:30 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:10.985 11:27:30 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:10.985 11:27:30 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:10.985 11:27:30 -- setup/devices.sh@166 -- # dm=dm-0 00:03:10.985 11:27:30 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:10.985 11:27:30 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:10.985 11:27:30 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:10.985 11:27:30 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:10.985 11:27:30 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:10.985 11:27:30 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:10.985 11:27:30 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:10.985 11:27:30 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:10.985 11:27:30 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:10.985 11:27:30 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:10.985 11:27:30 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:10.985 11:27:30 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:10.985 11:27:30 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:10.985 11:27:30 -- setup/devices.sh@53 -- # local found=0 00:03:10.985 11:27:30 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:10.985 11:27:30 -- setup/devices.sh@56 -- # : 00:03:10.985 11:27:30 -- setup/devices.sh@59 -- # local pci status 00:03:10.985 11:27:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.985 11:27:30 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:10.985 11:27:30 -- setup/devices.sh@47 -- # setup output config 00:03:10.985 11:27:30 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.985 11:27:30 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:11.921 11:27:31 -- setup/devices.sh@63 -- # found=1 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.921 11:27:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.921 11:27:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:12.181 11:27:32 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:12.181 11:27:32 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:12.181 11:27:32 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:12.181 11:27:32 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:12.181 11:27:32 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:12.181 11:27:32 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:12.181 11:27:32 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:12.181 11:27:32 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:12.181 11:27:32 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:12.181 11:27:32 -- setup/devices.sh@50 -- # local mount_point= 00:03:12.181 11:27:32 -- setup/devices.sh@51 -- # local test_file= 00:03:12.181 11:27:32 -- setup/devices.sh@53 -- # local found=0 00:03:12.181 11:27:32 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:12.181 11:27:32 -- setup/devices.sh@59 -- # local pci status 00:03:12.181 11:27:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:12.181 11:27:32 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:12.181 11:27:32 -- setup/devices.sh@47 -- # setup output config 00:03:12.181 11:27:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:12.181 11:27:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:13.561 11:27:33 -- setup/devices.sh@63 -- # found=1 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.561 11:27:33 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:13.561 11:27:33 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:13.561 11:27:33 -- setup/devices.sh@68 -- # return 0 00:03:13.561 11:27:33 -- setup/devices.sh@187 -- # cleanup_dm 00:03:13.561 11:27:33 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:13.561 11:27:33 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:13.561 11:27:33 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:13.561 11:27:33 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:13.561 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:13.561 11:27:33 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:13.561 00:03:13.561 real 0m5.824s 00:03:13.561 user 0m1.010s 00:03:13.561 sys 0m1.679s 00:03:13.561 11:27:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:13.561 11:27:33 -- common/autotest_common.sh@10 -- # set +x 00:03:13.561 ************************************ 00:03:13.561 END TEST dm_mount 00:03:13.561 ************************************ 00:03:13.561 11:27:33 -- setup/devices.sh@1 -- # cleanup 00:03:13.561 11:27:33 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:13.561 11:27:33 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:13.561 11:27:33 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:13.561 11:27:33 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:13.561 11:27:33 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:13.820 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:13.820 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:13.820 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:13.820 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:13.820 11:27:33 -- setup/devices.sh@12 -- # cleanup_dm 00:03:13.820 11:27:33 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:13.820 11:27:33 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:13.820 11:27:33 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:13.820 11:27:33 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:13.820 11:27:33 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:13.820 11:27:33 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:13.820 00:03:13.820 real 0m14.244s 00:03:13.820 user 0m3.213s 00:03:13.820 sys 0m5.238s 00:03:13.820 11:27:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:13.820 11:27:33 -- common/autotest_common.sh@10 -- # set +x 00:03:13.820 ************************************ 00:03:13.820 END TEST devices 00:03:13.820 ************************************ 00:03:13.820 00:03:13.820 real 0m44.137s 00:03:13.820 user 0m12.895s 00:03:13.820 sys 0m19.858s 00:03:13.820 11:27:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:13.820 11:27:33 -- common/autotest_common.sh@10 -- # set +x 00:03:13.820 ************************************ 00:03:13.820 END TEST setup.sh 00:03:13.820 ************************************ 00:03:13.820 11:27:33 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:14.756 Hugepages 00:03:14.756 node hugesize free / total 00:03:14.756 node0 1048576kB 0 / 0 00:03:14.756 node0 2048kB 2048 / 2048 00:03:14.756 node1 1048576kB 0 / 0 00:03:15.015 node1 2048kB 0 / 0 00:03:15.015 00:03:15.015 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:15.015 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:15.015 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:15.015 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:15.015 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:15.015 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:15.015 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:15.015 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:15.015 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:15.015 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:15.015 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:15.016 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:15.016 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:15.016 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:15.016 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:15.016 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:15.016 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:15.016 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:15.016 11:27:34 -- spdk/autotest.sh@128 -- # uname -s 00:03:15.016 11:27:34 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:15.016 11:27:34 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:15.016 11:27:34 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:16.389 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:16.389 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:16.389 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:16.389 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:16.389 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:16.389 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:16.389 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:16.389 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:16.389 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:16.389 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:16.389 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:16.389 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:16.389 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:16.389 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:16.389 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:16.389 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:17.325 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:17.325 11:27:37 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:18.290 11:27:38 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:18.290 11:27:38 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:18.290 11:27:38 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:18.290 11:27:38 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:18.290 11:27:38 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:18.290 11:27:38 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:18.290 11:27:38 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:18.290 11:27:38 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:18.290 11:27:38 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:18.290 11:27:38 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:18.290 11:27:38 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:18.290 11:27:38 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:19.710 Waiting for block devices as requested 00:03:19.710 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:19.710 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:19.710 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:19.968 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:19.968 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:19.968 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:19.968 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:20.226 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:20.226 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:20.226 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:20.226 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:20.484 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:20.484 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:20.484 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:20.484 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:20.742 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:20.742 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:20.742 11:27:40 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:03:20.742 11:27:40 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:20.742 11:27:40 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:03:20.742 11:27:40 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:03:20.742 11:27:40 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:20.742 11:27:40 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:20.742 11:27:40 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:20.742 11:27:40 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:03:20.742 11:27:40 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:03:20.742 11:27:40 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:03:20.742 11:27:40 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:20.742 11:27:40 -- common/autotest_common.sh@1540 -- # grep oacs 00:03:20.742 11:27:40 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:20.742 11:27:40 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:03:20.742 11:27:40 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:03:20.742 11:27:40 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:03:20.742 11:27:40 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:03:20.742 11:27:40 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:03:20.742 11:27:40 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:03:20.742 11:27:40 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:03:20.742 11:27:40 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:03:20.742 11:27:40 -- common/autotest_common.sh@1552 -- # continue 00:03:20.742 11:27:40 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:03:20.742 11:27:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:20.742 11:27:40 -- common/autotest_common.sh@10 -- # set +x 00:03:21.000 11:27:40 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:03:21.000 11:27:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:21.000 11:27:40 -- common/autotest_common.sh@10 -- # set +x 00:03:21.000 11:27:40 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:22.375 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:22.375 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:22.375 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:22.375 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:22.375 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:22.375 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:22.375 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:22.375 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:22.375 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:22.375 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:22.375 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:22.375 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:22.375 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:22.375 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:22.375 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:22.375 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:23.310 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:23.310 11:27:43 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:03:23.310 11:27:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:23.310 11:27:43 -- common/autotest_common.sh@10 -- # set +x 00:03:23.310 11:27:43 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:03:23.310 11:27:43 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:03:23.310 11:27:43 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:03:23.310 11:27:43 -- common/autotest_common.sh@1572 -- # bdfs=() 00:03:23.310 11:27:43 -- common/autotest_common.sh@1572 -- # local bdfs 00:03:23.311 11:27:43 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:03:23.311 11:27:43 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:23.311 11:27:43 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:23.311 11:27:43 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:23.311 11:27:43 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:23.311 11:27:43 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:23.311 11:27:43 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:23.311 11:27:43 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:23.311 11:27:43 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:03:23.311 11:27:43 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:23.311 11:27:43 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:03:23.311 11:27:43 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:23.311 11:27:43 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:03:23.311 11:27:43 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:03:23.311 11:27:43 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:03:23.311 11:27:43 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=3679752 00:03:23.311 11:27:43 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:23.311 11:27:43 -- common/autotest_common.sh@1593 -- # waitforlisten 3679752 00:03:23.311 11:27:43 -- common/autotest_common.sh@829 -- # '[' -z 3679752 ']' 00:03:23.311 11:27:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:23.311 11:27:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:23.311 11:27:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:23.311 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:23.311 11:27:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:23.311 11:27:43 -- common/autotest_common.sh@10 -- # set +x 00:03:23.311 [2024-11-28 11:27:43.320352] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:23.311 [2024-11-28 11:27:43.320447] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3679752 ] 00:03:23.311 EAL: No free 2048 kB hugepages reported on node 1 00:03:23.570 [2024-11-28 11:27:43.378543] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:23.570 [2024-11-28 11:27:43.488137] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:23.570 [2024-11-28 11:27:43.488313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:24.504 11:27:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:24.504 11:27:44 -- common/autotest_common.sh@862 -- # return 0 00:03:24.504 11:27:44 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:03:24.504 11:27:44 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:03:24.504 11:27:44 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:03:27.783 nvme0n1 00:03:27.783 11:27:47 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:03:27.783 [2024-11-28 11:27:47.696905] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:03:27.783 [2024-11-28 11:27:47.696954] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:03:27.783 request: 00:03:27.783 { 00:03:27.783 "nvme_ctrlr_name": "nvme0", 00:03:27.783 "password": "test", 00:03:27.783 "method": "bdev_nvme_opal_revert", 00:03:27.783 "req_id": 1 00:03:27.783 } 00:03:27.783 Got JSON-RPC error response 00:03:27.783 response: 00:03:27.783 { 00:03:27.783 "code": -32603, 00:03:27.783 "message": "Internal error" 00:03:27.783 } 00:03:27.783 11:27:47 -- common/autotest_common.sh@1599 -- # true 00:03:27.783 11:27:47 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:03:27.783 11:27:47 -- common/autotest_common.sh@1603 -- # killprocess 3679752 00:03:27.783 11:27:47 -- common/autotest_common.sh@936 -- # '[' -z 3679752 ']' 00:03:27.783 11:27:47 -- common/autotest_common.sh@940 -- # kill -0 3679752 00:03:27.783 11:27:47 -- common/autotest_common.sh@941 -- # uname 00:03:27.783 11:27:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:27.783 11:27:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3679752 00:03:27.783 11:27:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:27.783 11:27:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:27.783 11:27:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3679752' 00:03:27.783 killing process with pid 3679752 00:03:27.783 11:27:47 -- common/autotest_common.sh@955 -- # kill 3679752 00:03:27.783 11:27:47 -- common/autotest_common.sh@960 -- # wait 3679752 00:03:29.683 11:27:49 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:03:29.683 11:27:49 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:03:29.683 11:27:49 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:03:29.683 11:27:49 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:03:29.683 11:27:49 -- spdk/autotest.sh@160 -- # timing_enter lib 00:03:29.683 11:27:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:29.683 11:27:49 -- common/autotest_common.sh@10 -- # set +x 00:03:29.683 11:27:49 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:29.683 11:27:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:29.683 11:27:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:29.683 11:27:49 -- common/autotest_common.sh@10 -- # set +x 00:03:29.683 ************************************ 00:03:29.683 START TEST env 00:03:29.683 ************************************ 00:03:29.683 11:27:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:29.683 * Looking for test storage... 00:03:29.683 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:03:29.683 11:27:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:29.683 11:27:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:29.683 11:27:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:29.683 11:27:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:29.683 11:27:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:29.683 11:27:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:29.683 11:27:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:29.683 11:27:49 -- scripts/common.sh@335 -- # IFS=.-: 00:03:29.683 11:27:49 -- scripts/common.sh@335 -- # read -ra ver1 00:03:29.683 11:27:49 -- scripts/common.sh@336 -- # IFS=.-: 00:03:29.683 11:27:49 -- scripts/common.sh@336 -- # read -ra ver2 00:03:29.683 11:27:49 -- scripts/common.sh@337 -- # local 'op=<' 00:03:29.683 11:27:49 -- scripts/common.sh@339 -- # ver1_l=2 00:03:29.683 11:27:49 -- scripts/common.sh@340 -- # ver2_l=1 00:03:29.683 11:27:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:29.683 11:27:49 -- scripts/common.sh@343 -- # case "$op" in 00:03:29.683 11:27:49 -- scripts/common.sh@344 -- # : 1 00:03:29.683 11:27:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:29.683 11:27:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:29.683 11:27:49 -- scripts/common.sh@364 -- # decimal 1 00:03:29.683 11:27:49 -- scripts/common.sh@352 -- # local d=1 00:03:29.683 11:27:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:29.683 11:27:49 -- scripts/common.sh@354 -- # echo 1 00:03:29.683 11:27:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:29.683 11:27:49 -- scripts/common.sh@365 -- # decimal 2 00:03:29.683 11:27:49 -- scripts/common.sh@352 -- # local d=2 00:03:29.683 11:27:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:29.683 11:27:49 -- scripts/common.sh@354 -- # echo 2 00:03:29.683 11:27:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:29.683 11:27:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:29.683 11:27:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:29.683 11:27:49 -- scripts/common.sh@367 -- # return 0 00:03:29.683 11:27:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:29.683 11:27:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:29.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:29.683 --rc genhtml_branch_coverage=1 00:03:29.683 --rc genhtml_function_coverage=1 00:03:29.684 --rc genhtml_legend=1 00:03:29.684 --rc geninfo_all_blocks=1 00:03:29.684 --rc geninfo_unexecuted_blocks=1 00:03:29.684 00:03:29.684 ' 00:03:29.684 11:27:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:29.684 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:29.684 --rc genhtml_branch_coverage=1 00:03:29.684 --rc genhtml_function_coverage=1 00:03:29.684 --rc genhtml_legend=1 00:03:29.684 --rc geninfo_all_blocks=1 00:03:29.684 --rc geninfo_unexecuted_blocks=1 00:03:29.684 00:03:29.684 ' 00:03:29.684 11:27:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:29.684 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:29.684 --rc genhtml_branch_coverage=1 00:03:29.684 --rc genhtml_function_coverage=1 00:03:29.684 --rc genhtml_legend=1 00:03:29.684 --rc geninfo_all_blocks=1 00:03:29.684 --rc geninfo_unexecuted_blocks=1 00:03:29.684 00:03:29.684 ' 00:03:29.684 11:27:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:29.684 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:29.684 --rc genhtml_branch_coverage=1 00:03:29.684 --rc genhtml_function_coverage=1 00:03:29.684 --rc genhtml_legend=1 00:03:29.684 --rc geninfo_all_blocks=1 00:03:29.684 --rc geninfo_unexecuted_blocks=1 00:03:29.684 00:03:29.684 ' 00:03:29.684 11:27:49 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:29.684 11:27:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:29.684 11:27:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:29.684 11:27:49 -- common/autotest_common.sh@10 -- # set +x 00:03:29.684 ************************************ 00:03:29.684 START TEST env_memory 00:03:29.684 ************************************ 00:03:29.684 11:27:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:29.684 00:03:29.684 00:03:29.684 CUnit - A unit testing framework for C - Version 2.1-3 00:03:29.684 http://cunit.sourceforge.net/ 00:03:29.684 00:03:29.684 00:03:29.684 Suite: memory 00:03:29.684 Test: alloc and free memory map ...[2024-11-28 11:27:49.728378] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:03:29.943 passed 00:03:29.943 Test: mem map translation ...[2024-11-28 11:27:49.750469] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:03:29.943 [2024-11-28 11:27:49.750494] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:03:29.943 [2024-11-28 11:27:49.750558] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:03:29.943 [2024-11-28 11:27:49.750587] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:03:29.943 passed 00:03:29.943 Test: mem map registration ...[2024-11-28 11:27:49.793176] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:03:29.943 [2024-11-28 11:27:49.793196] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:03:29.943 passed 00:03:29.943 Test: mem map adjacent registrations ...passed 00:03:29.943 00:03:29.943 Run Summary: Type Total Ran Passed Failed Inactive 00:03:29.943 suites 1 1 n/a 0 0 00:03:29.943 tests 4 4 4 0 0 00:03:29.943 asserts 152 152 152 0 n/a 00:03:29.943 00:03:29.943 Elapsed time = 0.147 seconds 00:03:29.943 00:03:29.943 real 0m0.154s 00:03:29.943 user 0m0.145s 00:03:29.943 sys 0m0.008s 00:03:29.943 11:27:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:29.943 11:27:49 -- common/autotest_common.sh@10 -- # set +x 00:03:29.943 ************************************ 00:03:29.943 END TEST env_memory 00:03:29.943 ************************************ 00:03:29.943 11:27:49 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:29.943 11:27:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:29.943 11:27:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:29.943 11:27:49 -- common/autotest_common.sh@10 -- # set +x 00:03:29.943 ************************************ 00:03:29.943 START TEST env_vtophys 00:03:29.943 ************************************ 00:03:29.943 11:27:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:29.943 EAL: lib.eal log level changed from notice to debug 00:03:29.943 EAL: Detected lcore 0 as core 0 on socket 0 00:03:29.943 EAL: Detected lcore 1 as core 1 on socket 0 00:03:29.943 EAL: Detected lcore 2 as core 2 on socket 0 00:03:29.943 EAL: Detected lcore 3 as core 3 on socket 0 00:03:29.943 EAL: Detected lcore 4 as core 4 on socket 0 00:03:29.943 EAL: Detected lcore 5 as core 5 on socket 0 00:03:29.943 EAL: Detected lcore 6 as core 8 on socket 0 00:03:29.943 EAL: Detected lcore 7 as core 9 on socket 0 00:03:29.943 EAL: Detected lcore 8 as core 10 on socket 0 00:03:29.943 EAL: Detected lcore 9 as core 11 on socket 0 00:03:29.943 EAL: Detected lcore 10 as core 12 on socket 0 00:03:29.943 EAL: Detected lcore 11 as core 13 on socket 0 00:03:29.943 EAL: Detected lcore 12 as core 0 on socket 1 00:03:29.943 EAL: Detected lcore 13 as core 1 on socket 1 00:03:29.943 EAL: Detected lcore 14 as core 2 on socket 1 00:03:29.943 EAL: Detected lcore 15 as core 3 on socket 1 00:03:29.943 EAL: Detected lcore 16 as core 4 on socket 1 00:03:29.943 EAL: Detected lcore 17 as core 5 on socket 1 00:03:29.943 EAL: Detected lcore 18 as core 8 on socket 1 00:03:29.943 EAL: Detected lcore 19 as core 9 on socket 1 00:03:29.943 EAL: Detected lcore 20 as core 10 on socket 1 00:03:29.943 EAL: Detected lcore 21 as core 11 on socket 1 00:03:29.943 EAL: Detected lcore 22 as core 12 on socket 1 00:03:29.943 EAL: Detected lcore 23 as core 13 on socket 1 00:03:29.943 EAL: Detected lcore 24 as core 0 on socket 0 00:03:29.943 EAL: Detected lcore 25 as core 1 on socket 0 00:03:29.943 EAL: Detected lcore 26 as core 2 on socket 0 00:03:29.943 EAL: Detected lcore 27 as core 3 on socket 0 00:03:29.943 EAL: Detected lcore 28 as core 4 on socket 0 00:03:29.943 EAL: Detected lcore 29 as core 5 on socket 0 00:03:29.943 EAL: Detected lcore 30 as core 8 on socket 0 00:03:29.943 EAL: Detected lcore 31 as core 9 on socket 0 00:03:29.943 EAL: Detected lcore 32 as core 10 on socket 0 00:03:29.943 EAL: Detected lcore 33 as core 11 on socket 0 00:03:29.943 EAL: Detected lcore 34 as core 12 on socket 0 00:03:29.943 EAL: Detected lcore 35 as core 13 on socket 0 00:03:29.943 EAL: Detected lcore 36 as core 0 on socket 1 00:03:29.943 EAL: Detected lcore 37 as core 1 on socket 1 00:03:29.943 EAL: Detected lcore 38 as core 2 on socket 1 00:03:29.943 EAL: Detected lcore 39 as core 3 on socket 1 00:03:29.943 EAL: Detected lcore 40 as core 4 on socket 1 00:03:29.943 EAL: Detected lcore 41 as core 5 on socket 1 00:03:29.943 EAL: Detected lcore 42 as core 8 on socket 1 00:03:29.943 EAL: Detected lcore 43 as core 9 on socket 1 00:03:29.943 EAL: Detected lcore 44 as core 10 on socket 1 00:03:29.943 EAL: Detected lcore 45 as core 11 on socket 1 00:03:29.943 EAL: Detected lcore 46 as core 12 on socket 1 00:03:29.943 EAL: Detected lcore 47 as core 13 on socket 1 00:03:29.943 EAL: Maximum logical cores by configuration: 128 00:03:29.943 EAL: Detected CPU lcores: 48 00:03:29.943 EAL: Detected NUMA nodes: 2 00:03:29.943 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:03:29.943 EAL: Detected shared linkage of DPDK 00:03:29.943 EAL: No shared files mode enabled, IPC will be disabled 00:03:29.943 EAL: Bus pci wants IOVA as 'DC' 00:03:29.943 EAL: Buses did not request a specific IOVA mode. 00:03:29.943 EAL: IOMMU is available, selecting IOVA as VA mode. 00:03:29.943 EAL: Selected IOVA mode 'VA' 00:03:29.943 EAL: No free 2048 kB hugepages reported on node 1 00:03:29.943 EAL: Probing VFIO support... 00:03:29.943 EAL: IOMMU type 1 (Type 1) is supported 00:03:29.943 EAL: IOMMU type 7 (sPAPR) is not supported 00:03:29.943 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:03:29.943 EAL: VFIO support initialized 00:03:29.943 EAL: Ask a virtual area of 0x2e000 bytes 00:03:29.943 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:03:29.943 EAL: Setting up physically contiguous memory... 00:03:29.943 EAL: Setting maximum number of open files to 524288 00:03:29.943 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:03:29.943 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:03:29.943 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:03:29.943 EAL: Ask a virtual area of 0x61000 bytes 00:03:29.943 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:03:29.943 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:29.943 EAL: Ask a virtual area of 0x400000000 bytes 00:03:29.943 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:03:29.943 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:03:29.943 EAL: Ask a virtual area of 0x61000 bytes 00:03:29.943 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:03:29.943 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:29.943 EAL: Ask a virtual area of 0x400000000 bytes 00:03:29.943 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:03:29.943 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:03:29.943 EAL: Ask a virtual area of 0x61000 bytes 00:03:29.943 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:03:29.943 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:29.943 EAL: Ask a virtual area of 0x400000000 bytes 00:03:29.943 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:03:29.943 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:03:29.943 EAL: Ask a virtual area of 0x61000 bytes 00:03:29.943 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:03:29.943 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:29.943 EAL: Ask a virtual area of 0x400000000 bytes 00:03:29.943 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:03:29.943 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:03:29.943 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:03:29.943 EAL: Ask a virtual area of 0x61000 bytes 00:03:29.943 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:03:29.943 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:29.943 EAL: Ask a virtual area of 0x400000000 bytes 00:03:29.943 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:03:29.943 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:03:29.943 EAL: Ask a virtual area of 0x61000 bytes 00:03:29.943 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:03:29.943 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:29.943 EAL: Ask a virtual area of 0x400000000 bytes 00:03:29.943 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:03:29.943 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:03:29.943 EAL: Ask a virtual area of 0x61000 bytes 00:03:29.943 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:03:29.943 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:29.943 EAL: Ask a virtual area of 0x400000000 bytes 00:03:29.943 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:03:29.943 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:03:29.943 EAL: Ask a virtual area of 0x61000 bytes 00:03:29.943 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:03:29.943 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:29.943 EAL: Ask a virtual area of 0x400000000 bytes 00:03:29.943 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:03:29.943 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:03:29.943 EAL: Hugepages will be freed exactly as allocated. 00:03:29.943 EAL: No shared files mode enabled, IPC is disabled 00:03:29.943 EAL: No shared files mode enabled, IPC is disabled 00:03:29.943 EAL: TSC frequency is ~2700000 KHz 00:03:29.943 EAL: Main lcore 0 is ready (tid=7fdf8a615a00;cpuset=[0]) 00:03:29.943 EAL: Trying to obtain current memory policy. 00:03:29.943 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:29.943 EAL: Restoring previous memory policy: 0 00:03:29.943 EAL: request: mp_malloc_sync 00:03:29.943 EAL: No shared files mode enabled, IPC is disabled 00:03:29.944 EAL: Heap on socket 0 was expanded by 2MB 00:03:29.944 EAL: No shared files mode enabled, IPC is disabled 00:03:29.944 EAL: No PCI address specified using 'addr=' in: bus=pci 00:03:29.944 EAL: Mem event callback 'spdk:(nil)' registered 00:03:29.944 00:03:29.944 00:03:29.944 CUnit - A unit testing framework for C - Version 2.1-3 00:03:29.944 http://cunit.sourceforge.net/ 00:03:29.944 00:03:29.944 00:03:29.944 Suite: components_suite 00:03:29.944 Test: vtophys_malloc_test ...passed 00:03:29.944 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:03:29.944 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:29.944 EAL: Restoring previous memory policy: 4 00:03:29.944 EAL: Calling mem event callback 'spdk:(nil)' 00:03:29.944 EAL: request: mp_malloc_sync 00:03:29.944 EAL: No shared files mode enabled, IPC is disabled 00:03:29.944 EAL: Heap on socket 0 was expanded by 4MB 00:03:29.944 EAL: Calling mem event callback 'spdk:(nil)' 00:03:29.944 EAL: request: mp_malloc_sync 00:03:29.944 EAL: No shared files mode enabled, IPC is disabled 00:03:29.944 EAL: Heap on socket 0 was shrunk by 4MB 00:03:29.944 EAL: Trying to obtain current memory policy. 00:03:29.944 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:29.944 EAL: Restoring previous memory policy: 4 00:03:29.944 EAL: Calling mem event callback 'spdk:(nil)' 00:03:29.944 EAL: request: mp_malloc_sync 00:03:29.944 EAL: No shared files mode enabled, IPC is disabled 00:03:29.944 EAL: Heap on socket 0 was expanded by 6MB 00:03:29.944 EAL: Calling mem event callback 'spdk:(nil)' 00:03:29.944 EAL: request: mp_malloc_sync 00:03:29.944 EAL: No shared files mode enabled, IPC is disabled 00:03:29.944 EAL: Heap on socket 0 was shrunk by 6MB 00:03:29.944 EAL: Trying to obtain current memory policy. 00:03:29.944 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:29.944 EAL: Restoring previous memory policy: 4 00:03:29.944 EAL: Calling mem event callback 'spdk:(nil)' 00:03:29.944 EAL: request: mp_malloc_sync 00:03:29.944 EAL: No shared files mode enabled, IPC is disabled 00:03:29.944 EAL: Heap on socket 0 was expanded by 10MB 00:03:29.944 EAL: Calling mem event callback 'spdk:(nil)' 00:03:29.944 EAL: request: mp_malloc_sync 00:03:29.944 EAL: No shared files mode enabled, IPC is disabled 00:03:29.944 EAL: Heap on socket 0 was shrunk by 10MB 00:03:29.944 EAL: Trying to obtain current memory policy. 00:03:29.944 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:29.944 EAL: Restoring previous memory policy: 4 00:03:29.944 EAL: Calling mem event callback 'spdk:(nil)' 00:03:29.944 EAL: request: mp_malloc_sync 00:03:29.944 EAL: No shared files mode enabled, IPC is disabled 00:03:29.944 EAL: Heap on socket 0 was expanded by 18MB 00:03:29.944 EAL: Calling mem event callback 'spdk:(nil)' 00:03:29.944 EAL: request: mp_malloc_sync 00:03:29.944 EAL: No shared files mode enabled, IPC is disabled 00:03:29.944 EAL: Heap on socket 0 was shrunk by 18MB 00:03:29.944 EAL: Trying to obtain current memory policy. 00:03:29.944 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:29.944 EAL: Restoring previous memory policy: 4 00:03:29.944 EAL: Calling mem event callback 'spdk:(nil)' 00:03:29.944 EAL: request: mp_malloc_sync 00:03:29.944 EAL: No shared files mode enabled, IPC is disabled 00:03:29.944 EAL: Heap on socket 0 was expanded by 34MB 00:03:29.944 EAL: Calling mem event callback 'spdk:(nil)' 00:03:29.944 EAL: request: mp_malloc_sync 00:03:29.944 EAL: No shared files mode enabled, IPC is disabled 00:03:29.944 EAL: Heap on socket 0 was shrunk by 34MB 00:03:29.944 EAL: Trying to obtain current memory policy. 00:03:29.944 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:29.944 EAL: Restoring previous memory policy: 4 00:03:29.944 EAL: Calling mem event callback 'spdk:(nil)' 00:03:29.944 EAL: request: mp_malloc_sync 00:03:29.944 EAL: No shared files mode enabled, IPC is disabled 00:03:29.944 EAL: Heap on socket 0 was expanded by 66MB 00:03:30.201 EAL: Calling mem event callback 'spdk:(nil)' 00:03:30.201 EAL: request: mp_malloc_sync 00:03:30.201 EAL: No shared files mode enabled, IPC is disabled 00:03:30.201 EAL: Heap on socket 0 was shrunk by 66MB 00:03:30.201 EAL: Trying to obtain current memory policy. 00:03:30.201 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:30.201 EAL: Restoring previous memory policy: 4 00:03:30.201 EAL: Calling mem event callback 'spdk:(nil)' 00:03:30.201 EAL: request: mp_malloc_sync 00:03:30.201 EAL: No shared files mode enabled, IPC is disabled 00:03:30.201 EAL: Heap on socket 0 was expanded by 130MB 00:03:30.201 EAL: Calling mem event callback 'spdk:(nil)' 00:03:30.201 EAL: request: mp_malloc_sync 00:03:30.201 EAL: No shared files mode enabled, IPC is disabled 00:03:30.201 EAL: Heap on socket 0 was shrunk by 130MB 00:03:30.201 EAL: Trying to obtain current memory policy. 00:03:30.201 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:30.201 EAL: Restoring previous memory policy: 4 00:03:30.201 EAL: Calling mem event callback 'spdk:(nil)' 00:03:30.201 EAL: request: mp_malloc_sync 00:03:30.201 EAL: No shared files mode enabled, IPC is disabled 00:03:30.201 EAL: Heap on socket 0 was expanded by 258MB 00:03:30.201 EAL: Calling mem event callback 'spdk:(nil)' 00:03:30.459 EAL: request: mp_malloc_sync 00:03:30.459 EAL: No shared files mode enabled, IPC is disabled 00:03:30.459 EAL: Heap on socket 0 was shrunk by 258MB 00:03:30.459 EAL: Trying to obtain current memory policy. 00:03:30.459 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:30.459 EAL: Restoring previous memory policy: 4 00:03:30.459 EAL: Calling mem event callback 'spdk:(nil)' 00:03:30.459 EAL: request: mp_malloc_sync 00:03:30.459 EAL: No shared files mode enabled, IPC is disabled 00:03:30.459 EAL: Heap on socket 0 was expanded by 514MB 00:03:30.717 EAL: Calling mem event callback 'spdk:(nil)' 00:03:30.717 EAL: request: mp_malloc_sync 00:03:30.717 EAL: No shared files mode enabled, IPC is disabled 00:03:30.717 EAL: Heap on socket 0 was shrunk by 514MB 00:03:30.717 EAL: Trying to obtain current memory policy. 00:03:30.717 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:30.975 EAL: Restoring previous memory policy: 4 00:03:30.975 EAL: Calling mem event callback 'spdk:(nil)' 00:03:30.975 EAL: request: mp_malloc_sync 00:03:30.975 EAL: No shared files mode enabled, IPC is disabled 00:03:30.975 EAL: Heap on socket 0 was expanded by 1026MB 00:03:31.232 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.490 EAL: request: mp_malloc_sync 00:03:31.490 EAL: No shared files mode enabled, IPC is disabled 00:03:31.490 EAL: Heap on socket 0 was shrunk by 1026MB 00:03:31.490 passed 00:03:31.490 00:03:31.490 Run Summary: Type Total Ran Passed Failed Inactive 00:03:31.490 suites 1 1 n/a 0 0 00:03:31.490 tests 2 2 2 0 0 00:03:31.490 asserts 497 497 497 0 n/a 00:03:31.490 00:03:31.490 Elapsed time = 1.365 seconds 00:03:31.490 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.490 EAL: request: mp_malloc_sync 00:03:31.490 EAL: No shared files mode enabled, IPC is disabled 00:03:31.490 EAL: Heap on socket 0 was shrunk by 2MB 00:03:31.490 EAL: No shared files mode enabled, IPC is disabled 00:03:31.490 EAL: No shared files mode enabled, IPC is disabled 00:03:31.490 EAL: No shared files mode enabled, IPC is disabled 00:03:31.490 00:03:31.490 real 0m1.482s 00:03:31.490 user 0m0.846s 00:03:31.490 sys 0m0.600s 00:03:31.490 11:27:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:31.490 11:27:51 -- common/autotest_common.sh@10 -- # set +x 00:03:31.490 ************************************ 00:03:31.490 END TEST env_vtophys 00:03:31.490 ************************************ 00:03:31.490 11:27:51 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:31.490 11:27:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:31.490 11:27:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:31.490 11:27:51 -- common/autotest_common.sh@10 -- # set +x 00:03:31.490 ************************************ 00:03:31.490 START TEST env_pci 00:03:31.490 ************************************ 00:03:31.491 11:27:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:31.491 00:03:31.491 00:03:31.491 CUnit - A unit testing framework for C - Version 2.1-3 00:03:31.491 http://cunit.sourceforge.net/ 00:03:31.491 00:03:31.491 00:03:31.491 Suite: pci 00:03:31.491 Test: pci_hook ...[2024-11-28 11:27:51.393708] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3680795 has claimed it 00:03:31.491 EAL: Cannot find device (10000:00:01.0) 00:03:31.491 EAL: Failed to attach device on primary process 00:03:31.491 passed 00:03:31.491 00:03:31.491 Run Summary: Type Total Ran Passed Failed Inactive 00:03:31.491 suites 1 1 n/a 0 0 00:03:31.491 tests 1 1 1 0 0 00:03:31.491 asserts 25 25 25 0 n/a 00:03:31.491 00:03:31.491 Elapsed time = 0.019 seconds 00:03:31.491 00:03:31.491 real 0m0.030s 00:03:31.491 user 0m0.007s 00:03:31.491 sys 0m0.022s 00:03:31.491 11:27:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:31.491 11:27:51 -- common/autotest_common.sh@10 -- # set +x 00:03:31.491 ************************************ 00:03:31.491 END TEST env_pci 00:03:31.491 ************************************ 00:03:31.491 11:27:51 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:03:31.491 11:27:51 -- env/env.sh@15 -- # uname 00:03:31.491 11:27:51 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:03:31.491 11:27:51 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:03:31.491 11:27:51 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:31.491 11:27:51 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:03:31.491 11:27:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:31.491 11:27:51 -- common/autotest_common.sh@10 -- # set +x 00:03:31.491 ************************************ 00:03:31.491 START TEST env_dpdk_post_init 00:03:31.491 ************************************ 00:03:31.491 11:27:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:31.491 EAL: Detected CPU lcores: 48 00:03:31.491 EAL: Detected NUMA nodes: 2 00:03:31.491 EAL: Detected shared linkage of DPDK 00:03:31.491 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:31.491 EAL: Selected IOVA mode 'VA' 00:03:31.491 EAL: No free 2048 kB hugepages reported on node 1 00:03:31.491 EAL: VFIO support initialized 00:03:31.491 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:31.749 EAL: Using IOMMU type 1 (Type 1) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:03:31.749 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:03:32.684 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:03:35.974 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:03:35.974 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:03:35.974 Starting DPDK initialization... 00:03:35.974 Starting SPDK post initialization... 00:03:35.974 SPDK NVMe probe 00:03:35.974 Attaching to 0000:88:00.0 00:03:35.974 Attached to 0000:88:00.0 00:03:35.974 Cleaning up... 00:03:35.974 00:03:35.974 real 0m4.400s 00:03:35.974 user 0m3.277s 00:03:35.974 sys 0m0.179s 00:03:35.974 11:27:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:35.974 11:27:55 -- common/autotest_common.sh@10 -- # set +x 00:03:35.974 ************************************ 00:03:35.974 END TEST env_dpdk_post_init 00:03:35.974 ************************************ 00:03:35.974 11:27:55 -- env/env.sh@26 -- # uname 00:03:35.974 11:27:55 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:03:35.974 11:27:55 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:03:35.974 11:27:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:35.974 11:27:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:35.974 11:27:55 -- common/autotest_common.sh@10 -- # set +x 00:03:35.974 ************************************ 00:03:35.974 START TEST env_mem_callbacks 00:03:35.974 ************************************ 00:03:35.974 11:27:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:03:35.974 EAL: Detected CPU lcores: 48 00:03:35.974 EAL: Detected NUMA nodes: 2 00:03:35.974 EAL: Detected shared linkage of DPDK 00:03:35.974 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:35.974 EAL: Selected IOVA mode 'VA' 00:03:35.974 EAL: No free 2048 kB hugepages reported on node 1 00:03:35.974 EAL: VFIO support initialized 00:03:35.974 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:35.974 00:03:35.974 00:03:35.974 CUnit - A unit testing framework for C - Version 2.1-3 00:03:35.974 http://cunit.sourceforge.net/ 00:03:35.974 00:03:35.974 00:03:35.974 Suite: memory 00:03:35.974 Test: test ... 00:03:35.974 register 0x200000200000 2097152 00:03:35.974 malloc 3145728 00:03:35.974 register 0x200000400000 4194304 00:03:35.974 buf 0x200000500000 len 3145728 PASSED 00:03:35.974 malloc 64 00:03:35.974 buf 0x2000004fff40 len 64 PASSED 00:03:35.974 malloc 4194304 00:03:35.974 register 0x200000800000 6291456 00:03:35.974 buf 0x200000a00000 len 4194304 PASSED 00:03:35.974 free 0x200000500000 3145728 00:03:35.974 free 0x2000004fff40 64 00:03:35.974 unregister 0x200000400000 4194304 PASSED 00:03:35.974 free 0x200000a00000 4194304 00:03:35.974 unregister 0x200000800000 6291456 PASSED 00:03:35.974 malloc 8388608 00:03:35.974 register 0x200000400000 10485760 00:03:35.974 buf 0x200000600000 len 8388608 PASSED 00:03:35.974 free 0x200000600000 8388608 00:03:35.974 unregister 0x200000400000 10485760 PASSED 00:03:35.974 passed 00:03:35.974 00:03:35.974 Run Summary: Type Total Ran Passed Failed Inactive 00:03:35.974 suites 1 1 n/a 0 0 00:03:35.974 tests 1 1 1 0 0 00:03:35.974 asserts 15 15 15 0 n/a 00:03:35.974 00:03:35.974 Elapsed time = 0.005 seconds 00:03:35.974 00:03:35.974 real 0m0.049s 00:03:35.974 user 0m0.017s 00:03:35.974 sys 0m0.032s 00:03:35.974 11:27:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:35.974 11:27:55 -- common/autotest_common.sh@10 -- # set +x 00:03:35.974 ************************************ 00:03:35.974 END TEST env_mem_callbacks 00:03:35.974 ************************************ 00:03:35.974 00:03:35.974 real 0m6.392s 00:03:35.974 user 0m4.442s 00:03:35.974 sys 0m1.001s 00:03:35.974 11:27:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:35.974 11:27:55 -- common/autotest_common.sh@10 -- # set +x 00:03:35.974 ************************************ 00:03:35.974 END TEST env 00:03:35.974 ************************************ 00:03:35.974 11:27:55 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:03:35.974 11:27:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:35.974 11:27:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:35.974 11:27:55 -- common/autotest_common.sh@10 -- # set +x 00:03:35.974 ************************************ 00:03:35.974 START TEST rpc 00:03:35.974 ************************************ 00:03:35.974 11:27:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:03:35.974 * Looking for test storage... 00:03:35.974 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:35.974 11:27:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:35.974 11:27:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:35.974 11:27:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:36.233 11:27:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:36.233 11:27:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:36.233 11:27:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:36.233 11:27:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:36.233 11:27:56 -- scripts/common.sh@335 -- # IFS=.-: 00:03:36.233 11:27:56 -- scripts/common.sh@335 -- # read -ra ver1 00:03:36.233 11:27:56 -- scripts/common.sh@336 -- # IFS=.-: 00:03:36.233 11:27:56 -- scripts/common.sh@336 -- # read -ra ver2 00:03:36.233 11:27:56 -- scripts/common.sh@337 -- # local 'op=<' 00:03:36.233 11:27:56 -- scripts/common.sh@339 -- # ver1_l=2 00:03:36.233 11:27:56 -- scripts/common.sh@340 -- # ver2_l=1 00:03:36.233 11:27:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:36.233 11:27:56 -- scripts/common.sh@343 -- # case "$op" in 00:03:36.233 11:27:56 -- scripts/common.sh@344 -- # : 1 00:03:36.233 11:27:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:36.233 11:27:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:36.233 11:27:56 -- scripts/common.sh@364 -- # decimal 1 00:03:36.233 11:27:56 -- scripts/common.sh@352 -- # local d=1 00:03:36.233 11:27:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:36.233 11:27:56 -- scripts/common.sh@354 -- # echo 1 00:03:36.233 11:27:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:36.233 11:27:56 -- scripts/common.sh@365 -- # decimal 2 00:03:36.233 11:27:56 -- scripts/common.sh@352 -- # local d=2 00:03:36.233 11:27:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:36.233 11:27:56 -- scripts/common.sh@354 -- # echo 2 00:03:36.233 11:27:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:36.233 11:27:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:36.233 11:27:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:36.233 11:27:56 -- scripts/common.sh@367 -- # return 0 00:03:36.233 11:27:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:36.233 11:27:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:36.233 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:36.233 --rc genhtml_branch_coverage=1 00:03:36.233 --rc genhtml_function_coverage=1 00:03:36.233 --rc genhtml_legend=1 00:03:36.233 --rc geninfo_all_blocks=1 00:03:36.233 --rc geninfo_unexecuted_blocks=1 00:03:36.233 00:03:36.233 ' 00:03:36.233 11:27:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:36.233 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:36.233 --rc genhtml_branch_coverage=1 00:03:36.233 --rc genhtml_function_coverage=1 00:03:36.233 --rc genhtml_legend=1 00:03:36.233 --rc geninfo_all_blocks=1 00:03:36.233 --rc geninfo_unexecuted_blocks=1 00:03:36.233 00:03:36.233 ' 00:03:36.233 11:27:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:36.233 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:36.233 --rc genhtml_branch_coverage=1 00:03:36.233 --rc genhtml_function_coverage=1 00:03:36.233 --rc genhtml_legend=1 00:03:36.233 --rc geninfo_all_blocks=1 00:03:36.233 --rc geninfo_unexecuted_blocks=1 00:03:36.233 00:03:36.233 ' 00:03:36.233 11:27:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:36.233 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:36.233 --rc genhtml_branch_coverage=1 00:03:36.233 --rc genhtml_function_coverage=1 00:03:36.233 --rc genhtml_legend=1 00:03:36.233 --rc geninfo_all_blocks=1 00:03:36.233 --rc geninfo_unexecuted_blocks=1 00:03:36.233 00:03:36.233 ' 00:03:36.233 11:27:56 -- rpc/rpc.sh@65 -- # spdk_pid=3681471 00:03:36.233 11:27:56 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:03:36.233 11:27:56 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:03:36.233 11:27:56 -- rpc/rpc.sh@67 -- # waitforlisten 3681471 00:03:36.233 11:27:56 -- common/autotest_common.sh@829 -- # '[' -z 3681471 ']' 00:03:36.233 11:27:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:36.233 11:27:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:36.233 11:27:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:36.234 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:36.234 11:27:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:36.234 11:27:56 -- common/autotest_common.sh@10 -- # set +x 00:03:36.234 [2024-11-28 11:27:56.151960] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:36.234 [2024-11-28 11:27:56.152047] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3681471 ] 00:03:36.234 EAL: No free 2048 kB hugepages reported on node 1 00:03:36.234 [2024-11-28 11:27:56.208059] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:36.492 [2024-11-28 11:27:56.319871] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:36.492 [2024-11-28 11:27:56.320020] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:03:36.492 [2024-11-28 11:27:56.320041] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3681471' to capture a snapshot of events at runtime. 00:03:36.492 [2024-11-28 11:27:56.320054] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3681471 for offline analysis/debug. 00:03:36.492 [2024-11-28 11:27:56.320081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:37.058 11:27:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:37.058 11:27:57 -- common/autotest_common.sh@862 -- # return 0 00:03:37.058 11:27:57 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:37.058 11:27:57 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:37.058 11:27:57 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:03:37.058 11:27:57 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:03:37.058 11:27:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:37.058 11:27:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:37.058 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.058 ************************************ 00:03:37.058 START TEST rpc_integrity 00:03:37.058 ************************************ 00:03:37.058 11:27:57 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:03:37.058 11:27:57 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:03:37.058 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.058 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.058 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.058 11:27:57 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:03:37.058 11:27:57 -- rpc/rpc.sh@13 -- # jq length 00:03:37.317 11:27:57 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:03:37.317 11:27:57 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:03:37.317 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.317 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.317 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.317 11:27:57 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:03:37.317 11:27:57 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:03:37.317 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.317 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.317 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.317 11:27:57 -- rpc/rpc.sh@16 -- # bdevs='[ 00:03:37.317 { 00:03:37.317 "name": "Malloc0", 00:03:37.317 "aliases": [ 00:03:37.317 "977344d2-bbc6-4e70-b76d-9f06de0a4913" 00:03:37.317 ], 00:03:37.317 "product_name": "Malloc disk", 00:03:37.317 "block_size": 512, 00:03:37.317 "num_blocks": 16384, 00:03:37.317 "uuid": "977344d2-bbc6-4e70-b76d-9f06de0a4913", 00:03:37.317 "assigned_rate_limits": { 00:03:37.317 "rw_ios_per_sec": 0, 00:03:37.317 "rw_mbytes_per_sec": 0, 00:03:37.317 "r_mbytes_per_sec": 0, 00:03:37.317 "w_mbytes_per_sec": 0 00:03:37.317 }, 00:03:37.317 "claimed": false, 00:03:37.317 "zoned": false, 00:03:37.317 "supported_io_types": { 00:03:37.317 "read": true, 00:03:37.317 "write": true, 00:03:37.317 "unmap": true, 00:03:37.317 "write_zeroes": true, 00:03:37.317 "flush": true, 00:03:37.317 "reset": true, 00:03:37.317 "compare": false, 00:03:37.317 "compare_and_write": false, 00:03:37.317 "abort": true, 00:03:37.317 "nvme_admin": false, 00:03:37.317 "nvme_io": false 00:03:37.317 }, 00:03:37.317 "memory_domains": [ 00:03:37.317 { 00:03:37.317 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:37.317 "dma_device_type": 2 00:03:37.317 } 00:03:37.317 ], 00:03:37.317 "driver_specific": {} 00:03:37.317 } 00:03:37.317 ]' 00:03:37.317 11:27:57 -- rpc/rpc.sh@17 -- # jq length 00:03:37.317 11:27:57 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:03:37.317 11:27:57 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:03:37.317 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.317 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.317 [2024-11-28 11:27:57.208727] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:03:37.317 [2024-11-28 11:27:57.208772] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:03:37.317 [2024-11-28 11:27:57.208794] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x15f1cb0 00:03:37.317 [2024-11-28 11:27:57.208826] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:03:37.317 [2024-11-28 11:27:57.210272] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:03:37.317 [2024-11-28 11:27:57.210300] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:03:37.317 Passthru0 00:03:37.317 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.317 11:27:57 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:03:37.317 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.317 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.317 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.317 11:27:57 -- rpc/rpc.sh@20 -- # bdevs='[ 00:03:37.317 { 00:03:37.317 "name": "Malloc0", 00:03:37.317 "aliases": [ 00:03:37.318 "977344d2-bbc6-4e70-b76d-9f06de0a4913" 00:03:37.318 ], 00:03:37.318 "product_name": "Malloc disk", 00:03:37.318 "block_size": 512, 00:03:37.318 "num_blocks": 16384, 00:03:37.318 "uuid": "977344d2-bbc6-4e70-b76d-9f06de0a4913", 00:03:37.318 "assigned_rate_limits": { 00:03:37.318 "rw_ios_per_sec": 0, 00:03:37.318 "rw_mbytes_per_sec": 0, 00:03:37.318 "r_mbytes_per_sec": 0, 00:03:37.318 "w_mbytes_per_sec": 0 00:03:37.318 }, 00:03:37.318 "claimed": true, 00:03:37.318 "claim_type": "exclusive_write", 00:03:37.318 "zoned": false, 00:03:37.318 "supported_io_types": { 00:03:37.318 "read": true, 00:03:37.318 "write": true, 00:03:37.318 "unmap": true, 00:03:37.318 "write_zeroes": true, 00:03:37.318 "flush": true, 00:03:37.318 "reset": true, 00:03:37.318 "compare": false, 00:03:37.318 "compare_and_write": false, 00:03:37.318 "abort": true, 00:03:37.318 "nvme_admin": false, 00:03:37.318 "nvme_io": false 00:03:37.318 }, 00:03:37.318 "memory_domains": [ 00:03:37.318 { 00:03:37.318 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:37.318 "dma_device_type": 2 00:03:37.318 } 00:03:37.318 ], 00:03:37.318 "driver_specific": {} 00:03:37.318 }, 00:03:37.318 { 00:03:37.318 "name": "Passthru0", 00:03:37.318 "aliases": [ 00:03:37.318 "efe5e1ec-6c71-5c0c-a259-b8a9d439ae30" 00:03:37.318 ], 00:03:37.318 "product_name": "passthru", 00:03:37.318 "block_size": 512, 00:03:37.318 "num_blocks": 16384, 00:03:37.318 "uuid": "efe5e1ec-6c71-5c0c-a259-b8a9d439ae30", 00:03:37.318 "assigned_rate_limits": { 00:03:37.318 "rw_ios_per_sec": 0, 00:03:37.318 "rw_mbytes_per_sec": 0, 00:03:37.318 "r_mbytes_per_sec": 0, 00:03:37.318 "w_mbytes_per_sec": 0 00:03:37.318 }, 00:03:37.318 "claimed": false, 00:03:37.318 "zoned": false, 00:03:37.318 "supported_io_types": { 00:03:37.318 "read": true, 00:03:37.318 "write": true, 00:03:37.318 "unmap": true, 00:03:37.318 "write_zeroes": true, 00:03:37.318 "flush": true, 00:03:37.318 "reset": true, 00:03:37.318 "compare": false, 00:03:37.318 "compare_and_write": false, 00:03:37.318 "abort": true, 00:03:37.318 "nvme_admin": false, 00:03:37.318 "nvme_io": false 00:03:37.318 }, 00:03:37.318 "memory_domains": [ 00:03:37.318 { 00:03:37.318 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:37.318 "dma_device_type": 2 00:03:37.318 } 00:03:37.318 ], 00:03:37.318 "driver_specific": { 00:03:37.318 "passthru": { 00:03:37.318 "name": "Passthru0", 00:03:37.318 "base_bdev_name": "Malloc0" 00:03:37.318 } 00:03:37.318 } 00:03:37.318 } 00:03:37.318 ]' 00:03:37.318 11:27:57 -- rpc/rpc.sh@21 -- # jq length 00:03:37.318 11:27:57 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:03:37.318 11:27:57 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:03:37.318 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.318 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.318 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.318 11:27:57 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:03:37.318 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.318 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.318 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.318 11:27:57 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:03:37.318 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.318 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.318 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.318 11:27:57 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:03:37.318 11:27:57 -- rpc/rpc.sh@26 -- # jq length 00:03:37.318 11:27:57 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:03:37.318 00:03:37.318 real 0m0.225s 00:03:37.318 user 0m0.151s 00:03:37.318 sys 0m0.017s 00:03:37.318 11:27:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:37.318 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.318 ************************************ 00:03:37.318 END TEST rpc_integrity 00:03:37.318 ************************************ 00:03:37.318 11:27:57 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:03:37.318 11:27:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:37.318 11:27:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:37.318 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.318 ************************************ 00:03:37.318 START TEST rpc_plugins 00:03:37.318 ************************************ 00:03:37.318 11:27:57 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:03:37.318 11:27:57 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:03:37.318 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.318 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.318 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.318 11:27:57 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:03:37.318 11:27:57 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:03:37.318 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.318 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.577 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.577 11:27:57 -- rpc/rpc.sh@31 -- # bdevs='[ 00:03:37.577 { 00:03:37.577 "name": "Malloc1", 00:03:37.577 "aliases": [ 00:03:37.577 "56e52fff-b952-4712-b606-1bb048490171" 00:03:37.577 ], 00:03:37.577 "product_name": "Malloc disk", 00:03:37.577 "block_size": 4096, 00:03:37.577 "num_blocks": 256, 00:03:37.577 "uuid": "56e52fff-b952-4712-b606-1bb048490171", 00:03:37.577 "assigned_rate_limits": { 00:03:37.577 "rw_ios_per_sec": 0, 00:03:37.577 "rw_mbytes_per_sec": 0, 00:03:37.577 "r_mbytes_per_sec": 0, 00:03:37.577 "w_mbytes_per_sec": 0 00:03:37.577 }, 00:03:37.577 "claimed": false, 00:03:37.577 "zoned": false, 00:03:37.577 "supported_io_types": { 00:03:37.577 "read": true, 00:03:37.577 "write": true, 00:03:37.577 "unmap": true, 00:03:37.577 "write_zeroes": true, 00:03:37.577 "flush": true, 00:03:37.577 "reset": true, 00:03:37.577 "compare": false, 00:03:37.577 "compare_and_write": false, 00:03:37.577 "abort": true, 00:03:37.577 "nvme_admin": false, 00:03:37.577 "nvme_io": false 00:03:37.577 }, 00:03:37.577 "memory_domains": [ 00:03:37.577 { 00:03:37.577 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:37.577 "dma_device_type": 2 00:03:37.577 } 00:03:37.577 ], 00:03:37.577 "driver_specific": {} 00:03:37.577 } 00:03:37.577 ]' 00:03:37.577 11:27:57 -- rpc/rpc.sh@32 -- # jq length 00:03:37.577 11:27:57 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:03:37.577 11:27:57 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:03:37.577 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.577 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.577 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.577 11:27:57 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:03:37.577 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.577 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.577 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.577 11:27:57 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:03:37.577 11:27:57 -- rpc/rpc.sh@36 -- # jq length 00:03:37.577 11:27:57 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:03:37.577 00:03:37.577 real 0m0.109s 00:03:37.577 user 0m0.077s 00:03:37.577 sys 0m0.005s 00:03:37.577 11:27:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:37.577 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.577 ************************************ 00:03:37.577 END TEST rpc_plugins 00:03:37.577 ************************************ 00:03:37.577 11:27:57 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:03:37.577 11:27:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:37.577 11:27:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:37.577 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.577 ************************************ 00:03:37.577 START TEST rpc_trace_cmd_test 00:03:37.577 ************************************ 00:03:37.577 11:27:57 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:03:37.577 11:27:57 -- rpc/rpc.sh@40 -- # local info 00:03:37.577 11:27:57 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:03:37.577 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.577 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.577 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.577 11:27:57 -- rpc/rpc.sh@42 -- # info='{ 00:03:37.577 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3681471", 00:03:37.577 "tpoint_group_mask": "0x8", 00:03:37.577 "iscsi_conn": { 00:03:37.577 "mask": "0x2", 00:03:37.577 "tpoint_mask": "0x0" 00:03:37.577 }, 00:03:37.577 "scsi": { 00:03:37.577 "mask": "0x4", 00:03:37.577 "tpoint_mask": "0x0" 00:03:37.577 }, 00:03:37.577 "bdev": { 00:03:37.577 "mask": "0x8", 00:03:37.577 "tpoint_mask": "0xffffffffffffffff" 00:03:37.577 }, 00:03:37.577 "nvmf_rdma": { 00:03:37.577 "mask": "0x10", 00:03:37.577 "tpoint_mask": "0x0" 00:03:37.577 }, 00:03:37.577 "nvmf_tcp": { 00:03:37.577 "mask": "0x20", 00:03:37.577 "tpoint_mask": "0x0" 00:03:37.577 }, 00:03:37.577 "ftl": { 00:03:37.577 "mask": "0x40", 00:03:37.577 "tpoint_mask": "0x0" 00:03:37.577 }, 00:03:37.577 "blobfs": { 00:03:37.577 "mask": "0x80", 00:03:37.577 "tpoint_mask": "0x0" 00:03:37.577 }, 00:03:37.577 "dsa": { 00:03:37.577 "mask": "0x200", 00:03:37.577 "tpoint_mask": "0x0" 00:03:37.577 }, 00:03:37.577 "thread": { 00:03:37.577 "mask": "0x400", 00:03:37.577 "tpoint_mask": "0x0" 00:03:37.577 }, 00:03:37.577 "nvme_pcie": { 00:03:37.577 "mask": "0x800", 00:03:37.577 "tpoint_mask": "0x0" 00:03:37.577 }, 00:03:37.577 "iaa": { 00:03:37.577 "mask": "0x1000", 00:03:37.577 "tpoint_mask": "0x0" 00:03:37.577 }, 00:03:37.577 "nvme_tcp": { 00:03:37.577 "mask": "0x2000", 00:03:37.577 "tpoint_mask": "0x0" 00:03:37.577 }, 00:03:37.577 "bdev_nvme": { 00:03:37.577 "mask": "0x4000", 00:03:37.577 "tpoint_mask": "0x0" 00:03:37.577 } 00:03:37.577 }' 00:03:37.577 11:27:57 -- rpc/rpc.sh@43 -- # jq length 00:03:37.577 11:27:57 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:03:37.577 11:27:57 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:03:37.577 11:27:57 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:03:37.577 11:27:57 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:03:37.578 11:27:57 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:03:37.578 11:27:57 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:03:37.836 11:27:57 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:03:37.836 11:27:57 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:03:37.836 11:27:57 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:03:37.836 00:03:37.836 real 0m0.199s 00:03:37.836 user 0m0.174s 00:03:37.836 sys 0m0.016s 00:03:37.836 11:27:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:37.836 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.836 ************************************ 00:03:37.836 END TEST rpc_trace_cmd_test 00:03:37.836 ************************************ 00:03:37.836 11:27:57 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:03:37.836 11:27:57 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:03:37.836 11:27:57 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:03:37.836 11:27:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:37.836 11:27:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:37.836 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.836 ************************************ 00:03:37.836 START TEST rpc_daemon_integrity 00:03:37.836 ************************************ 00:03:37.836 11:27:57 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:03:37.836 11:27:57 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:03:37.836 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.836 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.836 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.836 11:27:57 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:03:37.836 11:27:57 -- rpc/rpc.sh@13 -- # jq length 00:03:37.836 11:27:57 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:03:37.836 11:27:57 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:03:37.836 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.836 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.836 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.836 11:27:57 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:03:37.836 11:27:57 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:03:37.836 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.836 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.836 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.836 11:27:57 -- rpc/rpc.sh@16 -- # bdevs='[ 00:03:37.836 { 00:03:37.836 "name": "Malloc2", 00:03:37.836 "aliases": [ 00:03:37.836 "2ccf139e-1847-4852-92e8-ac398ca705a9" 00:03:37.836 ], 00:03:37.836 "product_name": "Malloc disk", 00:03:37.836 "block_size": 512, 00:03:37.836 "num_blocks": 16384, 00:03:37.836 "uuid": "2ccf139e-1847-4852-92e8-ac398ca705a9", 00:03:37.836 "assigned_rate_limits": { 00:03:37.836 "rw_ios_per_sec": 0, 00:03:37.836 "rw_mbytes_per_sec": 0, 00:03:37.836 "r_mbytes_per_sec": 0, 00:03:37.836 "w_mbytes_per_sec": 0 00:03:37.836 }, 00:03:37.836 "claimed": false, 00:03:37.836 "zoned": false, 00:03:37.836 "supported_io_types": { 00:03:37.836 "read": true, 00:03:37.836 "write": true, 00:03:37.836 "unmap": true, 00:03:37.836 "write_zeroes": true, 00:03:37.836 "flush": true, 00:03:37.836 "reset": true, 00:03:37.836 "compare": false, 00:03:37.836 "compare_and_write": false, 00:03:37.836 "abort": true, 00:03:37.836 "nvme_admin": false, 00:03:37.836 "nvme_io": false 00:03:37.836 }, 00:03:37.836 "memory_domains": [ 00:03:37.836 { 00:03:37.836 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:37.836 "dma_device_type": 2 00:03:37.836 } 00:03:37.836 ], 00:03:37.836 "driver_specific": {} 00:03:37.836 } 00:03:37.836 ]' 00:03:37.836 11:27:57 -- rpc/rpc.sh@17 -- # jq length 00:03:37.836 11:27:57 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:03:37.837 11:27:57 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:03:37.837 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.837 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.837 [2024-11-28 11:27:57.822533] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:03:37.837 [2024-11-28 11:27:57.822607] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:03:37.837 [2024-11-28 11:27:57.822630] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x15f3590 00:03:37.837 [2024-11-28 11:27:57.822644] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:03:37.837 [2024-11-28 11:27:57.823997] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:03:37.837 [2024-11-28 11:27:57.824026] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:03:37.837 Passthru0 00:03:37.837 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.837 11:27:57 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:03:37.837 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.837 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.837 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.837 11:27:57 -- rpc/rpc.sh@20 -- # bdevs='[ 00:03:37.837 { 00:03:37.837 "name": "Malloc2", 00:03:37.837 "aliases": [ 00:03:37.837 "2ccf139e-1847-4852-92e8-ac398ca705a9" 00:03:37.837 ], 00:03:37.837 "product_name": "Malloc disk", 00:03:37.837 "block_size": 512, 00:03:37.837 "num_blocks": 16384, 00:03:37.837 "uuid": "2ccf139e-1847-4852-92e8-ac398ca705a9", 00:03:37.837 "assigned_rate_limits": { 00:03:37.837 "rw_ios_per_sec": 0, 00:03:37.837 "rw_mbytes_per_sec": 0, 00:03:37.837 "r_mbytes_per_sec": 0, 00:03:37.837 "w_mbytes_per_sec": 0 00:03:37.837 }, 00:03:37.837 "claimed": true, 00:03:37.837 "claim_type": "exclusive_write", 00:03:37.837 "zoned": false, 00:03:37.837 "supported_io_types": { 00:03:37.837 "read": true, 00:03:37.837 "write": true, 00:03:37.837 "unmap": true, 00:03:37.837 "write_zeroes": true, 00:03:37.837 "flush": true, 00:03:37.837 "reset": true, 00:03:37.837 "compare": false, 00:03:37.837 "compare_and_write": false, 00:03:37.837 "abort": true, 00:03:37.837 "nvme_admin": false, 00:03:37.837 "nvme_io": false 00:03:37.837 }, 00:03:37.837 "memory_domains": [ 00:03:37.837 { 00:03:37.837 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:37.837 "dma_device_type": 2 00:03:37.837 } 00:03:37.837 ], 00:03:37.837 "driver_specific": {} 00:03:37.837 }, 00:03:37.837 { 00:03:37.837 "name": "Passthru0", 00:03:37.837 "aliases": [ 00:03:37.837 "49f6c943-69cb-5a49-a991-c8607f66580b" 00:03:37.837 ], 00:03:37.837 "product_name": "passthru", 00:03:37.837 "block_size": 512, 00:03:37.837 "num_blocks": 16384, 00:03:37.837 "uuid": "49f6c943-69cb-5a49-a991-c8607f66580b", 00:03:37.837 "assigned_rate_limits": { 00:03:37.837 "rw_ios_per_sec": 0, 00:03:37.837 "rw_mbytes_per_sec": 0, 00:03:37.837 "r_mbytes_per_sec": 0, 00:03:37.837 "w_mbytes_per_sec": 0 00:03:37.837 }, 00:03:37.837 "claimed": false, 00:03:37.837 "zoned": false, 00:03:37.837 "supported_io_types": { 00:03:37.837 "read": true, 00:03:37.837 "write": true, 00:03:37.837 "unmap": true, 00:03:37.837 "write_zeroes": true, 00:03:37.837 "flush": true, 00:03:37.837 "reset": true, 00:03:37.837 "compare": false, 00:03:37.837 "compare_and_write": false, 00:03:37.837 "abort": true, 00:03:37.837 "nvme_admin": false, 00:03:37.837 "nvme_io": false 00:03:37.837 }, 00:03:37.837 "memory_domains": [ 00:03:37.837 { 00:03:37.837 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:37.837 "dma_device_type": 2 00:03:37.837 } 00:03:37.837 ], 00:03:37.837 "driver_specific": { 00:03:37.837 "passthru": { 00:03:37.837 "name": "Passthru0", 00:03:37.837 "base_bdev_name": "Malloc2" 00:03:37.837 } 00:03:37.837 } 00:03:37.837 } 00:03:37.837 ]' 00:03:37.837 11:27:57 -- rpc/rpc.sh@21 -- # jq length 00:03:37.837 11:27:57 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:03:37.837 11:27:57 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:03:37.837 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.837 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:37.837 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:37.837 11:27:57 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:03:37.837 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:37.837 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:38.095 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.095 11:27:57 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:03:38.096 11:27:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:38.096 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:38.096 11:27:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.096 11:27:57 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:03:38.096 11:27:57 -- rpc/rpc.sh@26 -- # jq length 00:03:38.096 11:27:57 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:03:38.096 00:03:38.096 real 0m0.227s 00:03:38.096 user 0m0.155s 00:03:38.096 sys 0m0.014s 00:03:38.096 11:27:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:38.096 11:27:57 -- common/autotest_common.sh@10 -- # set +x 00:03:38.096 ************************************ 00:03:38.096 END TEST rpc_daemon_integrity 00:03:38.096 ************************************ 00:03:38.096 11:27:57 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:03:38.096 11:27:57 -- rpc/rpc.sh@84 -- # killprocess 3681471 00:03:38.096 11:27:57 -- common/autotest_common.sh@936 -- # '[' -z 3681471 ']' 00:03:38.096 11:27:57 -- common/autotest_common.sh@940 -- # kill -0 3681471 00:03:38.096 11:27:57 -- common/autotest_common.sh@941 -- # uname 00:03:38.096 11:27:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:38.096 11:27:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3681471 00:03:38.096 11:27:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:38.096 11:27:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:38.096 11:27:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3681471' 00:03:38.096 killing process with pid 3681471 00:03:38.096 11:27:58 -- common/autotest_common.sh@955 -- # kill 3681471 00:03:38.096 11:27:58 -- common/autotest_common.sh@960 -- # wait 3681471 00:03:38.662 00:03:38.662 real 0m2.496s 00:03:38.662 user 0m3.152s 00:03:38.662 sys 0m0.583s 00:03:38.662 11:27:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:38.662 11:27:58 -- common/autotest_common.sh@10 -- # set +x 00:03:38.662 ************************************ 00:03:38.662 END TEST rpc 00:03:38.662 ************************************ 00:03:38.662 11:27:58 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:03:38.662 11:27:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:38.662 11:27:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:38.662 11:27:58 -- common/autotest_common.sh@10 -- # set +x 00:03:38.662 ************************************ 00:03:38.662 START TEST rpc_client 00:03:38.662 ************************************ 00:03:38.662 11:27:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:03:38.662 * Looking for test storage... 00:03:38.662 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:03:38.662 11:27:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:38.662 11:27:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:38.662 11:27:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:38.662 11:27:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:38.662 11:27:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:38.662 11:27:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:38.662 11:27:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:38.662 11:27:58 -- scripts/common.sh@335 -- # IFS=.-: 00:03:38.662 11:27:58 -- scripts/common.sh@335 -- # read -ra ver1 00:03:38.662 11:27:58 -- scripts/common.sh@336 -- # IFS=.-: 00:03:38.662 11:27:58 -- scripts/common.sh@336 -- # read -ra ver2 00:03:38.662 11:27:58 -- scripts/common.sh@337 -- # local 'op=<' 00:03:38.662 11:27:58 -- scripts/common.sh@339 -- # ver1_l=2 00:03:38.662 11:27:58 -- scripts/common.sh@340 -- # ver2_l=1 00:03:38.662 11:27:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:38.662 11:27:58 -- scripts/common.sh@343 -- # case "$op" in 00:03:38.662 11:27:58 -- scripts/common.sh@344 -- # : 1 00:03:38.662 11:27:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:38.662 11:27:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:38.662 11:27:58 -- scripts/common.sh@364 -- # decimal 1 00:03:38.662 11:27:58 -- scripts/common.sh@352 -- # local d=1 00:03:38.662 11:27:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:38.662 11:27:58 -- scripts/common.sh@354 -- # echo 1 00:03:38.662 11:27:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:38.662 11:27:58 -- scripts/common.sh@365 -- # decimal 2 00:03:38.662 11:27:58 -- scripts/common.sh@352 -- # local d=2 00:03:38.662 11:27:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:38.662 11:27:58 -- scripts/common.sh@354 -- # echo 2 00:03:38.662 11:27:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:38.662 11:27:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:38.662 11:27:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:38.662 11:27:58 -- scripts/common.sh@367 -- # return 0 00:03:38.662 11:27:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:38.662 11:27:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:38.662 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.662 --rc genhtml_branch_coverage=1 00:03:38.662 --rc genhtml_function_coverage=1 00:03:38.662 --rc genhtml_legend=1 00:03:38.662 --rc geninfo_all_blocks=1 00:03:38.662 --rc geninfo_unexecuted_blocks=1 00:03:38.662 00:03:38.662 ' 00:03:38.662 11:27:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:38.662 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.662 --rc genhtml_branch_coverage=1 00:03:38.662 --rc genhtml_function_coverage=1 00:03:38.662 --rc genhtml_legend=1 00:03:38.662 --rc geninfo_all_blocks=1 00:03:38.662 --rc geninfo_unexecuted_blocks=1 00:03:38.662 00:03:38.662 ' 00:03:38.662 11:27:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:38.662 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.662 --rc genhtml_branch_coverage=1 00:03:38.662 --rc genhtml_function_coverage=1 00:03:38.662 --rc genhtml_legend=1 00:03:38.662 --rc geninfo_all_blocks=1 00:03:38.662 --rc geninfo_unexecuted_blocks=1 00:03:38.662 00:03:38.662 ' 00:03:38.662 11:27:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:38.662 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.662 --rc genhtml_branch_coverage=1 00:03:38.662 --rc genhtml_function_coverage=1 00:03:38.662 --rc genhtml_legend=1 00:03:38.662 --rc geninfo_all_blocks=1 00:03:38.662 --rc geninfo_unexecuted_blocks=1 00:03:38.662 00:03:38.662 ' 00:03:38.662 11:27:58 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:03:38.662 OK 00:03:38.662 11:27:58 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:03:38.662 00:03:38.662 real 0m0.153s 00:03:38.662 user 0m0.099s 00:03:38.662 sys 0m0.062s 00:03:38.662 11:27:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:38.662 11:27:58 -- common/autotest_common.sh@10 -- # set +x 00:03:38.662 ************************************ 00:03:38.662 END TEST rpc_client 00:03:38.662 ************************************ 00:03:38.662 11:27:58 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:03:38.662 11:27:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:38.662 11:27:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:38.663 11:27:58 -- common/autotest_common.sh@10 -- # set +x 00:03:38.663 ************************************ 00:03:38.663 START TEST json_config 00:03:38.663 ************************************ 00:03:38.663 11:27:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:03:38.663 11:27:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:38.663 11:27:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:38.663 11:27:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:38.922 11:27:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:38.922 11:27:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:38.922 11:27:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:38.922 11:27:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:38.922 11:27:58 -- scripts/common.sh@335 -- # IFS=.-: 00:03:38.922 11:27:58 -- scripts/common.sh@335 -- # read -ra ver1 00:03:38.922 11:27:58 -- scripts/common.sh@336 -- # IFS=.-: 00:03:38.922 11:27:58 -- scripts/common.sh@336 -- # read -ra ver2 00:03:38.922 11:27:58 -- scripts/common.sh@337 -- # local 'op=<' 00:03:38.922 11:27:58 -- scripts/common.sh@339 -- # ver1_l=2 00:03:38.922 11:27:58 -- scripts/common.sh@340 -- # ver2_l=1 00:03:38.922 11:27:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:38.922 11:27:58 -- scripts/common.sh@343 -- # case "$op" in 00:03:38.922 11:27:58 -- scripts/common.sh@344 -- # : 1 00:03:38.922 11:27:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:38.922 11:27:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:38.922 11:27:58 -- scripts/common.sh@364 -- # decimal 1 00:03:38.922 11:27:58 -- scripts/common.sh@352 -- # local d=1 00:03:38.922 11:27:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:38.922 11:27:58 -- scripts/common.sh@354 -- # echo 1 00:03:38.922 11:27:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:38.922 11:27:58 -- scripts/common.sh@365 -- # decimal 2 00:03:38.922 11:27:58 -- scripts/common.sh@352 -- # local d=2 00:03:38.922 11:27:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:38.922 11:27:58 -- scripts/common.sh@354 -- # echo 2 00:03:38.922 11:27:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:38.922 11:27:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:38.922 11:27:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:38.922 11:27:58 -- scripts/common.sh@367 -- # return 0 00:03:38.922 11:27:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:38.922 11:27:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:38.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.922 --rc genhtml_branch_coverage=1 00:03:38.922 --rc genhtml_function_coverage=1 00:03:38.922 --rc genhtml_legend=1 00:03:38.922 --rc geninfo_all_blocks=1 00:03:38.922 --rc geninfo_unexecuted_blocks=1 00:03:38.922 00:03:38.922 ' 00:03:38.922 11:27:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:38.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.922 --rc genhtml_branch_coverage=1 00:03:38.922 --rc genhtml_function_coverage=1 00:03:38.922 --rc genhtml_legend=1 00:03:38.922 --rc geninfo_all_blocks=1 00:03:38.922 --rc geninfo_unexecuted_blocks=1 00:03:38.922 00:03:38.922 ' 00:03:38.922 11:27:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:38.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.922 --rc genhtml_branch_coverage=1 00:03:38.922 --rc genhtml_function_coverage=1 00:03:38.922 --rc genhtml_legend=1 00:03:38.922 --rc geninfo_all_blocks=1 00:03:38.922 --rc geninfo_unexecuted_blocks=1 00:03:38.922 00:03:38.922 ' 00:03:38.922 11:27:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:38.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.922 --rc genhtml_branch_coverage=1 00:03:38.922 --rc genhtml_function_coverage=1 00:03:38.922 --rc genhtml_legend=1 00:03:38.922 --rc geninfo_all_blocks=1 00:03:38.922 --rc geninfo_unexecuted_blocks=1 00:03:38.922 00:03:38.922 ' 00:03:38.922 11:27:58 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:38.922 11:27:58 -- nvmf/common.sh@7 -- # uname -s 00:03:38.922 11:27:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:38.922 11:27:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:38.922 11:27:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:38.922 11:27:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:38.922 11:27:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:38.922 11:27:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:38.922 11:27:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:38.922 11:27:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:38.922 11:27:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:38.922 11:27:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:38.922 11:27:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:38.922 11:27:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:38.922 11:27:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:38.922 11:27:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:38.922 11:27:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:03:38.922 11:27:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:38.922 11:27:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:38.922 11:27:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:38.922 11:27:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:38.922 11:27:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:38.922 11:27:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:38.922 11:27:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:38.922 11:27:58 -- paths/export.sh@5 -- # export PATH 00:03:38.922 11:27:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:38.922 11:27:58 -- nvmf/common.sh@46 -- # : 0 00:03:38.922 11:27:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:38.922 11:27:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:38.922 11:27:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:38.923 11:27:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:38.923 11:27:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:38.923 11:27:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:38.923 11:27:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:38.923 11:27:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:38.923 11:27:58 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:03:38.923 11:27:58 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:03:38.923 11:27:58 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:03:38.923 11:27:58 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:03:38.923 11:27:58 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:03:38.923 11:27:58 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:03:38.923 11:27:58 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:03:38.923 11:27:58 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:03:38.923 11:27:58 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:03:38.923 11:27:58 -- json_config/json_config.sh@32 -- # declare -A app_params 00:03:38.923 11:27:58 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:03:38.923 11:27:58 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:03:38.923 11:27:58 -- json_config/json_config.sh@43 -- # last_event_id=0 00:03:38.923 11:27:58 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:03:38.923 11:27:58 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:03:38.923 INFO: JSON configuration test init 00:03:38.923 11:27:58 -- json_config/json_config.sh@420 -- # json_config_test_init 00:03:38.923 11:27:58 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:03:38.923 11:27:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:38.923 11:27:58 -- common/autotest_common.sh@10 -- # set +x 00:03:38.923 11:27:58 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:03:38.923 11:27:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:38.923 11:27:58 -- common/autotest_common.sh@10 -- # set +x 00:03:38.923 11:27:58 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:03:38.923 11:27:58 -- json_config/json_config.sh@98 -- # local app=target 00:03:38.923 11:27:58 -- json_config/json_config.sh@99 -- # shift 00:03:38.923 11:27:58 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:03:38.923 11:27:58 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:03:38.923 11:27:58 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:03:38.923 11:27:58 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:38.923 11:27:58 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:38.923 11:27:58 -- json_config/json_config.sh@111 -- # app_pid[$app]=3681970 00:03:38.923 11:27:58 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:03:38.923 11:27:58 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:03:38.923 Waiting for target to run... 00:03:38.923 11:27:58 -- json_config/json_config.sh@114 -- # waitforlisten 3681970 /var/tmp/spdk_tgt.sock 00:03:38.923 11:27:58 -- common/autotest_common.sh@829 -- # '[' -z 3681970 ']' 00:03:38.923 11:27:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:38.923 11:27:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:38.923 11:27:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:38.923 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:38.923 11:27:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:38.923 11:27:58 -- common/autotest_common.sh@10 -- # set +x 00:03:38.923 [2024-11-28 11:27:58.854161] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:38.923 [2024-11-28 11:27:58.854237] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3681970 ] 00:03:38.923 EAL: No free 2048 kB hugepages reported on node 1 00:03:39.181 [2024-11-28 11:27:59.200176] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:39.439 [2024-11-28 11:27:59.287824] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:39.439 [2024-11-28 11:27:59.288015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:40.005 11:27:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:40.005 11:27:59 -- common/autotest_common.sh@862 -- # return 0 00:03:40.005 11:27:59 -- json_config/json_config.sh@115 -- # echo '' 00:03:40.005 00:03:40.005 11:27:59 -- json_config/json_config.sh@322 -- # create_accel_config 00:03:40.005 11:27:59 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:03:40.005 11:27:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:40.005 11:27:59 -- common/autotest_common.sh@10 -- # set +x 00:03:40.005 11:27:59 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:03:40.005 11:27:59 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:03:40.005 11:27:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:40.005 11:27:59 -- common/autotest_common.sh@10 -- # set +x 00:03:40.005 11:27:59 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:03:40.005 11:27:59 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:03:40.005 11:27:59 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:03:43.286 11:28:03 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:03:43.286 11:28:03 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:03:43.286 11:28:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:43.286 11:28:03 -- common/autotest_common.sh@10 -- # set +x 00:03:43.286 11:28:03 -- json_config/json_config.sh@48 -- # local ret=0 00:03:43.286 11:28:03 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:03:43.286 11:28:03 -- json_config/json_config.sh@49 -- # local enabled_types 00:03:43.286 11:28:03 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:03:43.286 11:28:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:03:43.286 11:28:03 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:03:43.286 11:28:03 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:03:43.286 11:28:03 -- json_config/json_config.sh@51 -- # local get_types 00:03:43.286 11:28:03 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:03:43.286 11:28:03 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:03:43.286 11:28:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:43.286 11:28:03 -- common/autotest_common.sh@10 -- # set +x 00:03:43.544 11:28:03 -- json_config/json_config.sh@58 -- # return 0 00:03:43.544 11:28:03 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:03:43.544 11:28:03 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:03:43.544 11:28:03 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:03:43.544 11:28:03 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:03:43.544 11:28:03 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:03:43.544 11:28:03 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:03:43.544 11:28:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:43.544 11:28:03 -- common/autotest_common.sh@10 -- # set +x 00:03:43.544 11:28:03 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:03:43.544 11:28:03 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:03:43.544 11:28:03 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:03:43.544 11:28:03 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:03:43.544 11:28:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:03:43.544 MallocForNvmf0 00:03:43.801 11:28:03 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:03:43.801 11:28:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:03:43.801 MallocForNvmf1 00:03:43.801 11:28:03 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:03:43.801 11:28:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:03:44.059 [2024-11-28 11:28:04.076311] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:03:44.059 11:28:04 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:03:44.059 11:28:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:03:44.317 11:28:04 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:03:44.317 11:28:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:03:44.574 11:28:04 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:03:44.575 11:28:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:03:44.832 11:28:04 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:03:44.832 11:28:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:03:45.090 [2024-11-28 11:28:05.067682] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:03:45.090 11:28:05 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:03:45.090 11:28:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:45.090 11:28:05 -- common/autotest_common.sh@10 -- # set +x 00:03:45.090 11:28:05 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:03:45.090 11:28:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:45.090 11:28:05 -- common/autotest_common.sh@10 -- # set +x 00:03:45.090 11:28:05 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:03:45.090 11:28:05 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:03:45.090 11:28:05 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:03:45.347 MallocBdevForConfigChangeCheck 00:03:45.347 11:28:05 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:03:45.347 11:28:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:45.347 11:28:05 -- common/autotest_common.sh@10 -- # set +x 00:03:45.605 11:28:05 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:03:45.605 11:28:05 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:45.863 11:28:05 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:03:45.863 INFO: shutting down applications... 00:03:45.863 11:28:05 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:03:45.863 11:28:05 -- json_config/json_config.sh@431 -- # json_config_clear target 00:03:45.863 11:28:05 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:03:45.863 11:28:05 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:03:47.763 Calling clear_iscsi_subsystem 00:03:47.763 Calling clear_nvmf_subsystem 00:03:47.763 Calling clear_nbd_subsystem 00:03:47.763 Calling clear_ublk_subsystem 00:03:47.763 Calling clear_vhost_blk_subsystem 00:03:47.763 Calling clear_vhost_scsi_subsystem 00:03:47.763 Calling clear_scheduler_subsystem 00:03:47.763 Calling clear_bdev_subsystem 00:03:47.763 Calling clear_accel_subsystem 00:03:47.763 Calling clear_vmd_subsystem 00:03:47.763 Calling clear_sock_subsystem 00:03:47.763 Calling clear_iobuf_subsystem 00:03:47.763 11:28:07 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:03:47.763 11:28:07 -- json_config/json_config.sh@396 -- # count=100 00:03:47.763 11:28:07 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:03:47.763 11:28:07 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:47.763 11:28:07 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:03:47.763 11:28:07 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:03:47.763 11:28:07 -- json_config/json_config.sh@398 -- # break 00:03:47.763 11:28:07 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:03:47.763 11:28:07 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:03:47.763 11:28:07 -- json_config/json_config.sh@120 -- # local app=target 00:03:47.763 11:28:07 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:03:47.763 11:28:07 -- json_config/json_config.sh@124 -- # [[ -n 3681970 ]] 00:03:47.763 11:28:07 -- json_config/json_config.sh@127 -- # kill -SIGINT 3681970 00:03:47.763 11:28:07 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:03:47.763 11:28:07 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:03:47.763 11:28:07 -- json_config/json_config.sh@130 -- # kill -0 3681970 00:03:47.763 11:28:07 -- json_config/json_config.sh@134 -- # sleep 0.5 00:03:48.331 11:28:08 -- json_config/json_config.sh@129 -- # (( i++ )) 00:03:48.331 11:28:08 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:03:48.331 11:28:08 -- json_config/json_config.sh@130 -- # kill -0 3681970 00:03:48.331 11:28:08 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:03:48.331 11:28:08 -- json_config/json_config.sh@132 -- # break 00:03:48.331 11:28:08 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:03:48.331 11:28:08 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:03:48.331 SPDK target shutdown done 00:03:48.331 11:28:08 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:03:48.331 INFO: relaunching applications... 00:03:48.331 11:28:08 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:48.331 11:28:08 -- json_config/json_config.sh@98 -- # local app=target 00:03:48.331 11:28:08 -- json_config/json_config.sh@99 -- # shift 00:03:48.331 11:28:08 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:03:48.331 11:28:08 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:03:48.331 11:28:08 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:03:48.331 11:28:08 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:48.331 11:28:08 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:48.331 11:28:08 -- json_config/json_config.sh@111 -- # app_pid[$app]=3683317 00:03:48.332 11:28:08 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:48.332 11:28:08 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:03:48.332 Waiting for target to run... 00:03:48.332 11:28:08 -- json_config/json_config.sh@114 -- # waitforlisten 3683317 /var/tmp/spdk_tgt.sock 00:03:48.332 11:28:08 -- common/autotest_common.sh@829 -- # '[' -z 3683317 ']' 00:03:48.332 11:28:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:48.332 11:28:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:48.332 11:28:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:48.332 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:48.332 11:28:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:48.332 11:28:08 -- common/autotest_common.sh@10 -- # set +x 00:03:48.332 [2024-11-28 11:28:08.292843] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:48.332 [2024-11-28 11:28:08.292929] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3683317 ] 00:03:48.332 EAL: No free 2048 kB hugepages reported on node 1 00:03:48.900 [2024-11-28 11:28:08.657013] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:48.900 [2024-11-28 11:28:08.743381] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:48.900 [2024-11-28 11:28:08.743572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:52.185 [2024-11-28 11:28:11.777391] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:03:52.185 [2024-11-28 11:28:11.809919] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:03:52.185 11:28:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:52.185 11:28:12 -- common/autotest_common.sh@862 -- # return 0 00:03:52.185 11:28:12 -- json_config/json_config.sh@115 -- # echo '' 00:03:52.185 00:03:52.185 11:28:12 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:03:52.185 11:28:12 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:03:52.185 INFO: Checking if target configuration is the same... 00:03:52.185 11:28:12 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:52.185 11:28:12 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:03:52.185 11:28:12 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:52.185 + '[' 2 -ne 2 ']' 00:03:52.185 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:03:52.185 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:03:52.185 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:52.185 +++ basename /dev/fd/62 00:03:52.185 ++ mktemp /tmp/62.XXX 00:03:52.185 + tmp_file_1=/tmp/62.62l 00:03:52.185 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:52.185 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:03:52.185 + tmp_file_2=/tmp/spdk_tgt_config.json.XWv 00:03:52.185 + ret=0 00:03:52.185 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:52.750 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:52.750 + diff -u /tmp/62.62l /tmp/spdk_tgt_config.json.XWv 00:03:52.750 + echo 'INFO: JSON config files are the same' 00:03:52.750 INFO: JSON config files are the same 00:03:52.750 + rm /tmp/62.62l /tmp/spdk_tgt_config.json.XWv 00:03:52.750 + exit 0 00:03:52.750 11:28:12 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:03:52.750 11:28:12 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:03:52.750 INFO: changing configuration and checking if this can be detected... 00:03:52.750 11:28:12 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:03:52.750 11:28:12 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:03:53.007 11:28:12 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:53.007 11:28:12 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:03:53.007 11:28:12 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:53.007 + '[' 2 -ne 2 ']' 00:03:53.008 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:03:53.008 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:03:53.008 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:53.008 +++ basename /dev/fd/62 00:03:53.008 ++ mktemp /tmp/62.XXX 00:03:53.008 + tmp_file_1=/tmp/62.h1F 00:03:53.008 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:53.008 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:03:53.008 + tmp_file_2=/tmp/spdk_tgt_config.json.ExL 00:03:53.008 + ret=0 00:03:53.008 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:53.265 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:53.265 + diff -u /tmp/62.h1F /tmp/spdk_tgt_config.json.ExL 00:03:53.265 + ret=1 00:03:53.265 + echo '=== Start of file: /tmp/62.h1F ===' 00:03:53.265 + cat /tmp/62.h1F 00:03:53.265 + echo '=== End of file: /tmp/62.h1F ===' 00:03:53.265 + echo '' 00:03:53.265 + echo '=== Start of file: /tmp/spdk_tgt_config.json.ExL ===' 00:03:53.265 + cat /tmp/spdk_tgt_config.json.ExL 00:03:53.265 + echo '=== End of file: /tmp/spdk_tgt_config.json.ExL ===' 00:03:53.265 + echo '' 00:03:53.265 + rm /tmp/62.h1F /tmp/spdk_tgt_config.json.ExL 00:03:53.265 + exit 1 00:03:53.265 11:28:13 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:03:53.265 INFO: configuration change detected. 00:03:53.265 11:28:13 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:03:53.265 11:28:13 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:03:53.265 11:28:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:53.265 11:28:13 -- common/autotest_common.sh@10 -- # set +x 00:03:53.265 11:28:13 -- json_config/json_config.sh@360 -- # local ret=0 00:03:53.265 11:28:13 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:03:53.265 11:28:13 -- json_config/json_config.sh@370 -- # [[ -n 3683317 ]] 00:03:53.265 11:28:13 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:03:53.265 11:28:13 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:03:53.265 11:28:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:53.265 11:28:13 -- common/autotest_common.sh@10 -- # set +x 00:03:53.265 11:28:13 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:03:53.265 11:28:13 -- json_config/json_config.sh@246 -- # uname -s 00:03:53.265 11:28:13 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:03:53.265 11:28:13 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:03:53.265 11:28:13 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:03:53.265 11:28:13 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:03:53.265 11:28:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:53.265 11:28:13 -- common/autotest_common.sh@10 -- # set +x 00:03:53.265 11:28:13 -- json_config/json_config.sh@376 -- # killprocess 3683317 00:03:53.265 11:28:13 -- common/autotest_common.sh@936 -- # '[' -z 3683317 ']' 00:03:53.265 11:28:13 -- common/autotest_common.sh@940 -- # kill -0 3683317 00:03:53.265 11:28:13 -- common/autotest_common.sh@941 -- # uname 00:03:53.265 11:28:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:53.265 11:28:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3683317 00:03:53.523 11:28:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:53.523 11:28:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:53.523 11:28:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3683317' 00:03:53.523 killing process with pid 3683317 00:03:53.523 11:28:13 -- common/autotest_common.sh@955 -- # kill 3683317 00:03:53.523 11:28:13 -- common/autotest_common.sh@960 -- # wait 3683317 00:03:55.444 11:28:14 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:55.444 11:28:14 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:03:55.444 11:28:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:55.444 11:28:14 -- common/autotest_common.sh@10 -- # set +x 00:03:55.444 11:28:14 -- json_config/json_config.sh@381 -- # return 0 00:03:55.444 11:28:14 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:03:55.444 INFO: Success 00:03:55.444 00:03:55.444 real 0m16.334s 00:03:55.444 user 0m19.003s 00:03:55.444 sys 0m1.946s 00:03:55.444 11:28:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:55.444 11:28:14 -- common/autotest_common.sh@10 -- # set +x 00:03:55.444 ************************************ 00:03:55.444 END TEST json_config 00:03:55.444 ************************************ 00:03:55.444 11:28:15 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:03:55.444 11:28:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:55.444 11:28:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:55.444 11:28:15 -- common/autotest_common.sh@10 -- # set +x 00:03:55.444 ************************************ 00:03:55.444 START TEST json_config_extra_key 00:03:55.444 ************************************ 00:03:55.444 11:28:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:03:55.444 11:28:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:55.444 11:28:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:55.444 11:28:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:55.444 11:28:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:55.444 11:28:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:55.444 11:28:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:55.444 11:28:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:55.444 11:28:15 -- scripts/common.sh@335 -- # IFS=.-: 00:03:55.444 11:28:15 -- scripts/common.sh@335 -- # read -ra ver1 00:03:55.444 11:28:15 -- scripts/common.sh@336 -- # IFS=.-: 00:03:55.444 11:28:15 -- scripts/common.sh@336 -- # read -ra ver2 00:03:55.444 11:28:15 -- scripts/common.sh@337 -- # local 'op=<' 00:03:55.444 11:28:15 -- scripts/common.sh@339 -- # ver1_l=2 00:03:55.444 11:28:15 -- scripts/common.sh@340 -- # ver2_l=1 00:03:55.444 11:28:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:55.444 11:28:15 -- scripts/common.sh@343 -- # case "$op" in 00:03:55.444 11:28:15 -- scripts/common.sh@344 -- # : 1 00:03:55.444 11:28:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:55.444 11:28:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:55.444 11:28:15 -- scripts/common.sh@364 -- # decimal 1 00:03:55.444 11:28:15 -- scripts/common.sh@352 -- # local d=1 00:03:55.444 11:28:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:55.444 11:28:15 -- scripts/common.sh@354 -- # echo 1 00:03:55.444 11:28:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:55.444 11:28:15 -- scripts/common.sh@365 -- # decimal 2 00:03:55.444 11:28:15 -- scripts/common.sh@352 -- # local d=2 00:03:55.444 11:28:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:55.444 11:28:15 -- scripts/common.sh@354 -- # echo 2 00:03:55.444 11:28:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:55.444 11:28:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:55.444 11:28:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:55.444 11:28:15 -- scripts/common.sh@367 -- # return 0 00:03:55.444 11:28:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:55.444 11:28:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:55.444 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:55.444 --rc genhtml_branch_coverage=1 00:03:55.444 --rc genhtml_function_coverage=1 00:03:55.444 --rc genhtml_legend=1 00:03:55.444 --rc geninfo_all_blocks=1 00:03:55.444 --rc geninfo_unexecuted_blocks=1 00:03:55.444 00:03:55.444 ' 00:03:55.444 11:28:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:55.444 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:55.444 --rc genhtml_branch_coverage=1 00:03:55.444 --rc genhtml_function_coverage=1 00:03:55.444 --rc genhtml_legend=1 00:03:55.444 --rc geninfo_all_blocks=1 00:03:55.444 --rc geninfo_unexecuted_blocks=1 00:03:55.444 00:03:55.444 ' 00:03:55.444 11:28:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:55.444 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:55.444 --rc genhtml_branch_coverage=1 00:03:55.444 --rc genhtml_function_coverage=1 00:03:55.444 --rc genhtml_legend=1 00:03:55.444 --rc geninfo_all_blocks=1 00:03:55.444 --rc geninfo_unexecuted_blocks=1 00:03:55.444 00:03:55.444 ' 00:03:55.444 11:28:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:55.444 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:55.444 --rc genhtml_branch_coverage=1 00:03:55.444 --rc genhtml_function_coverage=1 00:03:55.444 --rc genhtml_legend=1 00:03:55.444 --rc geninfo_all_blocks=1 00:03:55.444 --rc geninfo_unexecuted_blocks=1 00:03:55.444 00:03:55.444 ' 00:03:55.444 11:28:15 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:55.444 11:28:15 -- nvmf/common.sh@7 -- # uname -s 00:03:55.444 11:28:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:55.444 11:28:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:55.444 11:28:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:55.444 11:28:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:55.444 11:28:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:55.444 11:28:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:55.444 11:28:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:55.444 11:28:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:55.444 11:28:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:55.444 11:28:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:55.444 11:28:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:55.444 11:28:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:55.444 11:28:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:55.444 11:28:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:55.444 11:28:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:03:55.444 11:28:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:55.444 11:28:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:55.444 11:28:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:55.444 11:28:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:55.444 11:28:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:55.444 11:28:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:55.444 11:28:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:55.444 11:28:15 -- paths/export.sh@5 -- # export PATH 00:03:55.444 11:28:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:55.444 11:28:15 -- nvmf/common.sh@46 -- # : 0 00:03:55.444 11:28:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:55.444 11:28:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:55.444 11:28:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:55.444 11:28:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:55.444 11:28:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:55.444 11:28:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:55.444 11:28:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:55.444 11:28:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:55.444 11:28:15 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:03:55.444 11:28:15 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:03:55.444 11:28:15 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:03:55.444 11:28:15 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:03:55.444 11:28:15 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:03:55.444 11:28:15 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:03:55.444 11:28:15 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:03:55.444 11:28:15 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:03:55.444 11:28:15 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:03:55.444 11:28:15 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:03:55.444 INFO: launching applications... 00:03:55.444 11:28:15 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:03:55.445 11:28:15 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:03:55.445 11:28:15 -- json_config/json_config_extra_key.sh@25 -- # shift 00:03:55.445 11:28:15 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:03:55.445 11:28:15 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:03:55.445 11:28:15 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=3684268 00:03:55.445 11:28:15 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:03:55.445 11:28:15 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:03:55.445 Waiting for target to run... 00:03:55.445 11:28:15 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 3684268 /var/tmp/spdk_tgt.sock 00:03:55.445 11:28:15 -- common/autotest_common.sh@829 -- # '[' -z 3684268 ']' 00:03:55.445 11:28:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:55.445 11:28:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:55.445 11:28:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:55.445 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:55.445 11:28:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:55.445 11:28:15 -- common/autotest_common.sh@10 -- # set +x 00:03:55.445 [2024-11-28 11:28:15.202876] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:55.445 [2024-11-28 11:28:15.202969] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3684268 ] 00:03:55.445 EAL: No free 2048 kB hugepages reported on node 1 00:03:55.716 [2024-11-28 11:28:15.693891] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:55.978 [2024-11-28 11:28:15.798661] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:55.978 [2024-11-28 11:28:15.798848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:56.236 11:28:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:56.236 11:28:16 -- common/autotest_common.sh@862 -- # return 0 00:03:56.236 11:28:16 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:03:56.236 00:03:56.236 11:28:16 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:03:56.236 INFO: shutting down applications... 00:03:56.236 11:28:16 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:03:56.236 11:28:16 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:03:56.236 11:28:16 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:03:56.236 11:28:16 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 3684268 ]] 00:03:56.236 11:28:16 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 3684268 00:03:56.236 11:28:16 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:03:56.236 11:28:16 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:03:56.236 11:28:16 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3684268 00:03:56.236 11:28:16 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:03:56.803 11:28:16 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:03:56.803 11:28:16 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:03:56.803 11:28:16 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3684268 00:03:56.803 11:28:16 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:03:57.369 11:28:17 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:03:57.369 11:28:17 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:03:57.369 11:28:17 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3684268 00:03:57.369 11:28:17 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:03:57.369 11:28:17 -- json_config/json_config_extra_key.sh@52 -- # break 00:03:57.369 11:28:17 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:03:57.369 11:28:17 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:03:57.369 SPDK target shutdown done 00:03:57.369 11:28:17 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:03:57.369 Success 00:03:57.369 00:03:57.369 real 0m2.149s 00:03:57.369 user 0m1.512s 00:03:57.369 sys 0m0.617s 00:03:57.369 11:28:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:57.369 11:28:17 -- common/autotest_common.sh@10 -- # set +x 00:03:57.369 ************************************ 00:03:57.369 END TEST json_config_extra_key 00:03:57.369 ************************************ 00:03:57.369 11:28:17 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:03:57.369 11:28:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:57.369 11:28:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:57.369 11:28:17 -- common/autotest_common.sh@10 -- # set +x 00:03:57.369 ************************************ 00:03:57.369 START TEST alias_rpc 00:03:57.369 ************************************ 00:03:57.369 11:28:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:03:57.369 * Looking for test storage... 00:03:57.369 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:03:57.369 11:28:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:57.369 11:28:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:57.369 11:28:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:57.369 11:28:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:57.369 11:28:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:57.369 11:28:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:57.369 11:28:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:57.369 11:28:17 -- scripts/common.sh@335 -- # IFS=.-: 00:03:57.369 11:28:17 -- scripts/common.sh@335 -- # read -ra ver1 00:03:57.369 11:28:17 -- scripts/common.sh@336 -- # IFS=.-: 00:03:57.369 11:28:17 -- scripts/common.sh@336 -- # read -ra ver2 00:03:57.369 11:28:17 -- scripts/common.sh@337 -- # local 'op=<' 00:03:57.369 11:28:17 -- scripts/common.sh@339 -- # ver1_l=2 00:03:57.369 11:28:17 -- scripts/common.sh@340 -- # ver2_l=1 00:03:57.369 11:28:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:57.369 11:28:17 -- scripts/common.sh@343 -- # case "$op" in 00:03:57.369 11:28:17 -- scripts/common.sh@344 -- # : 1 00:03:57.369 11:28:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:57.369 11:28:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:57.369 11:28:17 -- scripts/common.sh@364 -- # decimal 1 00:03:57.369 11:28:17 -- scripts/common.sh@352 -- # local d=1 00:03:57.369 11:28:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:57.369 11:28:17 -- scripts/common.sh@354 -- # echo 1 00:03:57.369 11:28:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:57.369 11:28:17 -- scripts/common.sh@365 -- # decimal 2 00:03:57.369 11:28:17 -- scripts/common.sh@352 -- # local d=2 00:03:57.369 11:28:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:57.369 11:28:17 -- scripts/common.sh@354 -- # echo 2 00:03:57.369 11:28:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:57.369 11:28:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:57.369 11:28:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:57.369 11:28:17 -- scripts/common.sh@367 -- # return 0 00:03:57.369 11:28:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:57.369 11:28:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:57.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:57.369 --rc genhtml_branch_coverage=1 00:03:57.369 --rc genhtml_function_coverage=1 00:03:57.369 --rc genhtml_legend=1 00:03:57.369 --rc geninfo_all_blocks=1 00:03:57.369 --rc geninfo_unexecuted_blocks=1 00:03:57.369 00:03:57.369 ' 00:03:57.369 11:28:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:57.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:57.369 --rc genhtml_branch_coverage=1 00:03:57.369 --rc genhtml_function_coverage=1 00:03:57.369 --rc genhtml_legend=1 00:03:57.369 --rc geninfo_all_blocks=1 00:03:57.369 --rc geninfo_unexecuted_blocks=1 00:03:57.369 00:03:57.369 ' 00:03:57.369 11:28:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:57.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:57.369 --rc genhtml_branch_coverage=1 00:03:57.369 --rc genhtml_function_coverage=1 00:03:57.369 --rc genhtml_legend=1 00:03:57.369 --rc geninfo_all_blocks=1 00:03:57.369 --rc geninfo_unexecuted_blocks=1 00:03:57.369 00:03:57.369 ' 00:03:57.369 11:28:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:57.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:57.369 --rc genhtml_branch_coverage=1 00:03:57.369 --rc genhtml_function_coverage=1 00:03:57.369 --rc genhtml_legend=1 00:03:57.369 --rc geninfo_all_blocks=1 00:03:57.369 --rc geninfo_unexecuted_blocks=1 00:03:57.369 00:03:57.369 ' 00:03:57.369 11:28:17 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:03:57.369 11:28:17 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3684600 00:03:57.369 11:28:17 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:57.369 11:28:17 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3684600 00:03:57.369 11:28:17 -- common/autotest_common.sh@829 -- # '[' -z 3684600 ']' 00:03:57.369 11:28:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:57.369 11:28:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:57.369 11:28:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:57.369 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:57.369 11:28:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:57.369 11:28:17 -- common/autotest_common.sh@10 -- # set +x 00:03:57.369 [2024-11-28 11:28:17.380085] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:57.369 [2024-11-28 11:28:17.380175] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3684600 ] 00:03:57.369 EAL: No free 2048 kB hugepages reported on node 1 00:03:57.628 [2024-11-28 11:28:17.438285] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:57.628 [2024-11-28 11:28:17.544590] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:57.628 [2024-11-28 11:28:17.544773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:58.563 11:28:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:58.563 11:28:18 -- common/autotest_common.sh@862 -- # return 0 00:03:58.563 11:28:18 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:03:58.821 11:28:18 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3684600 00:03:58.822 11:28:18 -- common/autotest_common.sh@936 -- # '[' -z 3684600 ']' 00:03:58.822 11:28:18 -- common/autotest_common.sh@940 -- # kill -0 3684600 00:03:58.822 11:28:18 -- common/autotest_common.sh@941 -- # uname 00:03:58.822 11:28:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:58.822 11:28:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3684600 00:03:58.822 11:28:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:58.822 11:28:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:58.822 11:28:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3684600' 00:03:58.822 killing process with pid 3684600 00:03:58.822 11:28:18 -- common/autotest_common.sh@955 -- # kill 3684600 00:03:58.822 11:28:18 -- common/autotest_common.sh@960 -- # wait 3684600 00:03:59.389 00:03:59.389 real 0m1.950s 00:03:59.389 user 0m2.269s 00:03:59.389 sys 0m0.469s 00:03:59.389 11:28:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:59.389 11:28:19 -- common/autotest_common.sh@10 -- # set +x 00:03:59.389 ************************************ 00:03:59.389 END TEST alias_rpc 00:03:59.389 ************************************ 00:03:59.389 11:28:19 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:03:59.389 11:28:19 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:03:59.389 11:28:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:59.389 11:28:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:59.389 11:28:19 -- common/autotest_common.sh@10 -- # set +x 00:03:59.389 ************************************ 00:03:59.389 START TEST spdkcli_tcp 00:03:59.389 ************************************ 00:03:59.389 11:28:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:03:59.389 * Looking for test storage... 00:03:59.389 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:03:59.389 11:28:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:59.389 11:28:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:59.389 11:28:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:59.389 11:28:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:59.389 11:28:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:59.389 11:28:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:59.389 11:28:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:59.389 11:28:19 -- scripts/common.sh@335 -- # IFS=.-: 00:03:59.389 11:28:19 -- scripts/common.sh@335 -- # read -ra ver1 00:03:59.389 11:28:19 -- scripts/common.sh@336 -- # IFS=.-: 00:03:59.389 11:28:19 -- scripts/common.sh@336 -- # read -ra ver2 00:03:59.389 11:28:19 -- scripts/common.sh@337 -- # local 'op=<' 00:03:59.389 11:28:19 -- scripts/common.sh@339 -- # ver1_l=2 00:03:59.389 11:28:19 -- scripts/common.sh@340 -- # ver2_l=1 00:03:59.389 11:28:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:59.389 11:28:19 -- scripts/common.sh@343 -- # case "$op" in 00:03:59.389 11:28:19 -- scripts/common.sh@344 -- # : 1 00:03:59.389 11:28:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:59.389 11:28:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:59.389 11:28:19 -- scripts/common.sh@364 -- # decimal 1 00:03:59.389 11:28:19 -- scripts/common.sh@352 -- # local d=1 00:03:59.389 11:28:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:59.389 11:28:19 -- scripts/common.sh@354 -- # echo 1 00:03:59.389 11:28:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:59.389 11:28:19 -- scripts/common.sh@365 -- # decimal 2 00:03:59.389 11:28:19 -- scripts/common.sh@352 -- # local d=2 00:03:59.389 11:28:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:59.389 11:28:19 -- scripts/common.sh@354 -- # echo 2 00:03:59.389 11:28:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:59.389 11:28:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:59.389 11:28:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:59.389 11:28:19 -- scripts/common.sh@367 -- # return 0 00:03:59.389 11:28:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:59.389 11:28:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:59.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.389 --rc genhtml_branch_coverage=1 00:03:59.389 --rc genhtml_function_coverage=1 00:03:59.389 --rc genhtml_legend=1 00:03:59.389 --rc geninfo_all_blocks=1 00:03:59.389 --rc geninfo_unexecuted_blocks=1 00:03:59.389 00:03:59.389 ' 00:03:59.389 11:28:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:59.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.389 --rc genhtml_branch_coverage=1 00:03:59.389 --rc genhtml_function_coverage=1 00:03:59.389 --rc genhtml_legend=1 00:03:59.389 --rc geninfo_all_blocks=1 00:03:59.389 --rc geninfo_unexecuted_blocks=1 00:03:59.389 00:03:59.389 ' 00:03:59.389 11:28:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:59.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.389 --rc genhtml_branch_coverage=1 00:03:59.389 --rc genhtml_function_coverage=1 00:03:59.389 --rc genhtml_legend=1 00:03:59.389 --rc geninfo_all_blocks=1 00:03:59.389 --rc geninfo_unexecuted_blocks=1 00:03:59.389 00:03:59.389 ' 00:03:59.389 11:28:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:59.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.389 --rc genhtml_branch_coverage=1 00:03:59.389 --rc genhtml_function_coverage=1 00:03:59.389 --rc genhtml_legend=1 00:03:59.389 --rc geninfo_all_blocks=1 00:03:59.389 --rc geninfo_unexecuted_blocks=1 00:03:59.389 00:03:59.389 ' 00:03:59.389 11:28:19 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:03:59.389 11:28:19 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:03:59.389 11:28:19 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:03:59.389 11:28:19 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:03:59.389 11:28:19 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:03:59.389 11:28:19 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:03:59.389 11:28:19 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:03:59.389 11:28:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:59.389 11:28:19 -- common/autotest_common.sh@10 -- # set +x 00:03:59.389 11:28:19 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3684925 00:03:59.389 11:28:19 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:03:59.389 11:28:19 -- spdkcli/tcp.sh@27 -- # waitforlisten 3684925 00:03:59.389 11:28:19 -- common/autotest_common.sh@829 -- # '[' -z 3684925 ']' 00:03:59.389 11:28:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:59.389 11:28:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:59.389 11:28:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:59.389 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:59.389 11:28:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:59.389 11:28:19 -- common/autotest_common.sh@10 -- # set +x 00:03:59.389 [2024-11-28 11:28:19.357924] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:59.389 [2024-11-28 11:28:19.358013] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3684925 ] 00:03:59.389 EAL: No free 2048 kB hugepages reported on node 1 00:03:59.389 [2024-11-28 11:28:19.414838] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:03:59.647 [2024-11-28 11:28:19.527595] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:59.648 [2024-11-28 11:28:19.527834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:03:59.648 [2024-11-28 11:28:19.527840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:00.582 11:28:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:00.582 11:28:20 -- common/autotest_common.sh@862 -- # return 0 00:04:00.582 11:28:20 -- spdkcli/tcp.sh@31 -- # socat_pid=3684948 00:04:00.582 11:28:20 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:00.582 11:28:20 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:00.582 [ 00:04:00.582 "bdev_malloc_delete", 00:04:00.582 "bdev_malloc_create", 00:04:00.582 "bdev_null_resize", 00:04:00.582 "bdev_null_delete", 00:04:00.582 "bdev_null_create", 00:04:00.582 "bdev_nvme_cuse_unregister", 00:04:00.582 "bdev_nvme_cuse_register", 00:04:00.582 "bdev_opal_new_user", 00:04:00.582 "bdev_opal_set_lock_state", 00:04:00.582 "bdev_opal_delete", 00:04:00.582 "bdev_opal_get_info", 00:04:00.582 "bdev_opal_create", 00:04:00.582 "bdev_nvme_opal_revert", 00:04:00.582 "bdev_nvme_opal_init", 00:04:00.582 "bdev_nvme_send_cmd", 00:04:00.582 "bdev_nvme_get_path_iostat", 00:04:00.582 "bdev_nvme_get_mdns_discovery_info", 00:04:00.582 "bdev_nvme_stop_mdns_discovery", 00:04:00.583 "bdev_nvme_start_mdns_discovery", 00:04:00.583 "bdev_nvme_set_multipath_policy", 00:04:00.583 "bdev_nvme_set_preferred_path", 00:04:00.583 "bdev_nvme_get_io_paths", 00:04:00.583 "bdev_nvme_remove_error_injection", 00:04:00.583 "bdev_nvme_add_error_injection", 00:04:00.583 "bdev_nvme_get_discovery_info", 00:04:00.583 "bdev_nvme_stop_discovery", 00:04:00.583 "bdev_nvme_start_discovery", 00:04:00.583 "bdev_nvme_get_controller_health_info", 00:04:00.583 "bdev_nvme_disable_controller", 00:04:00.583 "bdev_nvme_enable_controller", 00:04:00.583 "bdev_nvme_reset_controller", 00:04:00.583 "bdev_nvme_get_transport_statistics", 00:04:00.583 "bdev_nvme_apply_firmware", 00:04:00.583 "bdev_nvme_detach_controller", 00:04:00.583 "bdev_nvme_get_controllers", 00:04:00.583 "bdev_nvme_attach_controller", 00:04:00.583 "bdev_nvme_set_hotplug", 00:04:00.583 "bdev_nvme_set_options", 00:04:00.583 "bdev_passthru_delete", 00:04:00.583 "bdev_passthru_create", 00:04:00.583 "bdev_lvol_grow_lvstore", 00:04:00.583 "bdev_lvol_get_lvols", 00:04:00.583 "bdev_lvol_get_lvstores", 00:04:00.583 "bdev_lvol_delete", 00:04:00.583 "bdev_lvol_set_read_only", 00:04:00.583 "bdev_lvol_resize", 00:04:00.583 "bdev_lvol_decouple_parent", 00:04:00.583 "bdev_lvol_inflate", 00:04:00.583 "bdev_lvol_rename", 00:04:00.583 "bdev_lvol_clone_bdev", 00:04:00.583 "bdev_lvol_clone", 00:04:00.583 "bdev_lvol_snapshot", 00:04:00.583 "bdev_lvol_create", 00:04:00.583 "bdev_lvol_delete_lvstore", 00:04:00.583 "bdev_lvol_rename_lvstore", 00:04:00.583 "bdev_lvol_create_lvstore", 00:04:00.583 "bdev_raid_set_options", 00:04:00.583 "bdev_raid_remove_base_bdev", 00:04:00.583 "bdev_raid_add_base_bdev", 00:04:00.583 "bdev_raid_delete", 00:04:00.583 "bdev_raid_create", 00:04:00.583 "bdev_raid_get_bdevs", 00:04:00.583 "bdev_error_inject_error", 00:04:00.583 "bdev_error_delete", 00:04:00.583 "bdev_error_create", 00:04:00.583 "bdev_split_delete", 00:04:00.583 "bdev_split_create", 00:04:00.583 "bdev_delay_delete", 00:04:00.583 "bdev_delay_create", 00:04:00.583 "bdev_delay_update_latency", 00:04:00.583 "bdev_zone_block_delete", 00:04:00.583 "bdev_zone_block_create", 00:04:00.583 "blobfs_create", 00:04:00.583 "blobfs_detect", 00:04:00.583 "blobfs_set_cache_size", 00:04:00.583 "bdev_aio_delete", 00:04:00.583 "bdev_aio_rescan", 00:04:00.583 "bdev_aio_create", 00:04:00.583 "bdev_ftl_set_property", 00:04:00.583 "bdev_ftl_get_properties", 00:04:00.583 "bdev_ftl_get_stats", 00:04:00.583 "bdev_ftl_unmap", 00:04:00.583 "bdev_ftl_unload", 00:04:00.583 "bdev_ftl_delete", 00:04:00.583 "bdev_ftl_load", 00:04:00.583 "bdev_ftl_create", 00:04:00.583 "bdev_virtio_attach_controller", 00:04:00.583 "bdev_virtio_scsi_get_devices", 00:04:00.583 "bdev_virtio_detach_controller", 00:04:00.583 "bdev_virtio_blk_set_hotplug", 00:04:00.583 "bdev_iscsi_delete", 00:04:00.583 "bdev_iscsi_create", 00:04:00.583 "bdev_iscsi_set_options", 00:04:00.583 "accel_error_inject_error", 00:04:00.583 "ioat_scan_accel_module", 00:04:00.583 "dsa_scan_accel_module", 00:04:00.583 "iaa_scan_accel_module", 00:04:00.583 "iscsi_set_options", 00:04:00.583 "iscsi_get_auth_groups", 00:04:00.583 "iscsi_auth_group_remove_secret", 00:04:00.583 "iscsi_auth_group_add_secret", 00:04:00.583 "iscsi_delete_auth_group", 00:04:00.583 "iscsi_create_auth_group", 00:04:00.583 "iscsi_set_discovery_auth", 00:04:00.583 "iscsi_get_options", 00:04:00.583 "iscsi_target_node_request_logout", 00:04:00.583 "iscsi_target_node_set_redirect", 00:04:00.583 "iscsi_target_node_set_auth", 00:04:00.583 "iscsi_target_node_add_lun", 00:04:00.583 "iscsi_get_connections", 00:04:00.583 "iscsi_portal_group_set_auth", 00:04:00.583 "iscsi_start_portal_group", 00:04:00.583 "iscsi_delete_portal_group", 00:04:00.583 "iscsi_create_portal_group", 00:04:00.583 "iscsi_get_portal_groups", 00:04:00.583 "iscsi_delete_target_node", 00:04:00.583 "iscsi_target_node_remove_pg_ig_maps", 00:04:00.583 "iscsi_target_node_add_pg_ig_maps", 00:04:00.583 "iscsi_create_target_node", 00:04:00.583 "iscsi_get_target_nodes", 00:04:00.583 "iscsi_delete_initiator_group", 00:04:00.583 "iscsi_initiator_group_remove_initiators", 00:04:00.583 "iscsi_initiator_group_add_initiators", 00:04:00.583 "iscsi_create_initiator_group", 00:04:00.583 "iscsi_get_initiator_groups", 00:04:00.583 "nvmf_set_crdt", 00:04:00.583 "nvmf_set_config", 00:04:00.583 "nvmf_set_max_subsystems", 00:04:00.583 "nvmf_subsystem_get_listeners", 00:04:00.583 "nvmf_subsystem_get_qpairs", 00:04:00.583 "nvmf_subsystem_get_controllers", 00:04:00.583 "nvmf_get_stats", 00:04:00.583 "nvmf_get_transports", 00:04:00.583 "nvmf_create_transport", 00:04:00.583 "nvmf_get_targets", 00:04:00.583 "nvmf_delete_target", 00:04:00.583 "nvmf_create_target", 00:04:00.583 "nvmf_subsystem_allow_any_host", 00:04:00.583 "nvmf_subsystem_remove_host", 00:04:00.583 "nvmf_subsystem_add_host", 00:04:00.583 "nvmf_subsystem_remove_ns", 00:04:00.583 "nvmf_subsystem_add_ns", 00:04:00.583 "nvmf_subsystem_listener_set_ana_state", 00:04:00.583 "nvmf_discovery_get_referrals", 00:04:00.583 "nvmf_discovery_remove_referral", 00:04:00.583 "nvmf_discovery_add_referral", 00:04:00.583 "nvmf_subsystem_remove_listener", 00:04:00.583 "nvmf_subsystem_add_listener", 00:04:00.583 "nvmf_delete_subsystem", 00:04:00.583 "nvmf_create_subsystem", 00:04:00.583 "nvmf_get_subsystems", 00:04:00.583 "env_dpdk_get_mem_stats", 00:04:00.583 "nbd_get_disks", 00:04:00.583 "nbd_stop_disk", 00:04:00.583 "nbd_start_disk", 00:04:00.583 "ublk_recover_disk", 00:04:00.583 "ublk_get_disks", 00:04:00.583 "ublk_stop_disk", 00:04:00.583 "ublk_start_disk", 00:04:00.583 "ublk_destroy_target", 00:04:00.583 "ublk_create_target", 00:04:00.583 "virtio_blk_create_transport", 00:04:00.583 "virtio_blk_get_transports", 00:04:00.583 "vhost_controller_set_coalescing", 00:04:00.583 "vhost_get_controllers", 00:04:00.583 "vhost_delete_controller", 00:04:00.583 "vhost_create_blk_controller", 00:04:00.583 "vhost_scsi_controller_remove_target", 00:04:00.583 "vhost_scsi_controller_add_target", 00:04:00.583 "vhost_start_scsi_controller", 00:04:00.583 "vhost_create_scsi_controller", 00:04:00.583 "thread_set_cpumask", 00:04:00.583 "framework_get_scheduler", 00:04:00.583 "framework_set_scheduler", 00:04:00.583 "framework_get_reactors", 00:04:00.583 "thread_get_io_channels", 00:04:00.583 "thread_get_pollers", 00:04:00.583 "thread_get_stats", 00:04:00.583 "framework_monitor_context_switch", 00:04:00.583 "spdk_kill_instance", 00:04:00.583 "log_enable_timestamps", 00:04:00.583 "log_get_flags", 00:04:00.583 "log_clear_flag", 00:04:00.583 "log_set_flag", 00:04:00.583 "log_get_level", 00:04:00.583 "log_set_level", 00:04:00.583 "log_get_print_level", 00:04:00.583 "log_set_print_level", 00:04:00.583 "framework_enable_cpumask_locks", 00:04:00.583 "framework_disable_cpumask_locks", 00:04:00.583 "framework_wait_init", 00:04:00.583 "framework_start_init", 00:04:00.583 "scsi_get_devices", 00:04:00.583 "bdev_get_histogram", 00:04:00.583 "bdev_enable_histogram", 00:04:00.583 "bdev_set_qos_limit", 00:04:00.583 "bdev_set_qd_sampling_period", 00:04:00.583 "bdev_get_bdevs", 00:04:00.583 "bdev_reset_iostat", 00:04:00.583 "bdev_get_iostat", 00:04:00.583 "bdev_examine", 00:04:00.583 "bdev_wait_for_examine", 00:04:00.583 "bdev_set_options", 00:04:00.583 "notify_get_notifications", 00:04:00.583 "notify_get_types", 00:04:00.583 "accel_get_stats", 00:04:00.583 "accel_set_options", 00:04:00.583 "accel_set_driver", 00:04:00.583 "accel_crypto_key_destroy", 00:04:00.583 "accel_crypto_keys_get", 00:04:00.583 "accel_crypto_key_create", 00:04:00.583 "accel_assign_opc", 00:04:00.583 "accel_get_module_info", 00:04:00.583 "accel_get_opc_assignments", 00:04:00.583 "vmd_rescan", 00:04:00.583 "vmd_remove_device", 00:04:00.583 "vmd_enable", 00:04:00.583 "sock_set_default_impl", 00:04:00.583 "sock_impl_set_options", 00:04:00.583 "sock_impl_get_options", 00:04:00.583 "iobuf_get_stats", 00:04:00.583 "iobuf_set_options", 00:04:00.583 "framework_get_pci_devices", 00:04:00.583 "framework_get_config", 00:04:00.583 "framework_get_subsystems", 00:04:00.583 "trace_get_info", 00:04:00.583 "trace_get_tpoint_group_mask", 00:04:00.583 "trace_disable_tpoint_group", 00:04:00.583 "trace_enable_tpoint_group", 00:04:00.583 "trace_clear_tpoint_mask", 00:04:00.583 "trace_set_tpoint_mask", 00:04:00.583 "spdk_get_version", 00:04:00.583 "rpc_get_methods" 00:04:00.583 ] 00:04:00.583 11:28:20 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:00.583 11:28:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:00.583 11:28:20 -- common/autotest_common.sh@10 -- # set +x 00:04:00.583 11:28:20 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:00.583 11:28:20 -- spdkcli/tcp.sh@38 -- # killprocess 3684925 00:04:00.583 11:28:20 -- common/autotest_common.sh@936 -- # '[' -z 3684925 ']' 00:04:00.583 11:28:20 -- common/autotest_common.sh@940 -- # kill -0 3684925 00:04:00.583 11:28:20 -- common/autotest_common.sh@941 -- # uname 00:04:00.583 11:28:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:00.583 11:28:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3684925 00:04:00.840 11:28:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:00.840 11:28:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:00.840 11:28:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3684925' 00:04:00.840 killing process with pid 3684925 00:04:00.840 11:28:20 -- common/autotest_common.sh@955 -- # kill 3684925 00:04:00.840 11:28:20 -- common/autotest_common.sh@960 -- # wait 3684925 00:04:01.098 00:04:01.098 real 0m1.945s 00:04:01.098 user 0m3.689s 00:04:01.098 sys 0m0.528s 00:04:01.098 11:28:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:01.098 11:28:21 -- common/autotest_common.sh@10 -- # set +x 00:04:01.098 ************************************ 00:04:01.098 END TEST spdkcli_tcp 00:04:01.098 ************************************ 00:04:01.098 11:28:21 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:01.098 11:28:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:01.098 11:28:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:01.098 11:28:21 -- common/autotest_common.sh@10 -- # set +x 00:04:01.098 ************************************ 00:04:01.098 START TEST dpdk_mem_utility 00:04:01.098 ************************************ 00:04:01.098 11:28:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:01.356 * Looking for test storage... 00:04:01.356 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:01.356 11:28:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:01.356 11:28:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:01.356 11:28:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:01.356 11:28:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:01.356 11:28:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:01.356 11:28:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:01.356 11:28:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:01.356 11:28:21 -- scripts/common.sh@335 -- # IFS=.-: 00:04:01.356 11:28:21 -- scripts/common.sh@335 -- # read -ra ver1 00:04:01.356 11:28:21 -- scripts/common.sh@336 -- # IFS=.-: 00:04:01.356 11:28:21 -- scripts/common.sh@336 -- # read -ra ver2 00:04:01.356 11:28:21 -- scripts/common.sh@337 -- # local 'op=<' 00:04:01.356 11:28:21 -- scripts/common.sh@339 -- # ver1_l=2 00:04:01.356 11:28:21 -- scripts/common.sh@340 -- # ver2_l=1 00:04:01.356 11:28:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:01.356 11:28:21 -- scripts/common.sh@343 -- # case "$op" in 00:04:01.356 11:28:21 -- scripts/common.sh@344 -- # : 1 00:04:01.356 11:28:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:01.356 11:28:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:01.356 11:28:21 -- scripts/common.sh@364 -- # decimal 1 00:04:01.356 11:28:21 -- scripts/common.sh@352 -- # local d=1 00:04:01.356 11:28:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:01.356 11:28:21 -- scripts/common.sh@354 -- # echo 1 00:04:01.356 11:28:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:01.356 11:28:21 -- scripts/common.sh@365 -- # decimal 2 00:04:01.356 11:28:21 -- scripts/common.sh@352 -- # local d=2 00:04:01.356 11:28:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:01.356 11:28:21 -- scripts/common.sh@354 -- # echo 2 00:04:01.356 11:28:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:01.356 11:28:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:01.356 11:28:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:01.356 11:28:21 -- scripts/common.sh@367 -- # return 0 00:04:01.356 11:28:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:01.356 11:28:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:01.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:01.356 --rc genhtml_branch_coverage=1 00:04:01.356 --rc genhtml_function_coverage=1 00:04:01.356 --rc genhtml_legend=1 00:04:01.356 --rc geninfo_all_blocks=1 00:04:01.356 --rc geninfo_unexecuted_blocks=1 00:04:01.356 00:04:01.356 ' 00:04:01.356 11:28:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:01.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:01.356 --rc genhtml_branch_coverage=1 00:04:01.356 --rc genhtml_function_coverage=1 00:04:01.356 --rc genhtml_legend=1 00:04:01.356 --rc geninfo_all_blocks=1 00:04:01.356 --rc geninfo_unexecuted_blocks=1 00:04:01.356 00:04:01.356 ' 00:04:01.356 11:28:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:01.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:01.356 --rc genhtml_branch_coverage=1 00:04:01.356 --rc genhtml_function_coverage=1 00:04:01.356 --rc genhtml_legend=1 00:04:01.356 --rc geninfo_all_blocks=1 00:04:01.356 --rc geninfo_unexecuted_blocks=1 00:04:01.356 00:04:01.356 ' 00:04:01.356 11:28:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:01.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:01.356 --rc genhtml_branch_coverage=1 00:04:01.356 --rc genhtml_function_coverage=1 00:04:01.356 --rc genhtml_legend=1 00:04:01.356 --rc geninfo_all_blocks=1 00:04:01.356 --rc geninfo_unexecuted_blocks=1 00:04:01.356 00:04:01.356 ' 00:04:01.356 11:28:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:01.356 11:28:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3685150 00:04:01.356 11:28:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:01.356 11:28:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3685150 00:04:01.356 11:28:21 -- common/autotest_common.sh@829 -- # '[' -z 3685150 ']' 00:04:01.356 11:28:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:01.356 11:28:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:01.356 11:28:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:01.356 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:01.356 11:28:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:01.356 11:28:21 -- common/autotest_common.sh@10 -- # set +x 00:04:01.356 [2024-11-28 11:28:21.329518] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:01.356 [2024-11-28 11:28:21.329610] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3685150 ] 00:04:01.356 EAL: No free 2048 kB hugepages reported on node 1 00:04:01.356 [2024-11-28 11:28:21.385548] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:01.615 [2024-11-28 11:28:21.503010] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:01.615 [2024-11-28 11:28:21.503183] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:02.549 11:28:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:02.549 11:28:22 -- common/autotest_common.sh@862 -- # return 0 00:04:02.549 11:28:22 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:02.549 11:28:22 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:02.549 11:28:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:02.549 11:28:22 -- common/autotest_common.sh@10 -- # set +x 00:04:02.549 { 00:04:02.549 "filename": "/tmp/spdk_mem_dump.txt" 00:04:02.549 } 00:04:02.549 11:28:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:02.549 11:28:22 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:02.549 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:02.549 1 heaps totaling size 814.000000 MiB 00:04:02.549 size: 814.000000 MiB heap id: 0 00:04:02.549 end heaps---------- 00:04:02.549 8 mempools totaling size 598.116089 MiB 00:04:02.549 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:02.549 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:02.549 size: 84.521057 MiB name: bdev_io_3685150 00:04:02.549 size: 51.011292 MiB name: evtpool_3685150 00:04:02.549 size: 50.003479 MiB name: msgpool_3685150 00:04:02.549 size: 21.763794 MiB name: PDU_Pool 00:04:02.549 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:02.549 size: 0.026123 MiB name: Session_Pool 00:04:02.549 end mempools------- 00:04:02.549 6 memzones totaling size 4.142822 MiB 00:04:02.549 size: 1.000366 MiB name: RG_ring_0_3685150 00:04:02.549 size: 1.000366 MiB name: RG_ring_1_3685150 00:04:02.549 size: 1.000366 MiB name: RG_ring_4_3685150 00:04:02.549 size: 1.000366 MiB name: RG_ring_5_3685150 00:04:02.549 size: 0.125366 MiB name: RG_ring_2_3685150 00:04:02.549 size: 0.015991 MiB name: RG_ring_3_3685150 00:04:02.549 end memzones------- 00:04:02.549 11:28:22 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:02.549 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:02.549 list of free elements. size: 12.519348 MiB 00:04:02.549 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:02.549 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:02.549 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:02.549 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:02.550 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:02.550 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:02.550 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:02.550 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:02.550 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:02.550 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:02.550 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:02.550 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:02.550 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:02.550 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:02.550 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:02.550 list of standard malloc elements. size: 199.218079 MiB 00:04:02.550 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:02.550 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:02.550 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:02.550 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:02.550 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:02.550 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:02.550 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:02.550 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:02.550 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:02.550 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:02.550 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:02.550 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:02.550 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:02.550 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:02.550 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:02.550 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:02.550 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:02.550 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:02.550 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:02.550 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:02.550 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:02.550 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:02.550 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:02.550 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:02.550 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:02.550 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:02.550 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:02.550 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:02.550 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:02.550 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:02.550 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:02.550 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:02.550 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:02.550 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:02.550 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:02.550 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:02.550 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:02.550 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:02.550 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:02.550 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:02.550 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:02.550 list of memzone associated elements. size: 602.262573 MiB 00:04:02.550 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:02.550 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:02.550 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:02.550 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:02.550 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:02.550 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3685150_0 00:04:02.550 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:02.550 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3685150_0 00:04:02.550 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:02.550 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3685150_0 00:04:02.550 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:02.550 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:02.550 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:02.550 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:02.550 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:02.550 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3685150 00:04:02.550 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:02.550 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3685150 00:04:02.550 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:02.550 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3685150 00:04:02.550 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:02.550 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:02.550 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:02.550 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:02.550 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:02.550 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:02.550 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:02.550 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:02.550 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:02.550 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3685150 00:04:02.550 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:02.550 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3685150 00:04:02.550 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:02.550 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3685150 00:04:02.550 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:02.550 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3685150 00:04:02.550 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:02.550 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3685150 00:04:02.550 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:02.550 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:02.550 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:02.550 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:02.550 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:02.550 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:02.550 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:02.550 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3685150 00:04:02.550 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:02.550 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:02.550 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:02.550 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:02.550 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:02.550 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3685150 00:04:02.550 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:02.550 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:02.550 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:02.550 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3685150 00:04:02.550 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:02.550 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3685150 00:04:02.550 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:02.550 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:02.550 11:28:22 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:02.550 11:28:22 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3685150 00:04:02.550 11:28:22 -- common/autotest_common.sh@936 -- # '[' -z 3685150 ']' 00:04:02.550 11:28:22 -- common/autotest_common.sh@940 -- # kill -0 3685150 00:04:02.550 11:28:22 -- common/autotest_common.sh@941 -- # uname 00:04:02.550 11:28:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:02.550 11:28:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3685150 00:04:02.550 11:28:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:02.550 11:28:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:02.550 11:28:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3685150' 00:04:02.550 killing process with pid 3685150 00:04:02.550 11:28:22 -- common/autotest_common.sh@955 -- # kill 3685150 00:04:02.550 11:28:22 -- common/autotest_common.sh@960 -- # wait 3685150 00:04:03.116 00:04:03.116 real 0m1.738s 00:04:03.116 user 0m1.911s 00:04:03.116 sys 0m0.452s 00:04:03.116 11:28:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:03.116 11:28:22 -- common/autotest_common.sh@10 -- # set +x 00:04:03.116 ************************************ 00:04:03.116 END TEST dpdk_mem_utility 00:04:03.116 ************************************ 00:04:03.116 11:28:22 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:03.116 11:28:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:03.116 11:28:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.116 11:28:22 -- common/autotest_common.sh@10 -- # set +x 00:04:03.116 ************************************ 00:04:03.116 START TEST event 00:04:03.116 ************************************ 00:04:03.116 11:28:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:03.116 * Looking for test storage... 00:04:03.116 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:03.116 11:28:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:03.116 11:28:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:03.116 11:28:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:03.116 11:28:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:03.116 11:28:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:03.116 11:28:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:03.116 11:28:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:03.116 11:28:23 -- scripts/common.sh@335 -- # IFS=.-: 00:04:03.116 11:28:23 -- scripts/common.sh@335 -- # read -ra ver1 00:04:03.116 11:28:23 -- scripts/common.sh@336 -- # IFS=.-: 00:04:03.116 11:28:23 -- scripts/common.sh@336 -- # read -ra ver2 00:04:03.116 11:28:23 -- scripts/common.sh@337 -- # local 'op=<' 00:04:03.116 11:28:23 -- scripts/common.sh@339 -- # ver1_l=2 00:04:03.116 11:28:23 -- scripts/common.sh@340 -- # ver2_l=1 00:04:03.116 11:28:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:03.116 11:28:23 -- scripts/common.sh@343 -- # case "$op" in 00:04:03.116 11:28:23 -- scripts/common.sh@344 -- # : 1 00:04:03.116 11:28:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:03.116 11:28:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:03.117 11:28:23 -- scripts/common.sh@364 -- # decimal 1 00:04:03.117 11:28:23 -- scripts/common.sh@352 -- # local d=1 00:04:03.117 11:28:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:03.117 11:28:23 -- scripts/common.sh@354 -- # echo 1 00:04:03.117 11:28:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:03.117 11:28:23 -- scripts/common.sh@365 -- # decimal 2 00:04:03.117 11:28:23 -- scripts/common.sh@352 -- # local d=2 00:04:03.117 11:28:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:03.117 11:28:23 -- scripts/common.sh@354 -- # echo 2 00:04:03.117 11:28:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:03.117 11:28:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:03.117 11:28:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:03.117 11:28:23 -- scripts/common.sh@367 -- # return 0 00:04:03.117 11:28:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:03.117 11:28:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:03.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.117 --rc genhtml_branch_coverage=1 00:04:03.117 --rc genhtml_function_coverage=1 00:04:03.117 --rc genhtml_legend=1 00:04:03.117 --rc geninfo_all_blocks=1 00:04:03.117 --rc geninfo_unexecuted_blocks=1 00:04:03.117 00:04:03.117 ' 00:04:03.117 11:28:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:03.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.117 --rc genhtml_branch_coverage=1 00:04:03.117 --rc genhtml_function_coverage=1 00:04:03.117 --rc genhtml_legend=1 00:04:03.117 --rc geninfo_all_blocks=1 00:04:03.117 --rc geninfo_unexecuted_blocks=1 00:04:03.117 00:04:03.117 ' 00:04:03.117 11:28:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:03.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.117 --rc genhtml_branch_coverage=1 00:04:03.117 --rc genhtml_function_coverage=1 00:04:03.117 --rc genhtml_legend=1 00:04:03.117 --rc geninfo_all_blocks=1 00:04:03.117 --rc geninfo_unexecuted_blocks=1 00:04:03.117 00:04:03.117 ' 00:04:03.117 11:28:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:03.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.117 --rc genhtml_branch_coverage=1 00:04:03.117 --rc genhtml_function_coverage=1 00:04:03.117 --rc genhtml_legend=1 00:04:03.117 --rc geninfo_all_blocks=1 00:04:03.117 --rc geninfo_unexecuted_blocks=1 00:04:03.117 00:04:03.117 ' 00:04:03.117 11:28:23 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:03.117 11:28:23 -- bdev/nbd_common.sh@6 -- # set -e 00:04:03.117 11:28:23 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:03.117 11:28:23 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:03.117 11:28:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.117 11:28:23 -- common/autotest_common.sh@10 -- # set +x 00:04:03.117 ************************************ 00:04:03.117 START TEST event_perf 00:04:03.117 ************************************ 00:04:03.117 11:28:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:03.117 Running I/O for 1 seconds...[2024-11-28 11:28:23.067763] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:03.117 [2024-11-28 11:28:23.067869] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3685476 ] 00:04:03.117 EAL: No free 2048 kB hugepages reported on node 1 00:04:03.117 [2024-11-28 11:28:23.129400] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:03.375 [2024-11-28 11:28:23.248705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:03.375 [2024-11-28 11:28:23.248760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:03.375 [2024-11-28 11:28:23.248874] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:03.375 [2024-11-28 11:28:23.248877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:04.748 Running I/O for 1 seconds... 00:04:04.748 lcore 0: 229043 00:04:04.748 lcore 1: 229042 00:04:04.748 lcore 2: 229042 00:04:04.748 lcore 3: 229042 00:04:04.748 done. 00:04:04.748 00:04:04.748 real 0m1.322s 00:04:04.748 user 0m4.226s 00:04:04.748 sys 0m0.090s 00:04:04.748 11:28:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:04.748 11:28:24 -- common/autotest_common.sh@10 -- # set +x 00:04:04.748 ************************************ 00:04:04.748 END TEST event_perf 00:04:04.748 ************************************ 00:04:04.748 11:28:24 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:04.748 11:28:24 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:04.748 11:28:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.748 11:28:24 -- common/autotest_common.sh@10 -- # set +x 00:04:04.748 ************************************ 00:04:04.748 START TEST event_reactor 00:04:04.748 ************************************ 00:04:04.748 11:28:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:04.748 [2024-11-28 11:28:24.418964] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:04.748 [2024-11-28 11:28:24.419035] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3685644 ] 00:04:04.748 EAL: No free 2048 kB hugepages reported on node 1 00:04:04.748 [2024-11-28 11:28:24.483778] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:04.748 [2024-11-28 11:28:24.599310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:05.684 test_start 00:04:05.684 oneshot 00:04:05.684 tick 100 00:04:05.684 tick 100 00:04:05.684 tick 250 00:04:05.684 tick 100 00:04:05.684 tick 100 00:04:05.684 tick 250 00:04:05.684 tick 500 00:04:05.684 tick 100 00:04:05.684 tick 100 00:04:05.684 tick 100 00:04:05.684 tick 250 00:04:05.684 tick 100 00:04:05.684 tick 100 00:04:05.684 test_end 00:04:05.684 00:04:05.684 real 0m1.319s 00:04:05.685 user 0m1.232s 00:04:05.685 sys 0m0.081s 00:04:05.685 11:28:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:05.685 11:28:25 -- common/autotest_common.sh@10 -- # set +x 00:04:05.685 ************************************ 00:04:05.685 END TEST event_reactor 00:04:05.685 ************************************ 00:04:05.943 11:28:25 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:05.943 11:28:25 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:05.943 11:28:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:05.943 11:28:25 -- common/autotest_common.sh@10 -- # set +x 00:04:05.943 ************************************ 00:04:05.943 START TEST event_reactor_perf 00:04:05.943 ************************************ 00:04:05.943 11:28:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:05.943 [2024-11-28 11:28:25.767975] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:05.943 [2024-11-28 11:28:25.768068] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3685811 ] 00:04:05.943 EAL: No free 2048 kB hugepages reported on node 1 00:04:05.943 [2024-11-28 11:28:25.830936] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:05.943 [2024-11-28 11:28:25.946012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:07.318 test_start 00:04:07.318 test_end 00:04:07.318 Performance: 351390 events per second 00:04:07.318 00:04:07.318 real 0m1.315s 00:04:07.318 user 0m1.223s 00:04:07.318 sys 0m0.086s 00:04:07.318 11:28:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:07.318 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.318 ************************************ 00:04:07.318 END TEST event_reactor_perf 00:04:07.318 ************************************ 00:04:07.318 11:28:27 -- event/event.sh@49 -- # uname -s 00:04:07.318 11:28:27 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:07.318 11:28:27 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:07.318 11:28:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.318 11:28:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.318 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.318 ************************************ 00:04:07.318 START TEST event_scheduler 00:04:07.318 ************************************ 00:04:07.318 11:28:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:07.318 * Looking for test storage... 00:04:07.318 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:07.318 11:28:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:07.318 11:28:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:07.318 11:28:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:07.318 11:28:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:07.318 11:28:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:07.318 11:28:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:07.318 11:28:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:07.318 11:28:27 -- scripts/common.sh@335 -- # IFS=.-: 00:04:07.318 11:28:27 -- scripts/common.sh@335 -- # read -ra ver1 00:04:07.318 11:28:27 -- scripts/common.sh@336 -- # IFS=.-: 00:04:07.318 11:28:27 -- scripts/common.sh@336 -- # read -ra ver2 00:04:07.318 11:28:27 -- scripts/common.sh@337 -- # local 'op=<' 00:04:07.318 11:28:27 -- scripts/common.sh@339 -- # ver1_l=2 00:04:07.318 11:28:27 -- scripts/common.sh@340 -- # ver2_l=1 00:04:07.318 11:28:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:07.318 11:28:27 -- scripts/common.sh@343 -- # case "$op" in 00:04:07.318 11:28:27 -- scripts/common.sh@344 -- # : 1 00:04:07.318 11:28:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:07.318 11:28:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:07.318 11:28:27 -- scripts/common.sh@364 -- # decimal 1 00:04:07.318 11:28:27 -- scripts/common.sh@352 -- # local d=1 00:04:07.318 11:28:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:07.318 11:28:27 -- scripts/common.sh@354 -- # echo 1 00:04:07.318 11:28:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:07.318 11:28:27 -- scripts/common.sh@365 -- # decimal 2 00:04:07.318 11:28:27 -- scripts/common.sh@352 -- # local d=2 00:04:07.318 11:28:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:07.318 11:28:27 -- scripts/common.sh@354 -- # echo 2 00:04:07.318 11:28:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:07.318 11:28:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:07.318 11:28:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:07.318 11:28:27 -- scripts/common.sh@367 -- # return 0 00:04:07.318 11:28:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:07.318 11:28:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:07.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.318 --rc genhtml_branch_coverage=1 00:04:07.318 --rc genhtml_function_coverage=1 00:04:07.318 --rc genhtml_legend=1 00:04:07.318 --rc geninfo_all_blocks=1 00:04:07.318 --rc geninfo_unexecuted_blocks=1 00:04:07.318 00:04:07.318 ' 00:04:07.318 11:28:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:07.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.319 --rc genhtml_branch_coverage=1 00:04:07.319 --rc genhtml_function_coverage=1 00:04:07.319 --rc genhtml_legend=1 00:04:07.319 --rc geninfo_all_blocks=1 00:04:07.319 --rc geninfo_unexecuted_blocks=1 00:04:07.319 00:04:07.319 ' 00:04:07.319 11:28:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:07.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.319 --rc genhtml_branch_coverage=1 00:04:07.319 --rc genhtml_function_coverage=1 00:04:07.319 --rc genhtml_legend=1 00:04:07.319 --rc geninfo_all_blocks=1 00:04:07.319 --rc geninfo_unexecuted_blocks=1 00:04:07.319 00:04:07.319 ' 00:04:07.319 11:28:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:07.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.319 --rc genhtml_branch_coverage=1 00:04:07.319 --rc genhtml_function_coverage=1 00:04:07.319 --rc genhtml_legend=1 00:04:07.319 --rc geninfo_all_blocks=1 00:04:07.319 --rc geninfo_unexecuted_blocks=1 00:04:07.319 00:04:07.319 ' 00:04:07.319 11:28:27 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:07.319 11:28:27 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3686130 00:04:07.319 11:28:27 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:07.319 11:28:27 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:07.319 11:28:27 -- scheduler/scheduler.sh@37 -- # waitforlisten 3686130 00:04:07.319 11:28:27 -- common/autotest_common.sh@829 -- # '[' -z 3686130 ']' 00:04:07.319 11:28:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:07.319 11:28:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:07.319 11:28:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:07.319 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:07.319 11:28:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:07.319 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.319 [2024-11-28 11:28:27.263272] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:07.319 [2024-11-28 11:28:27.263362] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3686130 ] 00:04:07.319 EAL: No free 2048 kB hugepages reported on node 1 00:04:07.319 [2024-11-28 11:28:27.319938] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:07.577 [2024-11-28 11:28:27.431457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:07.577 [2024-11-28 11:28:27.431522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:07.577 [2024-11-28 11:28:27.431588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:07.578 [2024-11-28 11:28:27.431591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:07.578 11:28:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:07.578 11:28:27 -- common/autotest_common.sh@862 -- # return 0 00:04:07.578 11:28:27 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:07.578 11:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.578 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.578 POWER: Env isn't set yet! 00:04:07.578 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:07.578 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:07.578 POWER: Cannot get available frequencies of lcore 0 00:04:07.578 POWER: Attempting to initialise PSTAT power management... 00:04:07.578 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:07.578 POWER: Initialized successfully for lcore 0 power management 00:04:07.578 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:07.578 POWER: Initialized successfully for lcore 1 power management 00:04:07.578 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:07.578 POWER: Initialized successfully for lcore 2 power management 00:04:07.578 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:07.578 POWER: Initialized successfully for lcore 3 power management 00:04:07.578 [2024-11-28 11:28:27.536741] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:07.578 [2024-11-28 11:28:27.536758] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:07.578 [2024-11-28 11:28:27.536769] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:07.578 11:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.578 11:28:27 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:07.578 11:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.578 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.836 [2024-11-28 11:28:27.642682] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:07.837 11:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.837 11:28:27 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:07.837 11:28:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.837 11:28:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.837 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.837 ************************************ 00:04:07.837 START TEST scheduler_create_thread 00:04:07.837 ************************************ 00:04:07.837 11:28:27 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:07.837 11:28:27 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:07.837 11:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.837 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.837 2 00:04:07.837 11:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.837 11:28:27 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:07.837 11:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.837 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.837 3 00:04:07.837 11:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.837 11:28:27 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:07.837 11:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.837 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.837 4 00:04:07.837 11:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.837 11:28:27 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:07.837 11:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.837 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.837 5 00:04:07.837 11:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.837 11:28:27 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:07.837 11:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.837 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.837 6 00:04:07.837 11:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.837 11:28:27 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:07.837 11:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.837 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.837 7 00:04:07.837 11:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.837 11:28:27 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:07.837 11:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.837 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.837 8 00:04:07.837 11:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.837 11:28:27 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:07.837 11:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.837 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.837 9 00:04:07.837 11:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.837 11:28:27 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:07.837 11:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.837 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.837 10 00:04:07.837 11:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.837 11:28:27 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:07.837 11:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.837 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.837 11:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.837 11:28:27 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:07.837 11:28:27 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:07.837 11:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.837 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:07.837 11:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.837 11:28:27 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:07.837 11:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.837 11:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:09.211 11:28:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.211 11:28:29 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:09.211 11:28:29 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:09.211 11:28:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.211 11:28:29 -- common/autotest_common.sh@10 -- # set +x 00:04:10.585 11:28:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.585 00:04:10.585 real 0m2.621s 00:04:10.585 user 0m0.010s 00:04:10.585 sys 0m0.004s 00:04:10.585 11:28:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.585 11:28:30 -- common/autotest_common.sh@10 -- # set +x 00:04:10.585 ************************************ 00:04:10.585 END TEST scheduler_create_thread 00:04:10.585 ************************************ 00:04:10.585 11:28:30 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:10.585 11:28:30 -- scheduler/scheduler.sh@46 -- # killprocess 3686130 00:04:10.585 11:28:30 -- common/autotest_common.sh@936 -- # '[' -z 3686130 ']' 00:04:10.585 11:28:30 -- common/autotest_common.sh@940 -- # kill -0 3686130 00:04:10.585 11:28:30 -- common/autotest_common.sh@941 -- # uname 00:04:10.585 11:28:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:10.585 11:28:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3686130 00:04:10.585 11:28:30 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:10.585 11:28:30 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:10.585 11:28:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3686130' 00:04:10.585 killing process with pid 3686130 00:04:10.585 11:28:30 -- common/autotest_common.sh@955 -- # kill 3686130 00:04:10.585 11:28:30 -- common/autotest_common.sh@960 -- # wait 3686130 00:04:10.844 [2024-11-28 11:28:30.750099] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:10.844 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:10.844 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:10.844 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:10.844 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:10.844 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:10.844 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:10.844 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:10.844 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:11.102 00:04:11.102 real 0m3.923s 00:04:11.102 user 0m5.905s 00:04:11.102 sys 0m0.343s 00:04:11.102 11:28:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:11.102 11:28:31 -- common/autotest_common.sh@10 -- # set +x 00:04:11.102 ************************************ 00:04:11.102 END TEST event_scheduler 00:04:11.102 ************************************ 00:04:11.102 11:28:31 -- event/event.sh@51 -- # modprobe -n nbd 00:04:11.102 11:28:31 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:11.102 11:28:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.102 11:28:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.102 11:28:31 -- common/autotest_common.sh@10 -- # set +x 00:04:11.102 ************************************ 00:04:11.102 START TEST app_repeat 00:04:11.102 ************************************ 00:04:11.102 11:28:31 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:11.102 11:28:31 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:11.102 11:28:31 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:11.102 11:28:31 -- event/event.sh@13 -- # local nbd_list 00:04:11.102 11:28:31 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:11.102 11:28:31 -- event/event.sh@14 -- # local bdev_list 00:04:11.102 11:28:31 -- event/event.sh@15 -- # local repeat_times=4 00:04:11.102 11:28:31 -- event/event.sh@17 -- # modprobe nbd 00:04:11.102 11:28:31 -- event/event.sh@19 -- # repeat_pid=3686591 00:04:11.102 11:28:31 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:11.102 11:28:31 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:11.102 11:28:31 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3686591' 00:04:11.102 Process app_repeat pid: 3686591 00:04:11.102 11:28:31 -- event/event.sh@23 -- # for i in {0..2} 00:04:11.102 11:28:31 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:11.102 spdk_app_start Round 0 00:04:11.102 11:28:31 -- event/event.sh@25 -- # waitforlisten 3686591 /var/tmp/spdk-nbd.sock 00:04:11.102 11:28:31 -- common/autotest_common.sh@829 -- # '[' -z 3686591 ']' 00:04:11.102 11:28:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:11.102 11:28:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:11.102 11:28:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:11.102 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:11.102 11:28:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:11.102 11:28:31 -- common/autotest_common.sh@10 -- # set +x 00:04:11.102 [2024-11-28 11:28:31.080215] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:11.102 [2024-11-28 11:28:31.080302] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3686591 ] 00:04:11.102 EAL: No free 2048 kB hugepages reported on node 1 00:04:11.102 [2024-11-28 11:28:31.142940] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:11.359 [2024-11-28 11:28:31.257675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:11.359 [2024-11-28 11:28:31.257692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:12.292 11:28:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:12.292 11:28:32 -- common/autotest_common.sh@862 -- # return 0 00:04:12.292 11:28:32 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:12.292 Malloc0 00:04:12.292 11:28:32 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:12.550 Malloc1 00:04:12.550 11:28:32 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@12 -- # local i 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:12.550 11:28:32 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:12.807 /dev/nbd0 00:04:12.807 11:28:32 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:12.807 11:28:32 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:12.807 11:28:32 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:12.807 11:28:32 -- common/autotest_common.sh@867 -- # local i 00:04:13.065 11:28:32 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:13.065 11:28:32 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:13.065 11:28:32 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:13.065 11:28:32 -- common/autotest_common.sh@871 -- # break 00:04:13.065 11:28:32 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:13.065 11:28:32 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:13.065 11:28:32 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:13.065 1+0 records in 00:04:13.065 1+0 records out 00:04:13.065 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000206499 s, 19.8 MB/s 00:04:13.065 11:28:32 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:13.065 11:28:32 -- common/autotest_common.sh@884 -- # size=4096 00:04:13.065 11:28:32 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:13.065 11:28:32 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:13.065 11:28:32 -- common/autotest_common.sh@887 -- # return 0 00:04:13.065 11:28:32 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:13.065 11:28:32 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:13.065 11:28:32 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:13.322 /dev/nbd1 00:04:13.322 11:28:33 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:13.322 11:28:33 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:13.322 11:28:33 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:13.322 11:28:33 -- common/autotest_common.sh@867 -- # local i 00:04:13.322 11:28:33 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:13.322 11:28:33 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:13.322 11:28:33 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:13.322 11:28:33 -- common/autotest_common.sh@871 -- # break 00:04:13.322 11:28:33 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:13.322 11:28:33 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:13.322 11:28:33 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:13.322 1+0 records in 00:04:13.322 1+0 records out 00:04:13.322 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000233332 s, 17.6 MB/s 00:04:13.323 11:28:33 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:13.323 11:28:33 -- common/autotest_common.sh@884 -- # size=4096 00:04:13.323 11:28:33 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:13.323 11:28:33 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:13.323 11:28:33 -- common/autotest_common.sh@887 -- # return 0 00:04:13.323 11:28:33 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:13.323 11:28:33 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:13.323 11:28:33 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:13.323 11:28:33 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:13.323 11:28:33 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:13.580 { 00:04:13.580 "nbd_device": "/dev/nbd0", 00:04:13.580 "bdev_name": "Malloc0" 00:04:13.580 }, 00:04:13.580 { 00:04:13.580 "nbd_device": "/dev/nbd1", 00:04:13.580 "bdev_name": "Malloc1" 00:04:13.580 } 00:04:13.580 ]' 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:13.580 { 00:04:13.580 "nbd_device": "/dev/nbd0", 00:04:13.580 "bdev_name": "Malloc0" 00:04:13.580 }, 00:04:13.580 { 00:04:13.580 "nbd_device": "/dev/nbd1", 00:04:13.580 "bdev_name": "Malloc1" 00:04:13.580 } 00:04:13.580 ]' 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:13.580 /dev/nbd1' 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:13.580 /dev/nbd1' 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@65 -- # count=2 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@95 -- # count=2 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:13.580 256+0 records in 00:04:13.580 256+0 records out 00:04:13.580 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00501515 s, 209 MB/s 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:13.580 256+0 records in 00:04:13.580 256+0 records out 00:04:13.580 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223934 s, 46.8 MB/s 00:04:13.580 11:28:33 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:13.581 256+0 records in 00:04:13.581 256+0 records out 00:04:13.581 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246108 s, 42.6 MB/s 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@51 -- # local i 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:13.581 11:28:33 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:13.839 11:28:33 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:13.839 11:28:33 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:13.839 11:28:33 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:13.839 11:28:33 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:13.839 11:28:33 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:13.839 11:28:33 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:13.839 11:28:33 -- bdev/nbd_common.sh@41 -- # break 00:04:13.839 11:28:33 -- bdev/nbd_common.sh@45 -- # return 0 00:04:13.839 11:28:33 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:13.839 11:28:33 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:14.097 11:28:34 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:14.097 11:28:34 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:14.097 11:28:34 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:14.097 11:28:34 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:14.097 11:28:34 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:14.097 11:28:34 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:14.097 11:28:34 -- bdev/nbd_common.sh@41 -- # break 00:04:14.097 11:28:34 -- bdev/nbd_common.sh@45 -- # return 0 00:04:14.097 11:28:34 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:14.097 11:28:34 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:14.097 11:28:34 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:14.355 11:28:34 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:14.355 11:28:34 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:14.355 11:28:34 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:14.355 11:28:34 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:14.355 11:28:34 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:14.355 11:28:34 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:14.355 11:28:34 -- bdev/nbd_common.sh@65 -- # true 00:04:14.355 11:28:34 -- bdev/nbd_common.sh@65 -- # count=0 00:04:14.355 11:28:34 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:14.355 11:28:34 -- bdev/nbd_common.sh@104 -- # count=0 00:04:14.355 11:28:34 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:14.355 11:28:34 -- bdev/nbd_common.sh@109 -- # return 0 00:04:14.355 11:28:34 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:14.613 11:28:34 -- event/event.sh@35 -- # sleep 3 00:04:15.179 [2024-11-28 11:28:34.935030] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:15.179 [2024-11-28 11:28:35.050280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:15.179 [2024-11-28 11:28:35.050280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:15.179 [2024-11-28 11:28:35.112319] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:15.179 [2024-11-28 11:28:35.112415] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:17.706 11:28:37 -- event/event.sh@23 -- # for i in {0..2} 00:04:17.706 11:28:37 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:17.706 spdk_app_start Round 1 00:04:17.706 11:28:37 -- event/event.sh@25 -- # waitforlisten 3686591 /var/tmp/spdk-nbd.sock 00:04:17.706 11:28:37 -- common/autotest_common.sh@829 -- # '[' -z 3686591 ']' 00:04:17.706 11:28:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:17.706 11:28:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:17.706 11:28:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:17.706 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:17.706 11:28:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:17.706 11:28:37 -- common/autotest_common.sh@10 -- # set +x 00:04:17.964 11:28:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:17.964 11:28:37 -- common/autotest_common.sh@862 -- # return 0 00:04:17.964 11:28:37 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:18.223 Malloc0 00:04:18.223 11:28:38 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:18.481 Malloc1 00:04:18.481 11:28:38 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@12 -- # local i 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:18.481 11:28:38 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:18.739 /dev/nbd0 00:04:18.739 11:28:38 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:18.739 11:28:38 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:18.739 11:28:38 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:18.739 11:28:38 -- common/autotest_common.sh@867 -- # local i 00:04:18.739 11:28:38 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:18.739 11:28:38 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:18.739 11:28:38 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:18.739 11:28:38 -- common/autotest_common.sh@871 -- # break 00:04:18.739 11:28:38 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:18.739 11:28:38 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:18.739 11:28:38 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:18.739 1+0 records in 00:04:18.739 1+0 records out 00:04:18.739 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000151933 s, 27.0 MB/s 00:04:18.739 11:28:38 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:18.739 11:28:38 -- common/autotest_common.sh@884 -- # size=4096 00:04:18.739 11:28:38 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:18.739 11:28:38 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:18.739 11:28:38 -- common/autotest_common.sh@887 -- # return 0 00:04:18.739 11:28:38 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:18.739 11:28:38 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:18.739 11:28:38 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:18.997 /dev/nbd1 00:04:18.997 11:28:38 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:18.997 11:28:38 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:18.997 11:28:38 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:18.997 11:28:38 -- common/autotest_common.sh@867 -- # local i 00:04:18.997 11:28:38 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:18.997 11:28:38 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:18.997 11:28:38 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:18.997 11:28:38 -- common/autotest_common.sh@871 -- # break 00:04:18.997 11:28:38 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:18.997 11:28:38 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:18.997 11:28:38 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:18.997 1+0 records in 00:04:18.997 1+0 records out 00:04:18.997 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000214895 s, 19.1 MB/s 00:04:18.997 11:28:38 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:18.997 11:28:38 -- common/autotest_common.sh@884 -- # size=4096 00:04:18.997 11:28:38 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:18.997 11:28:39 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:18.997 11:28:39 -- common/autotest_common.sh@887 -- # return 0 00:04:18.997 11:28:39 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:18.997 11:28:39 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:18.997 11:28:39 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:18.997 11:28:39 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:18.997 11:28:39 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:19.255 { 00:04:19.255 "nbd_device": "/dev/nbd0", 00:04:19.255 "bdev_name": "Malloc0" 00:04:19.255 }, 00:04:19.255 { 00:04:19.255 "nbd_device": "/dev/nbd1", 00:04:19.255 "bdev_name": "Malloc1" 00:04:19.255 } 00:04:19.255 ]' 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:19.255 { 00:04:19.255 "nbd_device": "/dev/nbd0", 00:04:19.255 "bdev_name": "Malloc0" 00:04:19.255 }, 00:04:19.255 { 00:04:19.255 "nbd_device": "/dev/nbd1", 00:04:19.255 "bdev_name": "Malloc1" 00:04:19.255 } 00:04:19.255 ]' 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:19.255 /dev/nbd1' 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:19.255 /dev/nbd1' 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@65 -- # count=2 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@95 -- # count=2 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:19.255 256+0 records in 00:04:19.255 256+0 records out 00:04:19.255 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00505194 s, 208 MB/s 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:19.255 11:28:39 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:19.513 256+0 records in 00:04:19.513 256+0 records out 00:04:19.513 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212179 s, 49.4 MB/s 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:19.513 256+0 records in 00:04:19.513 256+0 records out 00:04:19.513 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238894 s, 43.9 MB/s 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@51 -- # local i 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:19.513 11:28:39 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:19.771 11:28:39 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:19.771 11:28:39 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:19.771 11:28:39 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:19.771 11:28:39 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:19.771 11:28:39 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:19.771 11:28:39 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:19.771 11:28:39 -- bdev/nbd_common.sh@41 -- # break 00:04:19.771 11:28:39 -- bdev/nbd_common.sh@45 -- # return 0 00:04:19.771 11:28:39 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:19.771 11:28:39 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:20.029 11:28:39 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:20.029 11:28:39 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:20.029 11:28:39 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:20.029 11:28:39 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:20.029 11:28:39 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:20.029 11:28:39 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:20.029 11:28:39 -- bdev/nbd_common.sh@41 -- # break 00:04:20.029 11:28:39 -- bdev/nbd_common.sh@45 -- # return 0 00:04:20.029 11:28:39 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:20.030 11:28:39 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:20.030 11:28:39 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:20.287 11:28:40 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:20.287 11:28:40 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:20.287 11:28:40 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:20.287 11:28:40 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:20.287 11:28:40 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:20.287 11:28:40 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:20.287 11:28:40 -- bdev/nbd_common.sh@65 -- # true 00:04:20.287 11:28:40 -- bdev/nbd_common.sh@65 -- # count=0 00:04:20.287 11:28:40 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:20.287 11:28:40 -- bdev/nbd_common.sh@104 -- # count=0 00:04:20.287 11:28:40 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:20.287 11:28:40 -- bdev/nbd_common.sh@109 -- # return 0 00:04:20.287 11:28:40 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:20.545 11:28:40 -- event/event.sh@35 -- # sleep 3 00:04:20.802 [2024-11-28 11:28:40.777828] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:21.060 [2024-11-28 11:28:40.893201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:21.060 [2024-11-28 11:28:40.893206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:21.060 [2024-11-28 11:28:40.955153] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:21.060 [2024-11-28 11:28:40.955233] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:23.588 11:28:43 -- event/event.sh@23 -- # for i in {0..2} 00:04:23.588 11:28:43 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:23.588 spdk_app_start Round 2 00:04:23.588 11:28:43 -- event/event.sh@25 -- # waitforlisten 3686591 /var/tmp/spdk-nbd.sock 00:04:23.588 11:28:43 -- common/autotest_common.sh@829 -- # '[' -z 3686591 ']' 00:04:23.588 11:28:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:23.588 11:28:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:23.588 11:28:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:23.588 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:23.588 11:28:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:23.588 11:28:43 -- common/autotest_common.sh@10 -- # set +x 00:04:23.846 11:28:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:23.846 11:28:43 -- common/autotest_common.sh@862 -- # return 0 00:04:23.846 11:28:43 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:24.104 Malloc0 00:04:24.104 11:28:44 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:24.363 Malloc1 00:04:24.363 11:28:44 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@12 -- # local i 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:24.363 11:28:44 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:24.621 /dev/nbd0 00:04:24.621 11:28:44 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:24.621 11:28:44 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:24.621 11:28:44 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:24.621 11:28:44 -- common/autotest_common.sh@867 -- # local i 00:04:24.621 11:28:44 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:24.621 11:28:44 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:24.621 11:28:44 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:24.621 11:28:44 -- common/autotest_common.sh@871 -- # break 00:04:24.621 11:28:44 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:24.621 11:28:44 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:24.621 11:28:44 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:24.621 1+0 records in 00:04:24.621 1+0 records out 00:04:24.621 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000169626 s, 24.1 MB/s 00:04:24.621 11:28:44 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:24.621 11:28:44 -- common/autotest_common.sh@884 -- # size=4096 00:04:24.621 11:28:44 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:24.621 11:28:44 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:24.621 11:28:44 -- common/autotest_common.sh@887 -- # return 0 00:04:24.621 11:28:44 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:24.621 11:28:44 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:24.621 11:28:44 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:24.879 /dev/nbd1 00:04:24.879 11:28:44 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:24.879 11:28:44 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:24.879 11:28:44 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:24.879 11:28:44 -- common/autotest_common.sh@867 -- # local i 00:04:24.879 11:28:44 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:24.879 11:28:44 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:24.879 11:28:44 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:24.879 11:28:44 -- common/autotest_common.sh@871 -- # break 00:04:24.879 11:28:44 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:24.879 11:28:44 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:24.879 11:28:44 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:24.879 1+0 records in 00:04:24.879 1+0 records out 00:04:24.879 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000214606 s, 19.1 MB/s 00:04:24.879 11:28:44 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:24.879 11:28:44 -- common/autotest_common.sh@884 -- # size=4096 00:04:24.879 11:28:44 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:24.879 11:28:44 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:24.879 11:28:44 -- common/autotest_common.sh@887 -- # return 0 00:04:24.879 11:28:44 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:24.879 11:28:44 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:24.879 11:28:44 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:24.879 11:28:44 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:24.879 11:28:44 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:25.138 { 00:04:25.138 "nbd_device": "/dev/nbd0", 00:04:25.138 "bdev_name": "Malloc0" 00:04:25.138 }, 00:04:25.138 { 00:04:25.138 "nbd_device": "/dev/nbd1", 00:04:25.138 "bdev_name": "Malloc1" 00:04:25.138 } 00:04:25.138 ]' 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:25.138 { 00:04:25.138 "nbd_device": "/dev/nbd0", 00:04:25.138 "bdev_name": "Malloc0" 00:04:25.138 }, 00:04:25.138 { 00:04:25.138 "nbd_device": "/dev/nbd1", 00:04:25.138 "bdev_name": "Malloc1" 00:04:25.138 } 00:04:25.138 ]' 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:25.138 /dev/nbd1' 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:25.138 /dev/nbd1' 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@65 -- # count=2 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@95 -- # count=2 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:25.138 256+0 records in 00:04:25.138 256+0 records out 00:04:25.138 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00508155 s, 206 MB/s 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:25.138 11:28:45 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:25.395 256+0 records in 00:04:25.395 256+0 records out 00:04:25.395 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226472 s, 46.3 MB/s 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:25.395 256+0 records in 00:04:25.395 256+0 records out 00:04:25.395 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233127 s, 45.0 MB/s 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@51 -- # local i 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:25.395 11:28:45 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:25.652 11:28:45 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:25.652 11:28:45 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:25.652 11:28:45 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:25.652 11:28:45 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:25.652 11:28:45 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:25.652 11:28:45 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:25.652 11:28:45 -- bdev/nbd_common.sh@41 -- # break 00:04:25.652 11:28:45 -- bdev/nbd_common.sh@45 -- # return 0 00:04:25.652 11:28:45 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:25.652 11:28:45 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:25.910 11:28:45 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:25.910 11:28:45 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:25.910 11:28:45 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:25.910 11:28:45 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:25.910 11:28:45 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:25.910 11:28:45 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:25.910 11:28:45 -- bdev/nbd_common.sh@41 -- # break 00:04:25.910 11:28:45 -- bdev/nbd_common.sh@45 -- # return 0 00:04:25.910 11:28:45 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:25.910 11:28:45 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:25.910 11:28:45 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:26.168 11:28:46 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:26.168 11:28:46 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:26.168 11:28:46 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:26.168 11:28:46 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:26.168 11:28:46 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:26.168 11:28:46 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:26.168 11:28:46 -- bdev/nbd_common.sh@65 -- # true 00:04:26.168 11:28:46 -- bdev/nbd_common.sh@65 -- # count=0 00:04:26.168 11:28:46 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:26.168 11:28:46 -- bdev/nbd_common.sh@104 -- # count=0 00:04:26.168 11:28:46 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:26.168 11:28:46 -- bdev/nbd_common.sh@109 -- # return 0 00:04:26.168 11:28:46 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:26.426 11:28:46 -- event/event.sh@35 -- # sleep 3 00:04:26.712 [2024-11-28 11:28:46.653370] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:26.990 [2024-11-28 11:28:46.768418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:26.990 [2024-11-28 11:28:46.768423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:26.990 [2024-11-28 11:28:46.828867] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:26.990 [2024-11-28 11:28:46.828942] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:29.520 11:28:49 -- event/event.sh@38 -- # waitforlisten 3686591 /var/tmp/spdk-nbd.sock 00:04:29.520 11:28:49 -- common/autotest_common.sh@829 -- # '[' -z 3686591 ']' 00:04:29.520 11:28:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:29.520 11:28:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:29.520 11:28:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:29.520 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:29.520 11:28:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:29.520 11:28:49 -- common/autotest_common.sh@10 -- # set +x 00:04:29.778 11:28:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:29.778 11:28:49 -- common/autotest_common.sh@862 -- # return 0 00:04:29.778 11:28:49 -- event/event.sh@39 -- # killprocess 3686591 00:04:29.778 11:28:49 -- common/autotest_common.sh@936 -- # '[' -z 3686591 ']' 00:04:29.778 11:28:49 -- common/autotest_common.sh@940 -- # kill -0 3686591 00:04:29.778 11:28:49 -- common/autotest_common.sh@941 -- # uname 00:04:29.778 11:28:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:29.778 11:28:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3686591 00:04:29.778 11:28:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:29.778 11:28:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:29.778 11:28:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3686591' 00:04:29.778 killing process with pid 3686591 00:04:29.778 11:28:49 -- common/autotest_common.sh@955 -- # kill 3686591 00:04:29.778 11:28:49 -- common/autotest_common.sh@960 -- # wait 3686591 00:04:30.036 spdk_app_start is called in Round 0. 00:04:30.036 Shutdown signal received, stop current app iteration 00:04:30.036 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:30.036 spdk_app_start is called in Round 1. 00:04:30.036 Shutdown signal received, stop current app iteration 00:04:30.036 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:30.036 spdk_app_start is called in Round 2. 00:04:30.036 Shutdown signal received, stop current app iteration 00:04:30.036 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:30.036 spdk_app_start is called in Round 3. 00:04:30.036 Shutdown signal received, stop current app iteration 00:04:30.036 11:28:49 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:04:30.036 11:28:49 -- event/event.sh@42 -- # return 0 00:04:30.036 00:04:30.036 real 0m18.893s 00:04:30.036 user 0m41.164s 00:04:30.036 sys 0m3.179s 00:04:30.036 11:28:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:30.036 11:28:49 -- common/autotest_common.sh@10 -- # set +x 00:04:30.036 ************************************ 00:04:30.036 END TEST app_repeat 00:04:30.036 ************************************ 00:04:30.036 11:28:49 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:04:30.036 11:28:49 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:30.036 11:28:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.036 11:28:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.036 11:28:49 -- common/autotest_common.sh@10 -- # set +x 00:04:30.036 ************************************ 00:04:30.036 START TEST cpu_locks 00:04:30.036 ************************************ 00:04:30.036 11:28:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:30.036 * Looking for test storage... 00:04:30.036 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:30.036 11:28:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:30.036 11:28:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:30.036 11:28:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:30.294 11:28:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:30.294 11:28:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:30.294 11:28:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:30.294 11:28:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:30.294 11:28:50 -- scripts/common.sh@335 -- # IFS=.-: 00:04:30.294 11:28:50 -- scripts/common.sh@335 -- # read -ra ver1 00:04:30.294 11:28:50 -- scripts/common.sh@336 -- # IFS=.-: 00:04:30.294 11:28:50 -- scripts/common.sh@336 -- # read -ra ver2 00:04:30.294 11:28:50 -- scripts/common.sh@337 -- # local 'op=<' 00:04:30.294 11:28:50 -- scripts/common.sh@339 -- # ver1_l=2 00:04:30.294 11:28:50 -- scripts/common.sh@340 -- # ver2_l=1 00:04:30.294 11:28:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:30.294 11:28:50 -- scripts/common.sh@343 -- # case "$op" in 00:04:30.294 11:28:50 -- scripts/common.sh@344 -- # : 1 00:04:30.294 11:28:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:30.294 11:28:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:30.294 11:28:50 -- scripts/common.sh@364 -- # decimal 1 00:04:30.294 11:28:50 -- scripts/common.sh@352 -- # local d=1 00:04:30.295 11:28:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:30.295 11:28:50 -- scripts/common.sh@354 -- # echo 1 00:04:30.295 11:28:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:30.295 11:28:50 -- scripts/common.sh@365 -- # decimal 2 00:04:30.295 11:28:50 -- scripts/common.sh@352 -- # local d=2 00:04:30.295 11:28:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:30.295 11:28:50 -- scripts/common.sh@354 -- # echo 2 00:04:30.295 11:28:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:30.295 11:28:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:30.295 11:28:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:30.295 11:28:50 -- scripts/common.sh@367 -- # return 0 00:04:30.295 11:28:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:30.295 11:28:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:30.295 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.295 --rc genhtml_branch_coverage=1 00:04:30.295 --rc genhtml_function_coverage=1 00:04:30.295 --rc genhtml_legend=1 00:04:30.295 --rc geninfo_all_blocks=1 00:04:30.295 --rc geninfo_unexecuted_blocks=1 00:04:30.295 00:04:30.295 ' 00:04:30.295 11:28:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:30.295 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.295 --rc genhtml_branch_coverage=1 00:04:30.295 --rc genhtml_function_coverage=1 00:04:30.295 --rc genhtml_legend=1 00:04:30.295 --rc geninfo_all_blocks=1 00:04:30.295 --rc geninfo_unexecuted_blocks=1 00:04:30.295 00:04:30.295 ' 00:04:30.295 11:28:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:30.295 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.295 --rc genhtml_branch_coverage=1 00:04:30.295 --rc genhtml_function_coverage=1 00:04:30.295 --rc genhtml_legend=1 00:04:30.295 --rc geninfo_all_blocks=1 00:04:30.295 --rc geninfo_unexecuted_blocks=1 00:04:30.295 00:04:30.295 ' 00:04:30.295 11:28:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:30.295 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.295 --rc genhtml_branch_coverage=1 00:04:30.295 --rc genhtml_function_coverage=1 00:04:30.295 --rc genhtml_legend=1 00:04:30.295 --rc geninfo_all_blocks=1 00:04:30.295 --rc geninfo_unexecuted_blocks=1 00:04:30.295 00:04:30.295 ' 00:04:30.295 11:28:50 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:04:30.295 11:28:50 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:04:30.295 11:28:50 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:04:30.295 11:28:50 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:04:30.295 11:28:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.295 11:28:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.295 11:28:50 -- common/autotest_common.sh@10 -- # set +x 00:04:30.295 ************************************ 00:04:30.295 START TEST default_locks 00:04:30.295 ************************************ 00:04:30.295 11:28:50 -- common/autotest_common.sh@1114 -- # default_locks 00:04:30.295 11:28:50 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3689145 00:04:30.295 11:28:50 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:30.295 11:28:50 -- event/cpu_locks.sh@47 -- # waitforlisten 3689145 00:04:30.295 11:28:50 -- common/autotest_common.sh@829 -- # '[' -z 3689145 ']' 00:04:30.295 11:28:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:30.295 11:28:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:30.295 11:28:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:30.295 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:30.295 11:28:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:30.295 11:28:50 -- common/autotest_common.sh@10 -- # set +x 00:04:30.295 [2024-11-28 11:28:50.161815] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:30.295 [2024-11-28 11:28:50.161930] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3689145 ] 00:04:30.295 EAL: No free 2048 kB hugepages reported on node 1 00:04:30.295 [2024-11-28 11:28:50.220554] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:30.295 [2024-11-28 11:28:50.332522] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:30.295 [2024-11-28 11:28:50.332707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:31.229 11:28:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:31.229 11:28:51 -- common/autotest_common.sh@862 -- # return 0 00:04:31.229 11:28:51 -- event/cpu_locks.sh@49 -- # locks_exist 3689145 00:04:31.229 11:28:51 -- event/cpu_locks.sh@22 -- # lslocks -p 3689145 00:04:31.229 11:28:51 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:31.487 lslocks: write error 00:04:31.487 11:28:51 -- event/cpu_locks.sh@50 -- # killprocess 3689145 00:04:31.487 11:28:51 -- common/autotest_common.sh@936 -- # '[' -z 3689145 ']' 00:04:31.487 11:28:51 -- common/autotest_common.sh@940 -- # kill -0 3689145 00:04:31.487 11:28:51 -- common/autotest_common.sh@941 -- # uname 00:04:31.487 11:28:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:31.487 11:28:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3689145 00:04:31.487 11:28:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:31.487 11:28:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:31.487 11:28:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3689145' 00:04:31.487 killing process with pid 3689145 00:04:31.487 11:28:51 -- common/autotest_common.sh@955 -- # kill 3689145 00:04:31.487 11:28:51 -- common/autotest_common.sh@960 -- # wait 3689145 00:04:32.054 11:28:51 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3689145 00:04:32.054 11:28:51 -- common/autotest_common.sh@650 -- # local es=0 00:04:32.054 11:28:51 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3689145 00:04:32.054 11:28:51 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:32.054 11:28:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:32.054 11:28:51 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:32.054 11:28:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:32.054 11:28:51 -- common/autotest_common.sh@653 -- # waitforlisten 3689145 00:04:32.054 11:28:51 -- common/autotest_common.sh@829 -- # '[' -z 3689145 ']' 00:04:32.054 11:28:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:32.054 11:28:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:32.054 11:28:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:32.054 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:32.054 11:28:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:32.054 11:28:51 -- common/autotest_common.sh@10 -- # set +x 00:04:32.054 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3689145) - No such process 00:04:32.054 ERROR: process (pid: 3689145) is no longer running 00:04:32.054 11:28:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:32.054 11:28:51 -- common/autotest_common.sh@862 -- # return 1 00:04:32.054 11:28:51 -- common/autotest_common.sh@653 -- # es=1 00:04:32.054 11:28:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:32.054 11:28:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:32.054 11:28:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:32.054 11:28:51 -- event/cpu_locks.sh@54 -- # no_locks 00:04:32.054 11:28:51 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:32.054 11:28:51 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:32.054 11:28:51 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:32.054 00:04:32.054 real 0m1.767s 00:04:32.054 user 0m1.902s 00:04:32.054 sys 0m0.547s 00:04:32.054 11:28:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:32.054 11:28:51 -- common/autotest_common.sh@10 -- # set +x 00:04:32.054 ************************************ 00:04:32.054 END TEST default_locks 00:04:32.054 ************************************ 00:04:32.054 11:28:51 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:04:32.054 11:28:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:32.054 11:28:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:32.054 11:28:51 -- common/autotest_common.sh@10 -- # set +x 00:04:32.054 ************************************ 00:04:32.054 START TEST default_locks_via_rpc 00:04:32.054 ************************************ 00:04:32.054 11:28:51 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:04:32.054 11:28:51 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3689446 00:04:32.054 11:28:51 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:32.054 11:28:51 -- event/cpu_locks.sh@63 -- # waitforlisten 3689446 00:04:32.054 11:28:51 -- common/autotest_common.sh@829 -- # '[' -z 3689446 ']' 00:04:32.054 11:28:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:32.054 11:28:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:32.054 11:28:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:32.054 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:32.054 11:28:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:32.054 11:28:51 -- common/autotest_common.sh@10 -- # set +x 00:04:32.054 [2024-11-28 11:28:51.956222] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:32.054 [2024-11-28 11:28:51.956304] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3689446 ] 00:04:32.054 EAL: No free 2048 kB hugepages reported on node 1 00:04:32.054 [2024-11-28 11:28:52.016117] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:32.313 [2024-11-28 11:28:52.129777] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:32.313 [2024-11-28 11:28:52.129950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:32.878 11:28:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:32.878 11:28:52 -- common/autotest_common.sh@862 -- # return 0 00:04:32.878 11:28:52 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:04:32.878 11:28:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:32.878 11:28:52 -- common/autotest_common.sh@10 -- # set +x 00:04:32.878 11:28:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:32.878 11:28:52 -- event/cpu_locks.sh@67 -- # no_locks 00:04:32.878 11:28:52 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:32.878 11:28:52 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:32.878 11:28:52 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:32.878 11:28:52 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:04:32.878 11:28:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:32.878 11:28:52 -- common/autotest_common.sh@10 -- # set +x 00:04:32.878 11:28:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:32.878 11:28:52 -- event/cpu_locks.sh@71 -- # locks_exist 3689446 00:04:32.878 11:28:52 -- event/cpu_locks.sh@22 -- # lslocks -p 3689446 00:04:32.878 11:28:52 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:33.442 11:28:53 -- event/cpu_locks.sh@73 -- # killprocess 3689446 00:04:33.442 11:28:53 -- common/autotest_common.sh@936 -- # '[' -z 3689446 ']' 00:04:33.442 11:28:53 -- common/autotest_common.sh@940 -- # kill -0 3689446 00:04:33.442 11:28:53 -- common/autotest_common.sh@941 -- # uname 00:04:33.442 11:28:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:33.442 11:28:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3689446 00:04:33.442 11:28:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:33.442 11:28:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:33.442 11:28:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3689446' 00:04:33.442 killing process with pid 3689446 00:04:33.442 11:28:53 -- common/autotest_common.sh@955 -- # kill 3689446 00:04:33.442 11:28:53 -- common/autotest_common.sh@960 -- # wait 3689446 00:04:33.700 00:04:33.700 real 0m1.809s 00:04:33.700 user 0m1.952s 00:04:33.700 sys 0m0.557s 00:04:33.700 11:28:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.700 11:28:53 -- common/autotest_common.sh@10 -- # set +x 00:04:33.700 ************************************ 00:04:33.700 END TEST default_locks_via_rpc 00:04:33.700 ************************************ 00:04:33.700 11:28:53 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:04:33.700 11:28:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.700 11:28:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.700 11:28:53 -- common/autotest_common.sh@10 -- # set +x 00:04:33.700 ************************************ 00:04:33.700 START TEST non_locking_app_on_locked_coremask 00:04:33.700 ************************************ 00:04:33.700 11:28:53 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:04:33.700 11:28:53 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3689619 00:04:33.700 11:28:53 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:33.700 11:28:53 -- event/cpu_locks.sh@81 -- # waitforlisten 3689619 /var/tmp/spdk.sock 00:04:33.700 11:28:53 -- common/autotest_common.sh@829 -- # '[' -z 3689619 ']' 00:04:33.700 11:28:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:33.700 11:28:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:33.700 11:28:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:33.700 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:33.700 11:28:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:33.700 11:28:53 -- common/autotest_common.sh@10 -- # set +x 00:04:33.958 [2024-11-28 11:28:53.790325] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:33.958 [2024-11-28 11:28:53.790407] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3689619 ] 00:04:33.958 EAL: No free 2048 kB hugepages reported on node 1 00:04:33.958 [2024-11-28 11:28:53.851749] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:33.958 [2024-11-28 11:28:53.965834] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:33.958 [2024-11-28 11:28:53.966006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:34.892 11:28:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:34.892 11:28:54 -- common/autotest_common.sh@862 -- # return 0 00:04:34.892 11:28:54 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3689759 00:04:34.892 11:28:54 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:04:34.892 11:28:54 -- event/cpu_locks.sh@85 -- # waitforlisten 3689759 /var/tmp/spdk2.sock 00:04:34.892 11:28:54 -- common/autotest_common.sh@829 -- # '[' -z 3689759 ']' 00:04:34.892 11:28:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:34.892 11:28:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:34.892 11:28:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:34.892 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:34.892 11:28:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:34.892 11:28:54 -- common/autotest_common.sh@10 -- # set +x 00:04:34.892 [2024-11-28 11:28:54.781295] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:34.892 [2024-11-28 11:28:54.781370] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3689759 ] 00:04:34.892 EAL: No free 2048 kB hugepages reported on node 1 00:04:34.892 [2024-11-28 11:28:54.873647] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:34.892 [2024-11-28 11:28:54.873687] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:35.150 [2024-11-28 11:28:55.105828] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:35.150 [2024-11-28 11:28:55.106031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.715 11:28:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:35.715 11:28:55 -- common/autotest_common.sh@862 -- # return 0 00:04:35.715 11:28:55 -- event/cpu_locks.sh@87 -- # locks_exist 3689619 00:04:35.715 11:28:55 -- event/cpu_locks.sh@22 -- # lslocks -p 3689619 00:04:35.715 11:28:55 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:36.282 lslocks: write error 00:04:36.282 11:28:56 -- event/cpu_locks.sh@89 -- # killprocess 3689619 00:04:36.282 11:28:56 -- common/autotest_common.sh@936 -- # '[' -z 3689619 ']' 00:04:36.282 11:28:56 -- common/autotest_common.sh@940 -- # kill -0 3689619 00:04:36.282 11:28:56 -- common/autotest_common.sh@941 -- # uname 00:04:36.282 11:28:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:36.282 11:28:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3689619 00:04:36.282 11:28:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:36.282 11:28:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:36.282 11:28:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3689619' 00:04:36.282 killing process with pid 3689619 00:04:36.282 11:28:56 -- common/autotest_common.sh@955 -- # kill 3689619 00:04:36.282 11:28:56 -- common/autotest_common.sh@960 -- # wait 3689619 00:04:37.217 11:28:57 -- event/cpu_locks.sh@90 -- # killprocess 3689759 00:04:37.217 11:28:57 -- common/autotest_common.sh@936 -- # '[' -z 3689759 ']' 00:04:37.217 11:28:57 -- common/autotest_common.sh@940 -- # kill -0 3689759 00:04:37.217 11:28:57 -- common/autotest_common.sh@941 -- # uname 00:04:37.217 11:28:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:37.217 11:28:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3689759 00:04:37.217 11:28:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:37.217 11:28:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:37.217 11:28:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3689759' 00:04:37.217 killing process with pid 3689759 00:04:37.217 11:28:57 -- common/autotest_common.sh@955 -- # kill 3689759 00:04:37.217 11:28:57 -- common/autotest_common.sh@960 -- # wait 3689759 00:04:37.784 00:04:37.784 real 0m3.922s 00:04:37.784 user 0m4.262s 00:04:37.784 sys 0m1.097s 00:04:37.784 11:28:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:37.784 11:28:57 -- common/autotest_common.sh@10 -- # set +x 00:04:37.784 ************************************ 00:04:37.784 END TEST non_locking_app_on_locked_coremask 00:04:37.784 ************************************ 00:04:37.784 11:28:57 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:04:37.784 11:28:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.784 11:28:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.784 11:28:57 -- common/autotest_common.sh@10 -- # set +x 00:04:37.784 ************************************ 00:04:37.784 START TEST locking_app_on_unlocked_coremask 00:04:37.784 ************************************ 00:04:37.784 11:28:57 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:04:37.784 11:28:57 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3690200 00:04:37.784 11:28:57 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:04:37.784 11:28:57 -- event/cpu_locks.sh@99 -- # waitforlisten 3690200 /var/tmp/spdk.sock 00:04:37.784 11:28:57 -- common/autotest_common.sh@829 -- # '[' -z 3690200 ']' 00:04:37.784 11:28:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:37.784 11:28:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:37.784 11:28:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:37.784 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:37.784 11:28:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:37.784 11:28:57 -- common/autotest_common.sh@10 -- # set +x 00:04:37.784 [2024-11-28 11:28:57.740710] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:37.784 [2024-11-28 11:28:57.740797] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3690200 ] 00:04:37.784 EAL: No free 2048 kB hugepages reported on node 1 00:04:37.784 [2024-11-28 11:28:57.801550] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:37.784 [2024-11-28 11:28:57.801599] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:38.042 [2024-11-28 11:28:57.912263] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:38.042 [2024-11-28 11:28:57.912451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:38.977 11:28:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:38.977 11:28:58 -- common/autotest_common.sh@862 -- # return 0 00:04:38.977 11:28:58 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3690339 00:04:38.977 11:28:58 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:04:38.977 11:28:58 -- event/cpu_locks.sh@103 -- # waitforlisten 3690339 /var/tmp/spdk2.sock 00:04:38.977 11:28:58 -- common/autotest_common.sh@829 -- # '[' -z 3690339 ']' 00:04:38.977 11:28:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:38.977 11:28:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:38.977 11:28:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:38.977 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:38.977 11:28:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:38.977 11:28:58 -- common/autotest_common.sh@10 -- # set +x 00:04:38.977 [2024-11-28 11:28:58.740309] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:38.977 [2024-11-28 11:28:58.740381] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3690339 ] 00:04:38.977 EAL: No free 2048 kB hugepages reported on node 1 00:04:38.977 [2024-11-28 11:28:58.836513] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:39.236 [2024-11-28 11:28:59.077679] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:39.236 [2024-11-28 11:28:59.077864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:39.802 11:28:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:39.802 11:28:59 -- common/autotest_common.sh@862 -- # return 0 00:04:39.802 11:28:59 -- event/cpu_locks.sh@105 -- # locks_exist 3690339 00:04:39.802 11:28:59 -- event/cpu_locks.sh@22 -- # lslocks -p 3690339 00:04:39.802 11:28:59 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:40.060 lslocks: write error 00:04:40.060 11:29:00 -- event/cpu_locks.sh@107 -- # killprocess 3690200 00:04:40.060 11:29:00 -- common/autotest_common.sh@936 -- # '[' -z 3690200 ']' 00:04:40.060 11:29:00 -- common/autotest_common.sh@940 -- # kill -0 3690200 00:04:40.060 11:29:00 -- common/autotest_common.sh@941 -- # uname 00:04:40.060 11:29:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:40.060 11:29:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3690200 00:04:40.319 11:29:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:40.319 11:29:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:40.319 11:29:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3690200' 00:04:40.319 killing process with pid 3690200 00:04:40.319 11:29:00 -- common/autotest_common.sh@955 -- # kill 3690200 00:04:40.319 11:29:00 -- common/autotest_common.sh@960 -- # wait 3690200 00:04:41.253 11:29:01 -- event/cpu_locks.sh@108 -- # killprocess 3690339 00:04:41.253 11:29:01 -- common/autotest_common.sh@936 -- # '[' -z 3690339 ']' 00:04:41.253 11:29:01 -- common/autotest_common.sh@940 -- # kill -0 3690339 00:04:41.253 11:29:01 -- common/autotest_common.sh@941 -- # uname 00:04:41.253 11:29:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:41.253 11:29:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3690339 00:04:41.253 11:29:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:41.253 11:29:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:41.253 11:29:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3690339' 00:04:41.253 killing process with pid 3690339 00:04:41.253 11:29:01 -- common/autotest_common.sh@955 -- # kill 3690339 00:04:41.253 11:29:01 -- common/autotest_common.sh@960 -- # wait 3690339 00:04:41.512 00:04:41.512 real 0m3.872s 00:04:41.512 user 0m4.302s 00:04:41.512 sys 0m1.054s 00:04:41.512 11:29:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:41.512 11:29:01 -- common/autotest_common.sh@10 -- # set +x 00:04:41.512 ************************************ 00:04:41.512 END TEST locking_app_on_unlocked_coremask 00:04:41.512 ************************************ 00:04:41.771 11:29:01 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:04:41.771 11:29:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:41.771 11:29:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:41.771 11:29:01 -- common/autotest_common.sh@10 -- # set +x 00:04:41.771 ************************************ 00:04:41.771 START TEST locking_app_on_locked_coremask 00:04:41.771 ************************************ 00:04:41.771 11:29:01 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:04:41.771 11:29:01 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3690652 00:04:41.771 11:29:01 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:41.771 11:29:01 -- event/cpu_locks.sh@116 -- # waitforlisten 3690652 /var/tmp/spdk.sock 00:04:41.771 11:29:01 -- common/autotest_common.sh@829 -- # '[' -z 3690652 ']' 00:04:41.771 11:29:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:41.771 11:29:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:41.771 11:29:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:41.771 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:41.771 11:29:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:41.771 11:29:01 -- common/autotest_common.sh@10 -- # set +x 00:04:41.771 [2024-11-28 11:29:01.643739] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:41.771 [2024-11-28 11:29:01.643849] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3690652 ] 00:04:41.771 EAL: No free 2048 kB hugepages reported on node 1 00:04:41.771 [2024-11-28 11:29:01.706364] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:41.771 [2024-11-28 11:29:01.819257] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:41.771 [2024-11-28 11:29:01.819446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:42.704 11:29:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:42.704 11:29:02 -- common/autotest_common.sh@862 -- # return 0 00:04:42.704 11:29:02 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3690788 00:04:42.704 11:29:02 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:04:42.704 11:29:02 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3690788 /var/tmp/spdk2.sock 00:04:42.704 11:29:02 -- common/autotest_common.sh@650 -- # local es=0 00:04:42.704 11:29:02 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3690788 /var/tmp/spdk2.sock 00:04:42.704 11:29:02 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:42.704 11:29:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:42.704 11:29:02 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:42.704 11:29:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:42.704 11:29:02 -- common/autotest_common.sh@653 -- # waitforlisten 3690788 /var/tmp/spdk2.sock 00:04:42.704 11:29:02 -- common/autotest_common.sh@829 -- # '[' -z 3690788 ']' 00:04:42.705 11:29:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:42.705 11:29:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:42.705 11:29:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:42.705 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:42.705 11:29:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:42.705 11:29:02 -- common/autotest_common.sh@10 -- # set +x 00:04:42.705 [2024-11-28 11:29:02.635797] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:42.705 [2024-11-28 11:29:02.635883] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3690788 ] 00:04:42.705 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.705 [2024-11-28 11:29:02.728621] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3690652 has claimed it. 00:04:42.705 [2024-11-28 11:29:02.728678] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:04:43.639 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3690788) - No such process 00:04:43.639 ERROR: process (pid: 3690788) is no longer running 00:04:43.639 11:29:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:43.639 11:29:03 -- common/autotest_common.sh@862 -- # return 1 00:04:43.639 11:29:03 -- common/autotest_common.sh@653 -- # es=1 00:04:43.639 11:29:03 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:43.639 11:29:03 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:43.639 11:29:03 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:43.639 11:29:03 -- event/cpu_locks.sh@122 -- # locks_exist 3690652 00:04:43.639 11:29:03 -- event/cpu_locks.sh@22 -- # lslocks -p 3690652 00:04:43.639 11:29:03 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:43.639 lslocks: write error 00:04:43.639 11:29:03 -- event/cpu_locks.sh@124 -- # killprocess 3690652 00:04:43.639 11:29:03 -- common/autotest_common.sh@936 -- # '[' -z 3690652 ']' 00:04:43.639 11:29:03 -- common/autotest_common.sh@940 -- # kill -0 3690652 00:04:43.639 11:29:03 -- common/autotest_common.sh@941 -- # uname 00:04:43.639 11:29:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:43.639 11:29:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3690652 00:04:43.639 11:29:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:43.639 11:29:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:43.639 11:29:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3690652' 00:04:43.639 killing process with pid 3690652 00:04:43.639 11:29:03 -- common/autotest_common.sh@955 -- # kill 3690652 00:04:43.639 11:29:03 -- common/autotest_common.sh@960 -- # wait 3690652 00:04:44.205 00:04:44.205 real 0m2.515s 00:04:44.205 user 0m2.844s 00:04:44.205 sys 0m0.668s 00:04:44.205 11:29:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:44.205 11:29:04 -- common/autotest_common.sh@10 -- # set +x 00:04:44.205 ************************************ 00:04:44.205 END TEST locking_app_on_locked_coremask 00:04:44.205 ************************************ 00:04:44.205 11:29:04 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:04:44.205 11:29:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:44.205 11:29:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.205 11:29:04 -- common/autotest_common.sh@10 -- # set +x 00:04:44.205 ************************************ 00:04:44.205 START TEST locking_overlapped_coremask 00:04:44.205 ************************************ 00:04:44.205 11:29:04 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:04:44.205 11:29:04 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3690962 00:04:44.205 11:29:04 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:04:44.205 11:29:04 -- event/cpu_locks.sh@133 -- # waitforlisten 3690962 /var/tmp/spdk.sock 00:04:44.205 11:29:04 -- common/autotest_common.sh@829 -- # '[' -z 3690962 ']' 00:04:44.205 11:29:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:44.205 11:29:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:44.205 11:29:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:44.205 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:44.205 11:29:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:44.205 11:29:04 -- common/autotest_common.sh@10 -- # set +x 00:04:44.205 [2024-11-28 11:29:04.182411] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:44.205 [2024-11-28 11:29:04.182502] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3690962 ] 00:04:44.205 EAL: No free 2048 kB hugepages reported on node 1 00:04:44.205 [2024-11-28 11:29:04.240326] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:44.464 [2024-11-28 11:29:04.348219] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:44.464 [2024-11-28 11:29:04.348439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:44.464 [2024-11-28 11:29:04.348507] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:44.464 [2024-11-28 11:29:04.348510] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:45.397 11:29:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:45.397 11:29:05 -- common/autotest_common.sh@862 -- # return 0 00:04:45.397 11:29:05 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3691100 00:04:45.397 11:29:05 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3691100 /var/tmp/spdk2.sock 00:04:45.397 11:29:05 -- common/autotest_common.sh@650 -- # local es=0 00:04:45.397 11:29:05 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3691100 /var/tmp/spdk2.sock 00:04:45.397 11:29:05 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:45.397 11:29:05 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:04:45.397 11:29:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:45.397 11:29:05 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:45.397 11:29:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:45.397 11:29:05 -- common/autotest_common.sh@653 -- # waitforlisten 3691100 /var/tmp/spdk2.sock 00:04:45.397 11:29:05 -- common/autotest_common.sh@829 -- # '[' -z 3691100 ']' 00:04:45.397 11:29:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:45.397 11:29:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:45.397 11:29:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:45.397 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:45.397 11:29:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:45.397 11:29:05 -- common/autotest_common.sh@10 -- # set +x 00:04:45.397 [2024-11-28 11:29:05.185030] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:45.397 [2024-11-28 11:29:05.185110] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3691100 ] 00:04:45.397 EAL: No free 2048 kB hugepages reported on node 1 00:04:45.397 [2024-11-28 11:29:05.273060] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3690962 has claimed it. 00:04:45.397 [2024-11-28 11:29:05.273124] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:04:45.962 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3691100) - No such process 00:04:45.962 ERROR: process (pid: 3691100) is no longer running 00:04:45.962 11:29:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:45.962 11:29:05 -- common/autotest_common.sh@862 -- # return 1 00:04:45.962 11:29:05 -- common/autotest_common.sh@653 -- # es=1 00:04:45.962 11:29:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:45.962 11:29:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:45.962 11:29:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:45.962 11:29:05 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:04:45.962 11:29:05 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:04:45.963 11:29:05 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:04:45.963 11:29:05 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:04:45.963 11:29:05 -- event/cpu_locks.sh@141 -- # killprocess 3690962 00:04:45.963 11:29:05 -- common/autotest_common.sh@936 -- # '[' -z 3690962 ']' 00:04:45.963 11:29:05 -- common/autotest_common.sh@940 -- # kill -0 3690962 00:04:45.963 11:29:05 -- common/autotest_common.sh@941 -- # uname 00:04:45.963 11:29:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:45.963 11:29:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3690962 00:04:45.963 11:29:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:45.963 11:29:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:45.963 11:29:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3690962' 00:04:45.963 killing process with pid 3690962 00:04:45.963 11:29:05 -- common/autotest_common.sh@955 -- # kill 3690962 00:04:45.963 11:29:05 -- common/autotest_common.sh@960 -- # wait 3690962 00:04:46.530 00:04:46.530 real 0m2.267s 00:04:46.530 user 0m6.464s 00:04:46.530 sys 0m0.483s 00:04:46.530 11:29:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.530 11:29:06 -- common/autotest_common.sh@10 -- # set +x 00:04:46.530 ************************************ 00:04:46.530 END TEST locking_overlapped_coremask 00:04:46.530 ************************************ 00:04:46.530 11:29:06 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:04:46.530 11:29:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:46.530 11:29:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.530 11:29:06 -- common/autotest_common.sh@10 -- # set +x 00:04:46.530 ************************************ 00:04:46.530 START TEST locking_overlapped_coremask_via_rpc 00:04:46.530 ************************************ 00:04:46.530 11:29:06 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:04:46.530 11:29:06 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3691290 00:04:46.530 11:29:06 -- event/cpu_locks.sh@149 -- # waitforlisten 3691290 /var/tmp/spdk.sock 00:04:46.530 11:29:06 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:04:46.530 11:29:06 -- common/autotest_common.sh@829 -- # '[' -z 3691290 ']' 00:04:46.530 11:29:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:46.530 11:29:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:46.530 11:29:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:46.530 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:46.530 11:29:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:46.530 11:29:06 -- common/autotest_common.sh@10 -- # set +x 00:04:46.530 [2024-11-28 11:29:06.479136] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:46.530 [2024-11-28 11:29:06.479224] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3691290 ] 00:04:46.530 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.530 [2024-11-28 11:29:06.542994] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:46.530 [2024-11-28 11:29:06.543039] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:46.788 [2024-11-28 11:29:06.665254] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:46.788 [2024-11-28 11:29:06.665486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:46.788 [2024-11-28 11:29:06.665554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:46.788 [2024-11-28 11:29:06.665559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:47.723 11:29:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:47.723 11:29:07 -- common/autotest_common.sh@862 -- # return 0 00:04:47.723 11:29:07 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3691410 00:04:47.723 11:29:07 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:04:47.723 11:29:07 -- event/cpu_locks.sh@153 -- # waitforlisten 3691410 /var/tmp/spdk2.sock 00:04:47.723 11:29:07 -- common/autotest_common.sh@829 -- # '[' -z 3691410 ']' 00:04:47.723 11:29:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:47.723 11:29:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:47.723 11:29:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:47.723 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:47.723 11:29:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:47.723 11:29:07 -- common/autotest_common.sh@10 -- # set +x 00:04:47.723 [2024-11-28 11:29:07.474805] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:47.723 [2024-11-28 11:29:07.474908] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3691410 ] 00:04:47.723 EAL: No free 2048 kB hugepages reported on node 1 00:04:47.723 [2024-11-28 11:29:07.562502] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:47.723 [2024-11-28 11:29:07.562577] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:47.981 [2024-11-28 11:29:07.781132] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:47.981 [2024-11-28 11:29:07.781321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:47.981 [2024-11-28 11:29:07.781373] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:04:47.981 [2024-11-28 11:29:07.781378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:48.547 11:29:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:48.547 11:29:08 -- common/autotest_common.sh@862 -- # return 0 00:04:48.547 11:29:08 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:04:48.547 11:29:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.547 11:29:08 -- common/autotest_common.sh@10 -- # set +x 00:04:48.547 11:29:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.547 11:29:08 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:48.547 11:29:08 -- common/autotest_common.sh@650 -- # local es=0 00:04:48.547 11:29:08 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:48.547 11:29:08 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:04:48.547 11:29:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:48.547 11:29:08 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:04:48.547 11:29:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:48.547 11:29:08 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:48.547 11:29:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.547 11:29:08 -- common/autotest_common.sh@10 -- # set +x 00:04:48.547 [2024-11-28 11:29:08.455628] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3691290 has claimed it. 00:04:48.547 request: 00:04:48.547 { 00:04:48.547 "method": "framework_enable_cpumask_locks", 00:04:48.547 "req_id": 1 00:04:48.547 } 00:04:48.547 Got JSON-RPC error response 00:04:48.547 response: 00:04:48.547 { 00:04:48.547 "code": -32603, 00:04:48.547 "message": "Failed to claim CPU core: 2" 00:04:48.547 } 00:04:48.547 11:29:08 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:04:48.547 11:29:08 -- common/autotest_common.sh@653 -- # es=1 00:04:48.547 11:29:08 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:48.547 11:29:08 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:48.547 11:29:08 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:48.547 11:29:08 -- event/cpu_locks.sh@158 -- # waitforlisten 3691290 /var/tmp/spdk.sock 00:04:48.547 11:29:08 -- common/autotest_common.sh@829 -- # '[' -z 3691290 ']' 00:04:48.547 11:29:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:48.547 11:29:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:48.547 11:29:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:48.547 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:48.547 11:29:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:48.547 11:29:08 -- common/autotest_common.sh@10 -- # set +x 00:04:48.805 11:29:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:48.806 11:29:08 -- common/autotest_common.sh@862 -- # return 0 00:04:48.806 11:29:08 -- event/cpu_locks.sh@159 -- # waitforlisten 3691410 /var/tmp/spdk2.sock 00:04:48.806 11:29:08 -- common/autotest_common.sh@829 -- # '[' -z 3691410 ']' 00:04:48.806 11:29:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:48.806 11:29:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:48.806 11:29:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:48.806 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:48.806 11:29:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:48.806 11:29:08 -- common/autotest_common.sh@10 -- # set +x 00:04:49.064 11:29:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:49.064 11:29:08 -- common/autotest_common.sh@862 -- # return 0 00:04:49.064 11:29:08 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:04:49.064 11:29:08 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:04:49.064 11:29:08 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:04:49.064 11:29:08 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:04:49.064 00:04:49.064 real 0m2.564s 00:04:49.064 user 0m1.291s 00:04:49.064 sys 0m0.198s 00:04:49.064 11:29:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.064 11:29:08 -- common/autotest_common.sh@10 -- # set +x 00:04:49.064 ************************************ 00:04:49.064 END TEST locking_overlapped_coremask_via_rpc 00:04:49.064 ************************************ 00:04:49.064 11:29:09 -- event/cpu_locks.sh@174 -- # cleanup 00:04:49.064 11:29:09 -- event/cpu_locks.sh@15 -- # [[ -z 3691290 ]] 00:04:49.064 11:29:09 -- event/cpu_locks.sh@15 -- # killprocess 3691290 00:04:49.064 11:29:09 -- common/autotest_common.sh@936 -- # '[' -z 3691290 ']' 00:04:49.064 11:29:09 -- common/autotest_common.sh@940 -- # kill -0 3691290 00:04:49.064 11:29:09 -- common/autotest_common.sh@941 -- # uname 00:04:49.064 11:29:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:49.064 11:29:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3691290 00:04:49.064 11:29:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:49.064 11:29:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:49.064 11:29:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3691290' 00:04:49.064 killing process with pid 3691290 00:04:49.064 11:29:09 -- common/autotest_common.sh@955 -- # kill 3691290 00:04:49.064 11:29:09 -- common/autotest_common.sh@960 -- # wait 3691290 00:04:49.627 11:29:09 -- event/cpu_locks.sh@16 -- # [[ -z 3691410 ]] 00:04:49.627 11:29:09 -- event/cpu_locks.sh@16 -- # killprocess 3691410 00:04:49.627 11:29:09 -- common/autotest_common.sh@936 -- # '[' -z 3691410 ']' 00:04:49.627 11:29:09 -- common/autotest_common.sh@940 -- # kill -0 3691410 00:04:49.627 11:29:09 -- common/autotest_common.sh@941 -- # uname 00:04:49.627 11:29:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:49.627 11:29:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3691410 00:04:49.627 11:29:09 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:49.627 11:29:09 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:49.627 11:29:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3691410' 00:04:49.627 killing process with pid 3691410 00:04:49.627 11:29:09 -- common/autotest_common.sh@955 -- # kill 3691410 00:04:49.627 11:29:09 -- common/autotest_common.sh@960 -- # wait 3691410 00:04:50.192 11:29:09 -- event/cpu_locks.sh@18 -- # rm -f 00:04:50.192 11:29:09 -- event/cpu_locks.sh@1 -- # cleanup 00:04:50.192 11:29:09 -- event/cpu_locks.sh@15 -- # [[ -z 3691290 ]] 00:04:50.192 11:29:09 -- event/cpu_locks.sh@15 -- # killprocess 3691290 00:04:50.192 11:29:09 -- common/autotest_common.sh@936 -- # '[' -z 3691290 ']' 00:04:50.192 11:29:09 -- common/autotest_common.sh@940 -- # kill -0 3691290 00:04:50.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3691290) - No such process 00:04:50.192 11:29:09 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3691290 is not found' 00:04:50.192 Process with pid 3691290 is not found 00:04:50.192 11:29:09 -- event/cpu_locks.sh@16 -- # [[ -z 3691410 ]] 00:04:50.192 11:29:09 -- event/cpu_locks.sh@16 -- # killprocess 3691410 00:04:50.192 11:29:09 -- common/autotest_common.sh@936 -- # '[' -z 3691410 ']' 00:04:50.192 11:29:09 -- common/autotest_common.sh@940 -- # kill -0 3691410 00:04:50.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3691410) - No such process 00:04:50.192 11:29:09 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3691410 is not found' 00:04:50.192 Process with pid 3691410 is not found 00:04:50.192 11:29:09 -- event/cpu_locks.sh@18 -- # rm -f 00:04:50.192 00:04:50.192 real 0m20.021s 00:04:50.192 user 0m35.917s 00:04:50.192 sys 0m5.471s 00:04:50.192 11:29:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.193 11:29:09 -- common/autotest_common.sh@10 -- # set +x 00:04:50.193 ************************************ 00:04:50.193 END TEST cpu_locks 00:04:50.193 ************************************ 00:04:50.193 00:04:50.193 real 0m47.107s 00:04:50.193 user 1m29.822s 00:04:50.193 sys 0m9.445s 00:04:50.193 11:29:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.193 11:29:10 -- common/autotest_common.sh@10 -- # set +x 00:04:50.193 ************************************ 00:04:50.193 END TEST event 00:04:50.193 ************************************ 00:04:50.193 11:29:10 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:04:50.193 11:29:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.193 11:29:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.193 11:29:10 -- common/autotest_common.sh@10 -- # set +x 00:04:50.193 ************************************ 00:04:50.193 START TEST thread 00:04:50.193 ************************************ 00:04:50.193 11:29:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:04:50.193 * Looking for test storage... 00:04:50.193 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:04:50.193 11:29:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:50.193 11:29:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:50.193 11:29:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:50.193 11:29:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:50.193 11:29:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:50.193 11:29:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:50.193 11:29:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:50.193 11:29:10 -- scripts/common.sh@335 -- # IFS=.-: 00:04:50.193 11:29:10 -- scripts/common.sh@335 -- # read -ra ver1 00:04:50.193 11:29:10 -- scripts/common.sh@336 -- # IFS=.-: 00:04:50.193 11:29:10 -- scripts/common.sh@336 -- # read -ra ver2 00:04:50.193 11:29:10 -- scripts/common.sh@337 -- # local 'op=<' 00:04:50.193 11:29:10 -- scripts/common.sh@339 -- # ver1_l=2 00:04:50.193 11:29:10 -- scripts/common.sh@340 -- # ver2_l=1 00:04:50.193 11:29:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:50.193 11:29:10 -- scripts/common.sh@343 -- # case "$op" in 00:04:50.193 11:29:10 -- scripts/common.sh@344 -- # : 1 00:04:50.193 11:29:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:50.193 11:29:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:50.193 11:29:10 -- scripts/common.sh@364 -- # decimal 1 00:04:50.193 11:29:10 -- scripts/common.sh@352 -- # local d=1 00:04:50.193 11:29:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:50.193 11:29:10 -- scripts/common.sh@354 -- # echo 1 00:04:50.193 11:29:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:50.193 11:29:10 -- scripts/common.sh@365 -- # decimal 2 00:04:50.193 11:29:10 -- scripts/common.sh@352 -- # local d=2 00:04:50.193 11:29:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:50.193 11:29:10 -- scripts/common.sh@354 -- # echo 2 00:04:50.193 11:29:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:50.193 11:29:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:50.193 11:29:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:50.193 11:29:10 -- scripts/common.sh@367 -- # return 0 00:04:50.193 11:29:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:50.193 11:29:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:50.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.193 --rc genhtml_branch_coverage=1 00:04:50.193 --rc genhtml_function_coverage=1 00:04:50.193 --rc genhtml_legend=1 00:04:50.193 --rc geninfo_all_blocks=1 00:04:50.193 --rc geninfo_unexecuted_blocks=1 00:04:50.193 00:04:50.193 ' 00:04:50.193 11:29:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:50.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.193 --rc genhtml_branch_coverage=1 00:04:50.193 --rc genhtml_function_coverage=1 00:04:50.193 --rc genhtml_legend=1 00:04:50.193 --rc geninfo_all_blocks=1 00:04:50.193 --rc geninfo_unexecuted_blocks=1 00:04:50.193 00:04:50.193 ' 00:04:50.193 11:29:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:50.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.193 --rc genhtml_branch_coverage=1 00:04:50.193 --rc genhtml_function_coverage=1 00:04:50.193 --rc genhtml_legend=1 00:04:50.193 --rc geninfo_all_blocks=1 00:04:50.193 --rc geninfo_unexecuted_blocks=1 00:04:50.193 00:04:50.193 ' 00:04:50.193 11:29:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:50.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.193 --rc genhtml_branch_coverage=1 00:04:50.193 --rc genhtml_function_coverage=1 00:04:50.193 --rc genhtml_legend=1 00:04:50.193 --rc geninfo_all_blocks=1 00:04:50.193 --rc geninfo_unexecuted_blocks=1 00:04:50.193 00:04:50.193 ' 00:04:50.193 11:29:10 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:04:50.193 11:29:10 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:04:50.193 11:29:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.193 11:29:10 -- common/autotest_common.sh@10 -- # set +x 00:04:50.193 ************************************ 00:04:50.193 START TEST thread_poller_perf 00:04:50.193 ************************************ 00:04:50.193 11:29:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:04:50.193 [2024-11-28 11:29:10.192018] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:50.193 [2024-11-28 11:29:10.192109] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3691918 ] 00:04:50.193 EAL: No free 2048 kB hugepages reported on node 1 00:04:50.451 [2024-11-28 11:29:10.253140] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:50.451 [2024-11-28 11:29:10.367474] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:50.451 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:04:51.824 [2024-11-28T10:29:11.880Z] ====================================== 00:04:51.824 [2024-11-28T10:29:11.880Z] busy:2712157745 (cyc) 00:04:51.824 [2024-11-28T10:29:11.880Z] total_run_count: 281000 00:04:51.824 [2024-11-28T10:29:11.880Z] tsc_hz: 2700000000 (cyc) 00:04:51.824 [2024-11-28T10:29:11.880Z] ====================================== 00:04:51.824 [2024-11-28T10:29:11.880Z] poller_cost: 9651 (cyc), 3574 (nsec) 00:04:51.824 00:04:51.824 real 0m1.324s 00:04:51.824 user 0m1.232s 00:04:51.824 sys 0m0.085s 00:04:51.824 11:29:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:51.824 11:29:11 -- common/autotest_common.sh@10 -- # set +x 00:04:51.824 ************************************ 00:04:51.824 END TEST thread_poller_perf 00:04:51.824 ************************************ 00:04:51.824 11:29:11 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:04:51.824 11:29:11 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:04:51.824 11:29:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.824 11:29:11 -- common/autotest_common.sh@10 -- # set +x 00:04:51.824 ************************************ 00:04:51.824 START TEST thread_poller_perf 00:04:51.824 ************************************ 00:04:51.824 11:29:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:04:51.824 [2024-11-28 11:29:11.543657] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:51.824 [2024-11-28 11:29:11.543745] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3692074 ] 00:04:51.824 EAL: No free 2048 kB hugepages reported on node 1 00:04:51.824 [2024-11-28 11:29:11.608038] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:51.824 [2024-11-28 11:29:11.722310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.824 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:04:53.195 [2024-11-28T10:29:13.251Z] ====================================== 00:04:53.195 [2024-11-28T10:29:13.251Z] busy:2703781227 (cyc) 00:04:53.195 [2024-11-28T10:29:13.251Z] total_run_count: 3824000 00:04:53.195 [2024-11-28T10:29:13.251Z] tsc_hz: 2700000000 (cyc) 00:04:53.195 [2024-11-28T10:29:13.251Z] ====================================== 00:04:53.195 [2024-11-28T10:29:13.251Z] poller_cost: 707 (cyc), 261 (nsec) 00:04:53.195 00:04:53.195 real 0m1.320s 00:04:53.195 user 0m1.229s 00:04:53.195 sys 0m0.083s 00:04:53.195 11:29:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:53.195 11:29:12 -- common/autotest_common.sh@10 -- # set +x 00:04:53.195 ************************************ 00:04:53.195 END TEST thread_poller_perf 00:04:53.195 ************************************ 00:04:53.195 11:29:12 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:04:53.195 00:04:53.195 real 0m2.833s 00:04:53.195 user 0m2.569s 00:04:53.195 sys 0m0.267s 00:04:53.195 11:29:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:53.196 11:29:12 -- common/autotest_common.sh@10 -- # set +x 00:04:53.196 ************************************ 00:04:53.196 END TEST thread 00:04:53.196 ************************************ 00:04:53.196 11:29:12 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:04:53.196 11:29:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:53.196 11:29:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:53.196 11:29:12 -- common/autotest_common.sh@10 -- # set +x 00:04:53.196 ************************************ 00:04:53.196 START TEST accel 00:04:53.196 ************************************ 00:04:53.196 11:29:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:04:53.196 * Looking for test storage... 00:04:53.196 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:04:53.196 11:29:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:53.196 11:29:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:53.196 11:29:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:53.196 11:29:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:53.196 11:29:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:53.196 11:29:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:53.196 11:29:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:53.196 11:29:13 -- scripts/common.sh@335 -- # IFS=.-: 00:04:53.196 11:29:13 -- scripts/common.sh@335 -- # read -ra ver1 00:04:53.196 11:29:13 -- scripts/common.sh@336 -- # IFS=.-: 00:04:53.196 11:29:13 -- scripts/common.sh@336 -- # read -ra ver2 00:04:53.196 11:29:13 -- scripts/common.sh@337 -- # local 'op=<' 00:04:53.196 11:29:13 -- scripts/common.sh@339 -- # ver1_l=2 00:04:53.196 11:29:13 -- scripts/common.sh@340 -- # ver2_l=1 00:04:53.196 11:29:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:53.196 11:29:13 -- scripts/common.sh@343 -- # case "$op" in 00:04:53.196 11:29:13 -- scripts/common.sh@344 -- # : 1 00:04:53.196 11:29:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:53.196 11:29:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:53.196 11:29:13 -- scripts/common.sh@364 -- # decimal 1 00:04:53.196 11:29:13 -- scripts/common.sh@352 -- # local d=1 00:04:53.196 11:29:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:53.196 11:29:13 -- scripts/common.sh@354 -- # echo 1 00:04:53.196 11:29:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:53.196 11:29:13 -- scripts/common.sh@365 -- # decimal 2 00:04:53.196 11:29:13 -- scripts/common.sh@352 -- # local d=2 00:04:53.196 11:29:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:53.196 11:29:13 -- scripts/common.sh@354 -- # echo 2 00:04:53.196 11:29:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:53.196 11:29:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:53.196 11:29:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:53.196 11:29:13 -- scripts/common.sh@367 -- # return 0 00:04:53.196 11:29:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:53.196 11:29:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:53.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:53.196 --rc genhtml_branch_coverage=1 00:04:53.196 --rc genhtml_function_coverage=1 00:04:53.196 --rc genhtml_legend=1 00:04:53.196 --rc geninfo_all_blocks=1 00:04:53.196 --rc geninfo_unexecuted_blocks=1 00:04:53.196 00:04:53.196 ' 00:04:53.196 11:29:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:53.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:53.196 --rc genhtml_branch_coverage=1 00:04:53.196 --rc genhtml_function_coverage=1 00:04:53.196 --rc genhtml_legend=1 00:04:53.196 --rc geninfo_all_blocks=1 00:04:53.196 --rc geninfo_unexecuted_blocks=1 00:04:53.196 00:04:53.196 ' 00:04:53.196 11:29:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:53.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:53.196 --rc genhtml_branch_coverage=1 00:04:53.196 --rc genhtml_function_coverage=1 00:04:53.196 --rc genhtml_legend=1 00:04:53.196 --rc geninfo_all_blocks=1 00:04:53.196 --rc geninfo_unexecuted_blocks=1 00:04:53.196 00:04:53.196 ' 00:04:53.196 11:29:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:53.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:53.196 --rc genhtml_branch_coverage=1 00:04:53.196 --rc genhtml_function_coverage=1 00:04:53.196 --rc genhtml_legend=1 00:04:53.196 --rc geninfo_all_blocks=1 00:04:53.196 --rc geninfo_unexecuted_blocks=1 00:04:53.196 00:04:53.196 ' 00:04:53.196 11:29:13 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:04:53.196 11:29:13 -- accel/accel.sh@74 -- # get_expected_opcs 00:04:53.196 11:29:13 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:53.196 11:29:13 -- accel/accel.sh@59 -- # spdk_tgt_pid=3692280 00:04:53.196 11:29:13 -- accel/accel.sh@60 -- # waitforlisten 3692280 00:04:53.196 11:29:13 -- common/autotest_common.sh@829 -- # '[' -z 3692280 ']' 00:04:53.196 11:29:13 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:04:53.196 11:29:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:53.196 11:29:13 -- accel/accel.sh@58 -- # build_accel_config 00:04:53.196 11:29:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:53.196 11:29:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:53.196 11:29:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:53.196 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:53.196 11:29:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:53.196 11:29:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:53.196 11:29:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:53.196 11:29:13 -- common/autotest_common.sh@10 -- # set +x 00:04:53.196 11:29:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:53.196 11:29:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:53.196 11:29:13 -- accel/accel.sh@41 -- # local IFS=, 00:04:53.196 11:29:13 -- accel/accel.sh@42 -- # jq -r . 00:04:53.196 [2024-11-28 11:29:13.085607] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:53.196 [2024-11-28 11:29:13.085692] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3692280 ] 00:04:53.196 EAL: No free 2048 kB hugepages reported on node 1 00:04:53.196 [2024-11-28 11:29:13.159278] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:53.455 [2024-11-28 11:29:13.294994] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:53.455 [2024-11-28 11:29:13.295202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.389 11:29:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:54.389 11:29:14 -- common/autotest_common.sh@862 -- # return 0 00:04:54.389 11:29:14 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:04:54.389 11:29:14 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:04:54.389 11:29:14 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:04:54.389 11:29:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:54.389 11:29:14 -- common/autotest_common.sh@10 -- # set +x 00:04:54.389 11:29:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:54.389 11:29:14 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # IFS== 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # read -r opc module 00:04:54.389 11:29:14 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:54.389 11:29:14 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # IFS== 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # read -r opc module 00:04:54.389 11:29:14 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:54.389 11:29:14 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # IFS== 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # read -r opc module 00:04:54.389 11:29:14 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:54.389 11:29:14 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # IFS== 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # read -r opc module 00:04:54.389 11:29:14 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:54.389 11:29:14 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # IFS== 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # read -r opc module 00:04:54.389 11:29:14 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:54.389 11:29:14 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # IFS== 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # read -r opc module 00:04:54.389 11:29:14 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:54.389 11:29:14 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # IFS== 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # read -r opc module 00:04:54.389 11:29:14 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:54.389 11:29:14 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # IFS== 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # read -r opc module 00:04:54.389 11:29:14 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:54.389 11:29:14 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # IFS== 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # read -r opc module 00:04:54.389 11:29:14 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:54.389 11:29:14 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # IFS== 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # read -r opc module 00:04:54.389 11:29:14 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:54.389 11:29:14 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # IFS== 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # read -r opc module 00:04:54.389 11:29:14 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:54.389 11:29:14 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # IFS== 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # read -r opc module 00:04:54.389 11:29:14 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:54.389 11:29:14 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # IFS== 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # read -r opc module 00:04:54.389 11:29:14 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:54.389 11:29:14 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # IFS== 00:04:54.389 11:29:14 -- accel/accel.sh@64 -- # read -r opc module 00:04:54.389 11:29:14 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:54.389 11:29:14 -- accel/accel.sh@67 -- # killprocess 3692280 00:04:54.389 11:29:14 -- common/autotest_common.sh@936 -- # '[' -z 3692280 ']' 00:04:54.389 11:29:14 -- common/autotest_common.sh@940 -- # kill -0 3692280 00:04:54.389 11:29:14 -- common/autotest_common.sh@941 -- # uname 00:04:54.389 11:29:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:54.389 11:29:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3692280 00:04:54.389 11:29:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:54.389 11:29:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:54.389 11:29:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3692280' 00:04:54.389 killing process with pid 3692280 00:04:54.389 11:29:14 -- common/autotest_common.sh@955 -- # kill 3692280 00:04:54.389 11:29:14 -- common/autotest_common.sh@960 -- # wait 3692280 00:04:54.648 11:29:14 -- accel/accel.sh@68 -- # trap - ERR 00:04:54.648 11:29:14 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:04:54.648 11:29:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:04:54.648 11:29:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:54.648 11:29:14 -- common/autotest_common.sh@10 -- # set +x 00:04:54.648 11:29:14 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:04:54.648 11:29:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:04:54.648 11:29:14 -- accel/accel.sh@12 -- # build_accel_config 00:04:54.648 11:29:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:54.648 11:29:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:54.648 11:29:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:54.648 11:29:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:54.648 11:29:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:54.648 11:29:14 -- accel/accel.sh@41 -- # local IFS=, 00:04:54.648 11:29:14 -- accel/accel.sh@42 -- # jq -r . 00:04:54.648 11:29:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:54.648 11:29:14 -- common/autotest_common.sh@10 -- # set +x 00:04:54.907 11:29:14 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:04:54.907 11:29:14 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:04:54.907 11:29:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:54.907 11:29:14 -- common/autotest_common.sh@10 -- # set +x 00:04:54.907 ************************************ 00:04:54.907 START TEST accel_missing_filename 00:04:54.907 ************************************ 00:04:54.907 11:29:14 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:04:54.907 11:29:14 -- common/autotest_common.sh@650 -- # local es=0 00:04:54.907 11:29:14 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:04:54.907 11:29:14 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:54.907 11:29:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:54.907 11:29:14 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:54.907 11:29:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:54.907 11:29:14 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:04:54.907 11:29:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:04:54.907 11:29:14 -- accel/accel.sh@12 -- # build_accel_config 00:04:54.907 11:29:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:54.907 11:29:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:54.907 11:29:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:54.907 11:29:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:54.907 11:29:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:54.907 11:29:14 -- accel/accel.sh@41 -- # local IFS=, 00:04:54.907 11:29:14 -- accel/accel.sh@42 -- # jq -r . 00:04:54.908 [2024-11-28 11:29:14.736390] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:54.908 [2024-11-28 11:29:14.736478] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3692581 ] 00:04:54.908 EAL: No free 2048 kB hugepages reported on node 1 00:04:54.908 [2024-11-28 11:29:14.800505] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:54.908 [2024-11-28 11:29:14.917361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:55.166 [2024-11-28 11:29:14.979650] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:55.166 [2024-11-28 11:29:15.066196] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:04:55.166 A filename is required. 00:04:55.166 11:29:15 -- common/autotest_common.sh@653 -- # es=234 00:04:55.166 11:29:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:55.166 11:29:15 -- common/autotest_common.sh@662 -- # es=106 00:04:55.166 11:29:15 -- common/autotest_common.sh@663 -- # case "$es" in 00:04:55.166 11:29:15 -- common/autotest_common.sh@670 -- # es=1 00:04:55.166 11:29:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:55.166 00:04:55.166 real 0m0.472s 00:04:55.167 user 0m0.357s 00:04:55.167 sys 0m0.147s 00:04:55.167 11:29:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:55.167 11:29:15 -- common/autotest_common.sh@10 -- # set +x 00:04:55.167 ************************************ 00:04:55.167 END TEST accel_missing_filename 00:04:55.167 ************************************ 00:04:55.167 11:29:15 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:55.167 11:29:15 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:04:55.167 11:29:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.167 11:29:15 -- common/autotest_common.sh@10 -- # set +x 00:04:55.167 ************************************ 00:04:55.167 START TEST accel_compress_verify 00:04:55.167 ************************************ 00:04:55.167 11:29:15 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:55.167 11:29:15 -- common/autotest_common.sh@650 -- # local es=0 00:04:55.167 11:29:15 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:55.167 11:29:15 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:55.167 11:29:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:55.167 11:29:15 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:55.167 11:29:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:55.167 11:29:15 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:55.167 11:29:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:55.424 11:29:15 -- accel/accel.sh@12 -- # build_accel_config 00:04:55.424 11:29:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:55.424 11:29:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:55.424 11:29:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:55.424 11:29:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:55.424 11:29:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:55.424 11:29:15 -- accel/accel.sh@41 -- # local IFS=, 00:04:55.424 11:29:15 -- accel/accel.sh@42 -- # jq -r . 00:04:55.424 [2024-11-28 11:29:15.238161] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:55.424 [2024-11-28 11:29:15.238233] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3692606 ] 00:04:55.424 EAL: No free 2048 kB hugepages reported on node 1 00:04:55.424 [2024-11-28 11:29:15.301498] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:55.424 [2024-11-28 11:29:15.418578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:55.424 [2024-11-28 11:29:15.477069] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:55.682 [2024-11-28 11:29:15.557407] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:04:55.682 00:04:55.682 Compression does not support the verify option, aborting. 00:04:55.682 11:29:15 -- common/autotest_common.sh@653 -- # es=161 00:04:55.682 11:29:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:55.682 11:29:15 -- common/autotest_common.sh@662 -- # es=33 00:04:55.682 11:29:15 -- common/autotest_common.sh@663 -- # case "$es" in 00:04:55.682 11:29:15 -- common/autotest_common.sh@670 -- # es=1 00:04:55.682 11:29:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:55.682 00:04:55.682 real 0m0.460s 00:04:55.682 user 0m0.351s 00:04:55.682 sys 0m0.142s 00:04:55.682 11:29:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:55.683 11:29:15 -- common/autotest_common.sh@10 -- # set +x 00:04:55.683 ************************************ 00:04:55.683 END TEST accel_compress_verify 00:04:55.683 ************************************ 00:04:55.683 11:29:15 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:04:55.683 11:29:15 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:04:55.683 11:29:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.683 11:29:15 -- common/autotest_common.sh@10 -- # set +x 00:04:55.683 ************************************ 00:04:55.683 START TEST accel_wrong_workload 00:04:55.683 ************************************ 00:04:55.683 11:29:15 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:04:55.683 11:29:15 -- common/autotest_common.sh@650 -- # local es=0 00:04:55.683 11:29:15 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:04:55.683 11:29:15 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:55.683 11:29:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:55.683 11:29:15 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:55.683 11:29:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:55.683 11:29:15 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:04:55.683 11:29:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:04:55.683 11:29:15 -- accel/accel.sh@12 -- # build_accel_config 00:04:55.683 11:29:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:55.683 11:29:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:55.683 11:29:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:55.683 11:29:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:55.683 11:29:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:55.683 11:29:15 -- accel/accel.sh@41 -- # local IFS=, 00:04:55.683 11:29:15 -- accel/accel.sh@42 -- # jq -r . 00:04:55.683 Unsupported workload type: foobar 00:04:55.683 [2024-11-28 11:29:15.722647] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:04:55.683 accel_perf options: 00:04:55.683 [-h help message] 00:04:55.683 [-q queue depth per core] 00:04:55.683 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:04:55.683 [-T number of threads per core 00:04:55.683 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:04:55.683 [-t time in seconds] 00:04:55.683 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:04:55.683 [ dif_verify, , dif_generate, dif_generate_copy 00:04:55.683 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:04:55.683 [-l for compress/decompress workloads, name of uncompressed input file 00:04:55.683 [-S for crc32c workload, use this seed value (default 0) 00:04:55.683 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:04:55.683 [-f for fill workload, use this BYTE value (default 255) 00:04:55.683 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:04:55.683 [-y verify result if this switch is on] 00:04:55.683 [-a tasks to allocate per core (default: same value as -q)] 00:04:55.683 Can be used to spread operations across a wider range of memory. 00:04:55.683 11:29:15 -- common/autotest_common.sh@653 -- # es=1 00:04:55.683 11:29:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:55.683 11:29:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:55.683 11:29:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:55.683 00:04:55.683 real 0m0.023s 00:04:55.683 user 0m0.013s 00:04:55.683 sys 0m0.010s 00:04:55.683 11:29:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:55.683 11:29:15 -- common/autotest_common.sh@10 -- # set +x 00:04:55.683 ************************************ 00:04:55.683 END TEST accel_wrong_workload 00:04:55.683 ************************************ 00:04:55.942 Error: writing output failed: Broken pipe 00:04:55.943 11:29:15 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:04:55.943 11:29:15 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:04:55.943 11:29:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.943 11:29:15 -- common/autotest_common.sh@10 -- # set +x 00:04:55.943 ************************************ 00:04:55.943 START TEST accel_negative_buffers 00:04:55.943 ************************************ 00:04:55.943 11:29:15 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:04:55.943 11:29:15 -- common/autotest_common.sh@650 -- # local es=0 00:04:55.943 11:29:15 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:04:55.943 11:29:15 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:55.943 11:29:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:55.943 11:29:15 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:55.943 11:29:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:55.943 11:29:15 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:04:55.943 11:29:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:04:55.943 11:29:15 -- accel/accel.sh@12 -- # build_accel_config 00:04:55.943 11:29:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:55.943 11:29:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:55.943 11:29:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:55.943 11:29:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:55.943 11:29:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:55.943 11:29:15 -- accel/accel.sh@41 -- # local IFS=, 00:04:55.943 11:29:15 -- accel/accel.sh@42 -- # jq -r . 00:04:55.943 -x option must be non-negative. 00:04:55.943 [2024-11-28 11:29:15.767182] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:04:55.943 accel_perf options: 00:04:55.943 [-h help message] 00:04:55.943 [-q queue depth per core] 00:04:55.943 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:04:55.943 [-T number of threads per core 00:04:55.943 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:04:55.943 [-t time in seconds] 00:04:55.943 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:04:55.943 [ dif_verify, , dif_generate, dif_generate_copy 00:04:55.943 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:04:55.943 [-l for compress/decompress workloads, name of uncompressed input file 00:04:55.943 [-S for crc32c workload, use this seed value (default 0) 00:04:55.943 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:04:55.943 [-f for fill workload, use this BYTE value (default 255) 00:04:55.943 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:04:55.943 [-y verify result if this switch is on] 00:04:55.943 [-a tasks to allocate per core (default: same value as -q)] 00:04:55.943 Can be used to spread operations across a wider range of memory. 00:04:55.943 11:29:15 -- common/autotest_common.sh@653 -- # es=1 00:04:55.943 11:29:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:55.943 11:29:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:55.943 11:29:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:55.943 00:04:55.943 real 0m0.022s 00:04:55.943 user 0m0.014s 00:04:55.943 sys 0m0.008s 00:04:55.943 11:29:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:55.943 11:29:15 -- common/autotest_common.sh@10 -- # set +x 00:04:55.943 ************************************ 00:04:55.943 END TEST accel_negative_buffers 00:04:55.943 ************************************ 00:04:55.943 Error: writing output failed: Broken pipe 00:04:55.943 11:29:15 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:04:55.943 11:29:15 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:04:55.943 11:29:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.943 11:29:15 -- common/autotest_common.sh@10 -- # set +x 00:04:55.943 ************************************ 00:04:55.943 START TEST accel_crc32c 00:04:55.943 ************************************ 00:04:55.943 11:29:15 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:04:55.943 11:29:15 -- accel/accel.sh@16 -- # local accel_opc 00:04:55.943 11:29:15 -- accel/accel.sh@17 -- # local accel_module 00:04:55.943 11:29:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:04:55.943 11:29:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:04:55.943 11:29:15 -- accel/accel.sh@12 -- # build_accel_config 00:04:55.943 11:29:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:55.943 11:29:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:55.943 11:29:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:55.943 11:29:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:55.943 11:29:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:55.943 11:29:15 -- accel/accel.sh@41 -- # local IFS=, 00:04:55.943 11:29:15 -- accel/accel.sh@42 -- # jq -r . 00:04:55.943 [2024-11-28 11:29:15.815015] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:55.943 [2024-11-28 11:29:15.815097] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3692794 ] 00:04:55.943 EAL: No free 2048 kB hugepages reported on node 1 00:04:55.943 [2024-11-28 11:29:15.878564] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:55.943 [2024-11-28 11:29:15.997211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:57.316 11:29:17 -- accel/accel.sh@18 -- # out=' 00:04:57.316 SPDK Configuration: 00:04:57.316 Core mask: 0x1 00:04:57.316 00:04:57.316 Accel Perf Configuration: 00:04:57.316 Workload Type: crc32c 00:04:57.316 CRC-32C seed: 32 00:04:57.316 Transfer size: 4096 bytes 00:04:57.316 Vector count 1 00:04:57.316 Module: software 00:04:57.316 Queue depth: 32 00:04:57.316 Allocate depth: 32 00:04:57.316 # threads/core: 1 00:04:57.316 Run time: 1 seconds 00:04:57.316 Verify: Yes 00:04:57.316 00:04:57.316 Running for 1 seconds... 00:04:57.316 00:04:57.316 Core,Thread Transfers Bandwidth Failed Miscompares 00:04:57.316 ------------------------------------------------------------------------------------ 00:04:57.316 0,0 404064/s 1578 MiB/s 0 0 00:04:57.316 ==================================================================================== 00:04:57.316 Total 404064/s 1578 MiB/s 0 0' 00:04:57.316 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.316 11:29:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:04:57.316 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.316 11:29:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:04:57.316 11:29:17 -- accel/accel.sh@12 -- # build_accel_config 00:04:57.316 11:29:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:57.316 11:29:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:57.316 11:29:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:57.316 11:29:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:57.316 11:29:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:57.316 11:29:17 -- accel/accel.sh@41 -- # local IFS=, 00:04:57.316 11:29:17 -- accel/accel.sh@42 -- # jq -r . 00:04:57.316 [2024-11-28 11:29:17.291416] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:57.316 [2024-11-28 11:29:17.291494] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3692932 ] 00:04:57.316 EAL: No free 2048 kB hugepages reported on node 1 00:04:57.316 [2024-11-28 11:29:17.352428] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:57.574 [2024-11-28 11:29:17.469994] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:57.574 11:29:17 -- accel/accel.sh@21 -- # val= 00:04:57.574 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.574 11:29:17 -- accel/accel.sh@21 -- # val= 00:04:57.574 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.574 11:29:17 -- accel/accel.sh@21 -- # val=0x1 00:04:57.574 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.574 11:29:17 -- accel/accel.sh@21 -- # val= 00:04:57.574 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.574 11:29:17 -- accel/accel.sh@21 -- # val= 00:04:57.574 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.574 11:29:17 -- accel/accel.sh@21 -- # val=crc32c 00:04:57.574 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.574 11:29:17 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.574 11:29:17 -- accel/accel.sh@21 -- # val=32 00:04:57.574 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.574 11:29:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:04:57.574 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.574 11:29:17 -- accel/accel.sh@21 -- # val= 00:04:57.574 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.574 11:29:17 -- accel/accel.sh@21 -- # val=software 00:04:57.574 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.574 11:29:17 -- accel/accel.sh@23 -- # accel_module=software 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.574 11:29:17 -- accel/accel.sh@21 -- # val=32 00:04:57.574 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.574 11:29:17 -- accel/accel.sh@21 -- # val=32 00:04:57.574 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.574 11:29:17 -- accel/accel.sh@21 -- # val=1 00:04:57.574 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.574 11:29:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:04:57.574 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.574 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.575 11:29:17 -- accel/accel.sh@21 -- # val=Yes 00:04:57.575 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.575 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.575 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.575 11:29:17 -- accel/accel.sh@21 -- # val= 00:04:57.575 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.575 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.575 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:57.575 11:29:17 -- accel/accel.sh@21 -- # val= 00:04:57.575 11:29:17 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.575 11:29:17 -- accel/accel.sh@20 -- # IFS=: 00:04:57.575 11:29:17 -- accel/accel.sh@20 -- # read -r var val 00:04:58.998 11:29:18 -- accel/accel.sh@21 -- # val= 00:04:58.998 11:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.998 11:29:18 -- accel/accel.sh@20 -- # IFS=: 00:04:58.998 11:29:18 -- accel/accel.sh@20 -- # read -r var val 00:04:58.998 11:29:18 -- accel/accel.sh@21 -- # val= 00:04:58.998 11:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.998 11:29:18 -- accel/accel.sh@20 -- # IFS=: 00:04:58.998 11:29:18 -- accel/accel.sh@20 -- # read -r var val 00:04:58.998 11:29:18 -- accel/accel.sh@21 -- # val= 00:04:58.998 11:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.998 11:29:18 -- accel/accel.sh@20 -- # IFS=: 00:04:58.998 11:29:18 -- accel/accel.sh@20 -- # read -r var val 00:04:58.998 11:29:18 -- accel/accel.sh@21 -- # val= 00:04:58.998 11:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.998 11:29:18 -- accel/accel.sh@20 -- # IFS=: 00:04:58.998 11:29:18 -- accel/accel.sh@20 -- # read -r var val 00:04:58.998 11:29:18 -- accel/accel.sh@21 -- # val= 00:04:58.998 11:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.998 11:29:18 -- accel/accel.sh@20 -- # IFS=: 00:04:58.998 11:29:18 -- accel/accel.sh@20 -- # read -r var val 00:04:58.998 11:29:18 -- accel/accel.sh@21 -- # val= 00:04:58.998 11:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.998 11:29:18 -- accel/accel.sh@20 -- # IFS=: 00:04:58.998 11:29:18 -- accel/accel.sh@20 -- # read -r var val 00:04:58.998 11:29:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:04:58.998 11:29:18 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:04:58.998 11:29:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:04:58.998 00:04:58.998 real 0m2.950s 00:04:58.998 user 0m2.666s 00:04:58.998 sys 0m0.277s 00:04:58.998 11:29:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:58.998 11:29:18 -- common/autotest_common.sh@10 -- # set +x 00:04:58.998 ************************************ 00:04:58.998 END TEST accel_crc32c 00:04:58.998 ************************************ 00:04:58.998 11:29:18 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:04:58.998 11:29:18 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:04:58.998 11:29:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.998 11:29:18 -- common/autotest_common.sh@10 -- # set +x 00:04:58.998 ************************************ 00:04:58.998 START TEST accel_crc32c_C2 00:04:58.998 ************************************ 00:04:58.998 11:29:18 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:04:58.998 11:29:18 -- accel/accel.sh@16 -- # local accel_opc 00:04:58.998 11:29:18 -- accel/accel.sh@17 -- # local accel_module 00:04:58.998 11:29:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:04:58.998 11:29:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:04:58.998 11:29:18 -- accel/accel.sh@12 -- # build_accel_config 00:04:58.998 11:29:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:58.998 11:29:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:58.998 11:29:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:58.998 11:29:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:58.998 11:29:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:58.998 11:29:18 -- accel/accel.sh@41 -- # local IFS=, 00:04:58.998 11:29:18 -- accel/accel.sh@42 -- # jq -r . 00:04:58.998 [2024-11-28 11:29:18.789955] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:58.998 [2024-11-28 11:29:18.790033] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3693109 ] 00:04:58.998 EAL: No free 2048 kB hugepages reported on node 1 00:04:58.998 [2024-11-28 11:29:18.852471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:58.998 [2024-11-28 11:29:18.968634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:00.372 11:29:20 -- accel/accel.sh@18 -- # out=' 00:05:00.372 SPDK Configuration: 00:05:00.372 Core mask: 0x1 00:05:00.372 00:05:00.372 Accel Perf Configuration: 00:05:00.372 Workload Type: crc32c 00:05:00.372 CRC-32C seed: 0 00:05:00.372 Transfer size: 4096 bytes 00:05:00.372 Vector count 2 00:05:00.372 Module: software 00:05:00.372 Queue depth: 32 00:05:00.372 Allocate depth: 32 00:05:00.372 # threads/core: 1 00:05:00.372 Run time: 1 seconds 00:05:00.372 Verify: Yes 00:05:00.372 00:05:00.372 Running for 1 seconds... 00:05:00.372 00:05:00.372 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:00.372 ------------------------------------------------------------------------------------ 00:05:00.372 0,0 315872/s 2467 MiB/s 0 0 00:05:00.372 ==================================================================================== 00:05:00.372 Total 315872/s 1233 MiB/s 0 0' 00:05:00.372 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.372 11:29:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:00.372 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.372 11:29:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:00.372 11:29:20 -- accel/accel.sh@12 -- # build_accel_config 00:05:00.372 11:29:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:00.372 11:29:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:00.372 11:29:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:00.372 11:29:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:00.372 11:29:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:00.372 11:29:20 -- accel/accel.sh@41 -- # local IFS=, 00:05:00.372 11:29:20 -- accel/accel.sh@42 -- # jq -r . 00:05:00.372 [2024-11-28 11:29:20.255661] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:00.372 [2024-11-28 11:29:20.255739] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3693363 ] 00:05:00.372 EAL: No free 2048 kB hugepages reported on node 1 00:05:00.372 [2024-11-28 11:29:20.316813] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:00.631 [2024-11-28 11:29:20.435213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val= 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val= 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val=0x1 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val= 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val= 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val=crc32c 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val=0 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val= 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val=software 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@23 -- # accel_module=software 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val=32 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val=32 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val=1 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val=Yes 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val= 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:00.631 11:29:20 -- accel/accel.sh@21 -- # val= 00:05:00.631 11:29:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # IFS=: 00:05:00.631 11:29:20 -- accel/accel.sh@20 -- # read -r var val 00:05:02.006 11:29:21 -- accel/accel.sh@21 -- # val= 00:05:02.006 11:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.006 11:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:02.006 11:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:02.006 11:29:21 -- accel/accel.sh@21 -- # val= 00:05:02.006 11:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.006 11:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:02.006 11:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:02.006 11:29:21 -- accel/accel.sh@21 -- # val= 00:05:02.006 11:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.006 11:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:02.006 11:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:02.006 11:29:21 -- accel/accel.sh@21 -- # val= 00:05:02.006 11:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.006 11:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:02.006 11:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:02.006 11:29:21 -- accel/accel.sh@21 -- # val= 00:05:02.006 11:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.006 11:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:02.006 11:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:02.006 11:29:21 -- accel/accel.sh@21 -- # val= 00:05:02.006 11:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.006 11:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:02.006 11:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:02.006 11:29:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:02.006 11:29:21 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:02.006 11:29:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:02.006 00:05:02.006 real 0m2.940s 00:05:02.006 user 0m2.651s 00:05:02.006 sys 0m0.281s 00:05:02.006 11:29:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:02.006 11:29:21 -- common/autotest_common.sh@10 -- # set +x 00:05:02.006 ************************************ 00:05:02.006 END TEST accel_crc32c_C2 00:05:02.006 ************************************ 00:05:02.006 11:29:21 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:02.006 11:29:21 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:02.006 11:29:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:02.006 11:29:21 -- common/autotest_common.sh@10 -- # set +x 00:05:02.006 ************************************ 00:05:02.006 START TEST accel_copy 00:05:02.006 ************************************ 00:05:02.006 11:29:21 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:02.006 11:29:21 -- accel/accel.sh@16 -- # local accel_opc 00:05:02.006 11:29:21 -- accel/accel.sh@17 -- # local accel_module 00:05:02.006 11:29:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:02.006 11:29:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:02.006 11:29:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:02.006 11:29:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:02.006 11:29:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:02.006 11:29:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:02.006 11:29:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:02.006 11:29:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:02.006 11:29:21 -- accel/accel.sh@41 -- # local IFS=, 00:05:02.006 11:29:21 -- accel/accel.sh@42 -- # jq -r . 00:05:02.006 [2024-11-28 11:29:21.754267] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:02.006 [2024-11-28 11:29:21.754345] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3693519 ] 00:05:02.006 EAL: No free 2048 kB hugepages reported on node 1 00:05:02.006 [2024-11-28 11:29:21.815969] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:02.006 [2024-11-28 11:29:21.933810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.381 11:29:23 -- accel/accel.sh@18 -- # out=' 00:05:03.381 SPDK Configuration: 00:05:03.381 Core mask: 0x1 00:05:03.381 00:05:03.381 Accel Perf Configuration: 00:05:03.381 Workload Type: copy 00:05:03.381 Transfer size: 4096 bytes 00:05:03.381 Vector count 1 00:05:03.381 Module: software 00:05:03.381 Queue depth: 32 00:05:03.381 Allocate depth: 32 00:05:03.381 # threads/core: 1 00:05:03.381 Run time: 1 seconds 00:05:03.381 Verify: Yes 00:05:03.381 00:05:03.381 Running for 1 seconds... 00:05:03.381 00:05:03.381 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:03.381 ------------------------------------------------------------------------------------ 00:05:03.381 0,0 279168/s 1090 MiB/s 0 0 00:05:03.381 ==================================================================================== 00:05:03.381 Total 279168/s 1090 MiB/s 0 0' 00:05:03.381 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.381 11:29:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:03.381 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.381 11:29:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:03.381 11:29:23 -- accel/accel.sh@12 -- # build_accel_config 00:05:03.381 11:29:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:03.381 11:29:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:03.381 11:29:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:03.381 11:29:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:03.381 11:29:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:03.381 11:29:23 -- accel/accel.sh@41 -- # local IFS=, 00:05:03.381 11:29:23 -- accel/accel.sh@42 -- # jq -r . 00:05:03.381 [2024-11-28 11:29:23.222991] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:03.381 [2024-11-28 11:29:23.223073] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3693663 ] 00:05:03.381 EAL: No free 2048 kB hugepages reported on node 1 00:05:03.381 [2024-11-28 11:29:23.283129] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:03.381 [2024-11-28 11:29:23.398631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.640 11:29:23 -- accel/accel.sh@21 -- # val= 00:05:03.640 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.640 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.640 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.640 11:29:23 -- accel/accel.sh@21 -- # val= 00:05:03.640 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.640 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.640 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.640 11:29:23 -- accel/accel.sh@21 -- # val=0x1 00:05:03.640 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.640 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.640 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.640 11:29:23 -- accel/accel.sh@21 -- # val= 00:05:03.640 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.640 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.640 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.640 11:29:23 -- accel/accel.sh@21 -- # val= 00:05:03.640 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.640 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.640 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.640 11:29:23 -- accel/accel.sh@21 -- # val=copy 00:05:03.640 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.640 11:29:23 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:03.640 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.640 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.640 11:29:23 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:03.640 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.640 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.640 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.640 11:29:23 -- accel/accel.sh@21 -- # val= 00:05:03.640 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.641 11:29:23 -- accel/accel.sh@21 -- # val=software 00:05:03.641 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.641 11:29:23 -- accel/accel.sh@23 -- # accel_module=software 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.641 11:29:23 -- accel/accel.sh@21 -- # val=32 00:05:03.641 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.641 11:29:23 -- accel/accel.sh@21 -- # val=32 00:05:03.641 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.641 11:29:23 -- accel/accel.sh@21 -- # val=1 00:05:03.641 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.641 11:29:23 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:03.641 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.641 11:29:23 -- accel/accel.sh@21 -- # val=Yes 00:05:03.641 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.641 11:29:23 -- accel/accel.sh@21 -- # val= 00:05:03.641 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:03.641 11:29:23 -- accel/accel.sh@21 -- # val= 00:05:03.641 11:29:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # IFS=: 00:05:03.641 11:29:23 -- accel/accel.sh@20 -- # read -r var val 00:05:05.015 11:29:24 -- accel/accel.sh@21 -- # val= 00:05:05.015 11:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.015 11:29:24 -- accel/accel.sh@20 -- # IFS=: 00:05:05.015 11:29:24 -- accel/accel.sh@20 -- # read -r var val 00:05:05.015 11:29:24 -- accel/accel.sh@21 -- # val= 00:05:05.015 11:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.015 11:29:24 -- accel/accel.sh@20 -- # IFS=: 00:05:05.015 11:29:24 -- accel/accel.sh@20 -- # read -r var val 00:05:05.015 11:29:24 -- accel/accel.sh@21 -- # val= 00:05:05.015 11:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.015 11:29:24 -- accel/accel.sh@20 -- # IFS=: 00:05:05.015 11:29:24 -- accel/accel.sh@20 -- # read -r var val 00:05:05.015 11:29:24 -- accel/accel.sh@21 -- # val= 00:05:05.015 11:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.015 11:29:24 -- accel/accel.sh@20 -- # IFS=: 00:05:05.015 11:29:24 -- accel/accel.sh@20 -- # read -r var val 00:05:05.015 11:29:24 -- accel/accel.sh@21 -- # val= 00:05:05.015 11:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.015 11:29:24 -- accel/accel.sh@20 -- # IFS=: 00:05:05.015 11:29:24 -- accel/accel.sh@20 -- # read -r var val 00:05:05.015 11:29:24 -- accel/accel.sh@21 -- # val= 00:05:05.015 11:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.015 11:29:24 -- accel/accel.sh@20 -- # IFS=: 00:05:05.015 11:29:24 -- accel/accel.sh@20 -- # read -r var val 00:05:05.015 11:29:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:05.015 11:29:24 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:05.015 11:29:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:05.015 00:05:05.015 real 0m2.926s 00:05:05.015 user 0m2.643s 00:05:05.015 sys 0m0.274s 00:05:05.015 11:29:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.015 11:29:24 -- common/autotest_common.sh@10 -- # set +x 00:05:05.015 ************************************ 00:05:05.015 END TEST accel_copy 00:05:05.015 ************************************ 00:05:05.015 11:29:24 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:05.015 11:29:24 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:05.015 11:29:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.015 11:29:24 -- common/autotest_common.sh@10 -- # set +x 00:05:05.015 ************************************ 00:05:05.015 START TEST accel_fill 00:05:05.015 ************************************ 00:05:05.015 11:29:24 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:05.015 11:29:24 -- accel/accel.sh@16 -- # local accel_opc 00:05:05.015 11:29:24 -- accel/accel.sh@17 -- # local accel_module 00:05:05.015 11:29:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:05.015 11:29:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:05.015 11:29:24 -- accel/accel.sh@12 -- # build_accel_config 00:05:05.015 11:29:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:05.015 11:29:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:05.015 11:29:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:05.015 11:29:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:05.015 11:29:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:05.015 11:29:24 -- accel/accel.sh@41 -- # local IFS=, 00:05:05.015 11:29:24 -- accel/accel.sh@42 -- # jq -r . 00:05:05.015 [2024-11-28 11:29:24.703088] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:05.015 [2024-11-28 11:29:24.703162] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3693945 ] 00:05:05.015 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.015 [2024-11-28 11:29:24.766446] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:05.015 [2024-11-28 11:29:24.887598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.390 11:29:26 -- accel/accel.sh@18 -- # out=' 00:05:06.390 SPDK Configuration: 00:05:06.390 Core mask: 0x1 00:05:06.390 00:05:06.390 Accel Perf Configuration: 00:05:06.390 Workload Type: fill 00:05:06.390 Fill pattern: 0x80 00:05:06.390 Transfer size: 4096 bytes 00:05:06.390 Vector count 1 00:05:06.390 Module: software 00:05:06.390 Queue depth: 64 00:05:06.390 Allocate depth: 64 00:05:06.390 # threads/core: 1 00:05:06.390 Run time: 1 seconds 00:05:06.390 Verify: Yes 00:05:06.390 00:05:06.390 Running for 1 seconds... 00:05:06.390 00:05:06.390 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:06.390 ------------------------------------------------------------------------------------ 00:05:06.390 0,0 405696/s 1584 MiB/s 0 0 00:05:06.390 ==================================================================================== 00:05:06.390 Total 405696/s 1584 MiB/s 0 0' 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:06.390 11:29:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:06.390 11:29:26 -- accel/accel.sh@12 -- # build_accel_config 00:05:06.390 11:29:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:06.390 11:29:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:06.390 11:29:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:06.390 11:29:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:06.390 11:29:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:06.390 11:29:26 -- accel/accel.sh@41 -- # local IFS=, 00:05:06.390 11:29:26 -- accel/accel.sh@42 -- # jq -r . 00:05:06.390 [2024-11-28 11:29:26.181496] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:06.390 [2024-11-28 11:29:26.181605] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3694091 ] 00:05:06.390 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.390 [2024-11-28 11:29:26.245861] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:06.390 [2024-11-28 11:29:26.362549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val= 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val= 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val=0x1 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val= 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val= 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val=fill 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.390 11:29:26 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val=0x80 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val= 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val=software 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.390 11:29:26 -- accel/accel.sh@23 -- # accel_module=software 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val=64 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val=64 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val=1 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.390 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.390 11:29:26 -- accel/accel.sh@21 -- # val=Yes 00:05:06.390 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.391 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.391 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.391 11:29:26 -- accel/accel.sh@21 -- # val= 00:05:06.391 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.391 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.391 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:06.391 11:29:26 -- accel/accel.sh@21 -- # val= 00:05:06.391 11:29:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.391 11:29:26 -- accel/accel.sh@20 -- # IFS=: 00:05:06.391 11:29:26 -- accel/accel.sh@20 -- # read -r var val 00:05:07.766 11:29:27 -- accel/accel.sh@21 -- # val= 00:05:07.766 11:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.766 11:29:27 -- accel/accel.sh@20 -- # IFS=: 00:05:07.766 11:29:27 -- accel/accel.sh@20 -- # read -r var val 00:05:07.766 11:29:27 -- accel/accel.sh@21 -- # val= 00:05:07.766 11:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.766 11:29:27 -- accel/accel.sh@20 -- # IFS=: 00:05:07.766 11:29:27 -- accel/accel.sh@20 -- # read -r var val 00:05:07.766 11:29:27 -- accel/accel.sh@21 -- # val= 00:05:07.766 11:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.766 11:29:27 -- accel/accel.sh@20 -- # IFS=: 00:05:07.766 11:29:27 -- accel/accel.sh@20 -- # read -r var val 00:05:07.766 11:29:27 -- accel/accel.sh@21 -- # val= 00:05:07.766 11:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.766 11:29:27 -- accel/accel.sh@20 -- # IFS=: 00:05:07.766 11:29:27 -- accel/accel.sh@20 -- # read -r var val 00:05:07.766 11:29:27 -- accel/accel.sh@21 -- # val= 00:05:07.766 11:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.766 11:29:27 -- accel/accel.sh@20 -- # IFS=: 00:05:07.766 11:29:27 -- accel/accel.sh@20 -- # read -r var val 00:05:07.766 11:29:27 -- accel/accel.sh@21 -- # val= 00:05:07.766 11:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.766 11:29:27 -- accel/accel.sh@20 -- # IFS=: 00:05:07.766 11:29:27 -- accel/accel.sh@20 -- # read -r var val 00:05:07.766 11:29:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:07.766 11:29:27 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:07.766 11:29:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:07.766 00:05:07.766 real 0m2.953s 00:05:07.766 user 0m2.648s 00:05:07.766 sys 0m0.297s 00:05:07.767 11:29:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:07.767 11:29:27 -- common/autotest_common.sh@10 -- # set +x 00:05:07.767 ************************************ 00:05:07.767 END TEST accel_fill 00:05:07.767 ************************************ 00:05:07.767 11:29:27 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:07.767 11:29:27 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:07.767 11:29:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:07.767 11:29:27 -- common/autotest_common.sh@10 -- # set +x 00:05:07.767 ************************************ 00:05:07.767 START TEST accel_copy_crc32c 00:05:07.767 ************************************ 00:05:07.767 11:29:27 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:07.767 11:29:27 -- accel/accel.sh@16 -- # local accel_opc 00:05:07.767 11:29:27 -- accel/accel.sh@17 -- # local accel_module 00:05:07.767 11:29:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:07.767 11:29:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:07.767 11:29:27 -- accel/accel.sh@12 -- # build_accel_config 00:05:07.767 11:29:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:07.767 11:29:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:07.767 11:29:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:07.767 11:29:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:07.767 11:29:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:07.767 11:29:27 -- accel/accel.sh@41 -- # local IFS=, 00:05:07.767 11:29:27 -- accel/accel.sh@42 -- # jq -r . 00:05:07.767 [2024-11-28 11:29:27.682844] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:07.767 [2024-11-28 11:29:27.682921] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3694246 ] 00:05:07.767 EAL: No free 2048 kB hugepages reported on node 1 00:05:07.767 [2024-11-28 11:29:27.744354] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:08.026 [2024-11-28 11:29:27.862395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:09.398 11:29:29 -- accel/accel.sh@18 -- # out=' 00:05:09.398 SPDK Configuration: 00:05:09.398 Core mask: 0x1 00:05:09.398 00:05:09.398 Accel Perf Configuration: 00:05:09.398 Workload Type: copy_crc32c 00:05:09.398 CRC-32C seed: 0 00:05:09.398 Vector size: 4096 bytes 00:05:09.398 Transfer size: 4096 bytes 00:05:09.398 Vector count 1 00:05:09.398 Module: software 00:05:09.398 Queue depth: 32 00:05:09.398 Allocate depth: 32 00:05:09.398 # threads/core: 1 00:05:09.398 Run time: 1 seconds 00:05:09.398 Verify: Yes 00:05:09.398 00:05:09.398 Running for 1 seconds... 00:05:09.398 00:05:09.398 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:09.398 ------------------------------------------------------------------------------------ 00:05:09.398 0,0 218144/s 852 MiB/s 0 0 00:05:09.398 ==================================================================================== 00:05:09.398 Total 218144/s 852 MiB/s 0 0' 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.398 11:29:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:09.398 11:29:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:09.398 11:29:29 -- accel/accel.sh@12 -- # build_accel_config 00:05:09.398 11:29:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:09.398 11:29:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:09.398 11:29:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:09.398 11:29:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:09.398 11:29:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:09.398 11:29:29 -- accel/accel.sh@41 -- # local IFS=, 00:05:09.398 11:29:29 -- accel/accel.sh@42 -- # jq -r . 00:05:09.398 [2024-11-28 11:29:29.155440] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:09.398 [2024-11-28 11:29:29.155520] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3694509 ] 00:05:09.398 EAL: No free 2048 kB hugepages reported on node 1 00:05:09.398 [2024-11-28 11:29:29.217155] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:09.398 [2024-11-28 11:29:29.337240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:09.398 11:29:29 -- accel/accel.sh@21 -- # val= 00:05:09.398 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.398 11:29:29 -- accel/accel.sh@21 -- # val= 00:05:09.398 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.398 11:29:29 -- accel/accel.sh@21 -- # val=0x1 00:05:09.398 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.398 11:29:29 -- accel/accel.sh@21 -- # val= 00:05:09.398 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.398 11:29:29 -- accel/accel.sh@21 -- # val= 00:05:09.398 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.398 11:29:29 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:09.398 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.398 11:29:29 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.398 11:29:29 -- accel/accel.sh@21 -- # val=0 00:05:09.398 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.398 11:29:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:09.398 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.398 11:29:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:09.398 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.398 11:29:29 -- accel/accel.sh@21 -- # val= 00:05:09.398 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.398 11:29:29 -- accel/accel.sh@21 -- # val=software 00:05:09.398 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.398 11:29:29 -- accel/accel.sh@23 -- # accel_module=software 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.398 11:29:29 -- accel/accel.sh@21 -- # val=32 00:05:09.398 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.398 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.398 11:29:29 -- accel/accel.sh@21 -- # val=32 00:05:09.399 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.399 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.399 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.399 11:29:29 -- accel/accel.sh@21 -- # val=1 00:05:09.399 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.399 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.399 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.399 11:29:29 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:09.399 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.399 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.399 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.399 11:29:29 -- accel/accel.sh@21 -- # val=Yes 00:05:09.399 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.399 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.399 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.399 11:29:29 -- accel/accel.sh@21 -- # val= 00:05:09.399 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.399 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.399 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:09.399 11:29:29 -- accel/accel.sh@21 -- # val= 00:05:09.399 11:29:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.399 11:29:29 -- accel/accel.sh@20 -- # IFS=: 00:05:09.399 11:29:29 -- accel/accel.sh@20 -- # read -r var val 00:05:10.773 11:29:30 -- accel/accel.sh@21 -- # val= 00:05:10.773 11:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.773 11:29:30 -- accel/accel.sh@20 -- # IFS=: 00:05:10.773 11:29:30 -- accel/accel.sh@20 -- # read -r var val 00:05:10.773 11:29:30 -- accel/accel.sh@21 -- # val= 00:05:10.773 11:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.773 11:29:30 -- accel/accel.sh@20 -- # IFS=: 00:05:10.773 11:29:30 -- accel/accel.sh@20 -- # read -r var val 00:05:10.773 11:29:30 -- accel/accel.sh@21 -- # val= 00:05:10.773 11:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.773 11:29:30 -- accel/accel.sh@20 -- # IFS=: 00:05:10.773 11:29:30 -- accel/accel.sh@20 -- # read -r var val 00:05:10.773 11:29:30 -- accel/accel.sh@21 -- # val= 00:05:10.773 11:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.773 11:29:30 -- accel/accel.sh@20 -- # IFS=: 00:05:10.773 11:29:30 -- accel/accel.sh@20 -- # read -r var val 00:05:10.773 11:29:30 -- accel/accel.sh@21 -- # val= 00:05:10.773 11:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.773 11:29:30 -- accel/accel.sh@20 -- # IFS=: 00:05:10.773 11:29:30 -- accel/accel.sh@20 -- # read -r var val 00:05:10.773 11:29:30 -- accel/accel.sh@21 -- # val= 00:05:10.773 11:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.773 11:29:30 -- accel/accel.sh@20 -- # IFS=: 00:05:10.773 11:29:30 -- accel/accel.sh@20 -- # read -r var val 00:05:10.773 11:29:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:10.773 11:29:30 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:10.773 11:29:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:10.773 00:05:10.773 real 0m2.943s 00:05:10.773 user 0m2.644s 00:05:10.773 sys 0m0.290s 00:05:10.773 11:29:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:10.773 11:29:30 -- common/autotest_common.sh@10 -- # set +x 00:05:10.773 ************************************ 00:05:10.773 END TEST accel_copy_crc32c 00:05:10.773 ************************************ 00:05:10.773 11:29:30 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:10.773 11:29:30 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:10.773 11:29:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.773 11:29:30 -- common/autotest_common.sh@10 -- # set +x 00:05:10.773 ************************************ 00:05:10.773 START TEST accel_copy_crc32c_C2 00:05:10.773 ************************************ 00:05:10.773 11:29:30 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:10.773 11:29:30 -- accel/accel.sh@16 -- # local accel_opc 00:05:10.773 11:29:30 -- accel/accel.sh@17 -- # local accel_module 00:05:10.773 11:29:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:10.773 11:29:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:10.773 11:29:30 -- accel/accel.sh@12 -- # build_accel_config 00:05:10.773 11:29:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:10.773 11:29:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:10.773 11:29:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:10.773 11:29:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:10.773 11:29:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:10.773 11:29:30 -- accel/accel.sh@41 -- # local IFS=, 00:05:10.773 11:29:30 -- accel/accel.sh@42 -- # jq -r . 00:05:10.773 [2024-11-28 11:29:30.650656] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:10.773 [2024-11-28 11:29:30.650738] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3694674 ] 00:05:10.773 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.773 [2024-11-28 11:29:30.713035] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:11.031 [2024-11-28 11:29:30.834521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:12.405 11:29:32 -- accel/accel.sh@18 -- # out=' 00:05:12.405 SPDK Configuration: 00:05:12.405 Core mask: 0x1 00:05:12.405 00:05:12.405 Accel Perf Configuration: 00:05:12.405 Workload Type: copy_crc32c 00:05:12.405 CRC-32C seed: 0 00:05:12.405 Vector size: 4096 bytes 00:05:12.405 Transfer size: 8192 bytes 00:05:12.405 Vector count 2 00:05:12.405 Module: software 00:05:12.405 Queue depth: 32 00:05:12.405 Allocate depth: 32 00:05:12.405 # threads/core: 1 00:05:12.405 Run time: 1 seconds 00:05:12.405 Verify: Yes 00:05:12.405 00:05:12.405 Running for 1 seconds... 00:05:12.405 00:05:12.405 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:12.405 ------------------------------------------------------------------------------------ 00:05:12.405 0,0 154112/s 1204 MiB/s 0 0 00:05:12.405 ==================================================================================== 00:05:12.405 Total 154112/s 602 MiB/s 0 0' 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:12.405 11:29:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:12.405 11:29:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:12.405 11:29:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:12.405 11:29:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:12.405 11:29:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:12.405 11:29:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:12.405 11:29:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:12.405 11:29:32 -- accel/accel.sh@42 -- # jq -r . 00:05:12.405 [2024-11-28 11:29:32.137689] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:12.405 [2024-11-28 11:29:32.137771] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3694818 ] 00:05:12.405 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.405 [2024-11-28 11:29:32.203701] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:12.405 [2024-11-28 11:29:32.323917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val= 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val= 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val=0x1 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val= 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val= 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val=0 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val= 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val=software 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@23 -- # accel_module=software 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val=32 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val=32 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val=1 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val=Yes 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val= 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:12.405 11:29:32 -- accel/accel.sh@21 -- # val= 00:05:12.405 11:29:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # IFS=: 00:05:12.405 11:29:32 -- accel/accel.sh@20 -- # read -r var val 00:05:13.780 11:29:33 -- accel/accel.sh@21 -- # val= 00:05:13.780 11:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.780 11:29:33 -- accel/accel.sh@20 -- # IFS=: 00:05:13.780 11:29:33 -- accel/accel.sh@20 -- # read -r var val 00:05:13.780 11:29:33 -- accel/accel.sh@21 -- # val= 00:05:13.780 11:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.780 11:29:33 -- accel/accel.sh@20 -- # IFS=: 00:05:13.780 11:29:33 -- accel/accel.sh@20 -- # read -r var val 00:05:13.780 11:29:33 -- accel/accel.sh@21 -- # val= 00:05:13.780 11:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.780 11:29:33 -- accel/accel.sh@20 -- # IFS=: 00:05:13.780 11:29:33 -- accel/accel.sh@20 -- # read -r var val 00:05:13.780 11:29:33 -- accel/accel.sh@21 -- # val= 00:05:13.780 11:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.780 11:29:33 -- accel/accel.sh@20 -- # IFS=: 00:05:13.780 11:29:33 -- accel/accel.sh@20 -- # read -r var val 00:05:13.780 11:29:33 -- accel/accel.sh@21 -- # val= 00:05:13.780 11:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.780 11:29:33 -- accel/accel.sh@20 -- # IFS=: 00:05:13.780 11:29:33 -- accel/accel.sh@20 -- # read -r var val 00:05:13.780 11:29:33 -- accel/accel.sh@21 -- # val= 00:05:13.780 11:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.780 11:29:33 -- accel/accel.sh@20 -- # IFS=: 00:05:13.780 11:29:33 -- accel/accel.sh@20 -- # read -r var val 00:05:13.780 11:29:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:13.780 11:29:33 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:13.780 11:29:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:13.780 00:05:13.780 real 0m2.976s 00:05:13.780 user 0m2.674s 00:05:13.780 sys 0m0.293s 00:05:13.780 11:29:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.780 11:29:33 -- common/autotest_common.sh@10 -- # set +x 00:05:13.780 ************************************ 00:05:13.780 END TEST accel_copy_crc32c_C2 00:05:13.780 ************************************ 00:05:13.780 11:29:33 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:13.780 11:29:33 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:13.780 11:29:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.780 11:29:33 -- common/autotest_common.sh@10 -- # set +x 00:05:13.780 ************************************ 00:05:13.780 START TEST accel_dualcast 00:05:13.780 ************************************ 00:05:13.780 11:29:33 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:13.780 11:29:33 -- accel/accel.sh@16 -- # local accel_opc 00:05:13.780 11:29:33 -- accel/accel.sh@17 -- # local accel_module 00:05:13.780 11:29:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:13.780 11:29:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:13.780 11:29:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:13.780 11:29:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:13.780 11:29:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:13.780 11:29:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:13.780 11:29:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:13.780 11:29:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:13.780 11:29:33 -- accel/accel.sh@41 -- # local IFS=, 00:05:13.780 11:29:33 -- accel/accel.sh@42 -- # jq -r . 00:05:13.780 [2024-11-28 11:29:33.654423] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:13.780 [2024-11-28 11:29:33.654502] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3695043 ] 00:05:13.780 EAL: No free 2048 kB hugepages reported on node 1 00:05:13.780 [2024-11-28 11:29:33.716302] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.038 [2024-11-28 11:29:33.836519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.414 11:29:35 -- accel/accel.sh@18 -- # out=' 00:05:15.414 SPDK Configuration: 00:05:15.414 Core mask: 0x1 00:05:15.414 00:05:15.414 Accel Perf Configuration: 00:05:15.414 Workload Type: dualcast 00:05:15.414 Transfer size: 4096 bytes 00:05:15.414 Vector count 1 00:05:15.414 Module: software 00:05:15.414 Queue depth: 32 00:05:15.414 Allocate depth: 32 00:05:15.414 # threads/core: 1 00:05:15.414 Run time: 1 seconds 00:05:15.414 Verify: Yes 00:05:15.414 00:05:15.414 Running for 1 seconds... 00:05:15.414 00:05:15.414 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:15.414 ------------------------------------------------------------------------------------ 00:05:15.414 0,0 298400/s 1165 MiB/s 0 0 00:05:15.414 ==================================================================================== 00:05:15.414 Total 298400/s 1165 MiB/s 0 0' 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:15.414 11:29:35 -- accel/accel.sh@12 -- # build_accel_config 00:05:15.414 11:29:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:15.414 11:29:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:15.414 11:29:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:15.414 11:29:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:15.414 11:29:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:15.414 11:29:35 -- accel/accel.sh@41 -- # local IFS=, 00:05:15.414 11:29:35 -- accel/accel.sh@42 -- # jq -r . 00:05:15.414 [2024-11-28 11:29:35.125082] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:15.414 [2024-11-28 11:29:35.125160] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3695245 ] 00:05:15.414 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.414 [2024-11-28 11:29:35.189883] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:15.414 [2024-11-28 11:29:35.310161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val= 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val= 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val=0x1 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val= 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val= 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val=dualcast 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val= 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val=software 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@23 -- # accel_module=software 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val=32 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val=32 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val=1 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val=Yes 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val= 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:15.414 11:29:35 -- accel/accel.sh@21 -- # val= 00:05:15.414 11:29:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # IFS=: 00:05:15.414 11:29:35 -- accel/accel.sh@20 -- # read -r var val 00:05:16.789 11:29:36 -- accel/accel.sh@21 -- # val= 00:05:16.789 11:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.789 11:29:36 -- accel/accel.sh@20 -- # IFS=: 00:05:16.789 11:29:36 -- accel/accel.sh@20 -- # read -r var val 00:05:16.789 11:29:36 -- accel/accel.sh@21 -- # val= 00:05:16.789 11:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.789 11:29:36 -- accel/accel.sh@20 -- # IFS=: 00:05:16.789 11:29:36 -- accel/accel.sh@20 -- # read -r var val 00:05:16.789 11:29:36 -- accel/accel.sh@21 -- # val= 00:05:16.789 11:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.789 11:29:36 -- accel/accel.sh@20 -- # IFS=: 00:05:16.789 11:29:36 -- accel/accel.sh@20 -- # read -r var val 00:05:16.789 11:29:36 -- accel/accel.sh@21 -- # val= 00:05:16.789 11:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.789 11:29:36 -- accel/accel.sh@20 -- # IFS=: 00:05:16.789 11:29:36 -- accel/accel.sh@20 -- # read -r var val 00:05:16.789 11:29:36 -- accel/accel.sh@21 -- # val= 00:05:16.789 11:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.789 11:29:36 -- accel/accel.sh@20 -- # IFS=: 00:05:16.789 11:29:36 -- accel/accel.sh@20 -- # read -r var val 00:05:16.789 11:29:36 -- accel/accel.sh@21 -- # val= 00:05:16.789 11:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.789 11:29:36 -- accel/accel.sh@20 -- # IFS=: 00:05:16.789 11:29:36 -- accel/accel.sh@20 -- # read -r var val 00:05:16.789 11:29:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:16.789 11:29:36 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:16.789 11:29:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:16.789 00:05:16.789 real 0m2.961s 00:05:16.789 user 0m2.647s 00:05:16.789 sys 0m0.305s 00:05:16.789 11:29:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:16.789 11:29:36 -- common/autotest_common.sh@10 -- # set +x 00:05:16.789 ************************************ 00:05:16.789 END TEST accel_dualcast 00:05:16.789 ************************************ 00:05:16.789 11:29:36 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:16.789 11:29:36 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:16.789 11:29:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:16.789 11:29:36 -- common/autotest_common.sh@10 -- # set +x 00:05:16.790 ************************************ 00:05:16.790 START TEST accel_compare 00:05:16.790 ************************************ 00:05:16.790 11:29:36 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:16.790 11:29:36 -- accel/accel.sh@16 -- # local accel_opc 00:05:16.790 11:29:36 -- accel/accel.sh@17 -- # local accel_module 00:05:16.790 11:29:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:16.790 11:29:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:16.790 11:29:36 -- accel/accel.sh@12 -- # build_accel_config 00:05:16.790 11:29:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:16.790 11:29:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:16.790 11:29:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:16.790 11:29:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:16.790 11:29:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:16.790 11:29:36 -- accel/accel.sh@41 -- # local IFS=, 00:05:16.790 11:29:36 -- accel/accel.sh@42 -- # jq -r . 00:05:16.790 [2024-11-28 11:29:36.641173] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:16.790 [2024-11-28 11:29:36.641253] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3695401 ] 00:05:16.790 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.790 [2024-11-28 11:29:36.702336] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:16.790 [2024-11-28 11:29:36.822927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.164 11:29:38 -- accel/accel.sh@18 -- # out=' 00:05:18.164 SPDK Configuration: 00:05:18.164 Core mask: 0x1 00:05:18.164 00:05:18.164 Accel Perf Configuration: 00:05:18.164 Workload Type: compare 00:05:18.164 Transfer size: 4096 bytes 00:05:18.164 Vector count 1 00:05:18.164 Module: software 00:05:18.164 Queue depth: 32 00:05:18.164 Allocate depth: 32 00:05:18.164 # threads/core: 1 00:05:18.164 Run time: 1 seconds 00:05:18.164 Verify: Yes 00:05:18.164 00:05:18.164 Running for 1 seconds... 00:05:18.164 00:05:18.164 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:18.164 ------------------------------------------------------------------------------------ 00:05:18.164 0,0 398432/s 1556 MiB/s 0 0 00:05:18.164 ==================================================================================== 00:05:18.164 Total 398432/s 1556 MiB/s 0 0' 00:05:18.164 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.164 11:29:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:18.164 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.164 11:29:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:18.164 11:29:38 -- accel/accel.sh@12 -- # build_accel_config 00:05:18.164 11:29:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:18.164 11:29:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:18.164 11:29:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:18.164 11:29:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:18.164 11:29:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:18.164 11:29:38 -- accel/accel.sh@41 -- # local IFS=, 00:05:18.164 11:29:38 -- accel/accel.sh@42 -- # jq -r . 00:05:18.164 [2024-11-28 11:29:38.124348] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:18.164 [2024-11-28 11:29:38.124430] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3695545 ] 00:05:18.164 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.164 [2024-11-28 11:29:38.190506] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.423 [2024-11-28 11:29:38.310157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val= 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val= 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val=0x1 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val= 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val= 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val=compare 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val= 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val=software 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@23 -- # accel_module=software 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val=32 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val=32 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val=1 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val=Yes 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val= 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:18.423 11:29:38 -- accel/accel.sh@21 -- # val= 00:05:18.423 11:29:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # IFS=: 00:05:18.423 11:29:38 -- accel/accel.sh@20 -- # read -r var val 00:05:19.798 11:29:39 -- accel/accel.sh@21 -- # val= 00:05:19.798 11:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.798 11:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:19.798 11:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:19.798 11:29:39 -- accel/accel.sh@21 -- # val= 00:05:19.798 11:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.798 11:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:19.798 11:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:19.798 11:29:39 -- accel/accel.sh@21 -- # val= 00:05:19.798 11:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.798 11:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:19.798 11:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:19.798 11:29:39 -- accel/accel.sh@21 -- # val= 00:05:19.798 11:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.798 11:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:19.798 11:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:19.798 11:29:39 -- accel/accel.sh@21 -- # val= 00:05:19.798 11:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.798 11:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:19.798 11:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:19.798 11:29:39 -- accel/accel.sh@21 -- # val= 00:05:19.798 11:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.798 11:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:19.798 11:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:19.798 11:29:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:19.798 11:29:39 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:19.798 11:29:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:19.798 00:05:19.798 real 0m2.966s 00:05:19.798 user 0m2.671s 00:05:19.798 sys 0m0.286s 00:05:19.798 11:29:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.798 11:29:39 -- common/autotest_common.sh@10 -- # set +x 00:05:19.798 ************************************ 00:05:19.798 END TEST accel_compare 00:05:19.798 ************************************ 00:05:19.799 11:29:39 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:19.799 11:29:39 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:19.799 11:29:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.799 11:29:39 -- common/autotest_common.sh@10 -- # set +x 00:05:19.799 ************************************ 00:05:19.799 START TEST accel_xor 00:05:19.799 ************************************ 00:05:19.799 11:29:39 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:19.799 11:29:39 -- accel/accel.sh@16 -- # local accel_opc 00:05:19.799 11:29:39 -- accel/accel.sh@17 -- # local accel_module 00:05:19.799 11:29:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:19.799 11:29:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:19.799 11:29:39 -- accel/accel.sh@12 -- # build_accel_config 00:05:19.799 11:29:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:19.799 11:29:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:19.799 11:29:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:19.799 11:29:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:19.799 11:29:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:19.799 11:29:39 -- accel/accel.sh@41 -- # local IFS=, 00:05:19.799 11:29:39 -- accel/accel.sh@42 -- # jq -r . 00:05:19.799 [2024-11-28 11:29:39.632384] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:19.799 [2024-11-28 11:29:39.632461] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3695828 ] 00:05:19.799 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.799 [2024-11-28 11:29:39.693466] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:19.799 [2024-11-28 11:29:39.812245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.174 11:29:41 -- accel/accel.sh@18 -- # out=' 00:05:21.174 SPDK Configuration: 00:05:21.174 Core mask: 0x1 00:05:21.174 00:05:21.174 Accel Perf Configuration: 00:05:21.174 Workload Type: xor 00:05:21.174 Source buffers: 2 00:05:21.174 Transfer size: 4096 bytes 00:05:21.174 Vector count 1 00:05:21.174 Module: software 00:05:21.174 Queue depth: 32 00:05:21.174 Allocate depth: 32 00:05:21.174 # threads/core: 1 00:05:21.174 Run time: 1 seconds 00:05:21.174 Verify: Yes 00:05:21.174 00:05:21.174 Running for 1 seconds... 00:05:21.174 00:05:21.174 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:21.174 ------------------------------------------------------------------------------------ 00:05:21.174 0,0 189952/s 742 MiB/s 0 0 00:05:21.174 ==================================================================================== 00:05:21.174 Total 189952/s 742 MiB/s 0 0' 00:05:21.174 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.174 11:29:41 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:21.174 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.174 11:29:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:21.174 11:29:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:21.174 11:29:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:21.174 11:29:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:21.174 11:29:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:21.174 11:29:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:21.174 11:29:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:21.174 11:29:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:21.174 11:29:41 -- accel/accel.sh@42 -- # jq -r . 00:05:21.174 [2024-11-28 11:29:41.115127] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:21.174 [2024-11-28 11:29:41.115206] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3695967 ] 00:05:21.174 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.174 [2024-11-28 11:29:41.180455] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.432 [2024-11-28 11:29:41.300786] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.432 11:29:41 -- accel/accel.sh@21 -- # val= 00:05:21.432 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.432 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.432 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.432 11:29:41 -- accel/accel.sh@21 -- # val= 00:05:21.432 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.432 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.432 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.432 11:29:41 -- accel/accel.sh@21 -- # val=0x1 00:05:21.432 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.432 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.432 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.432 11:29:41 -- accel/accel.sh@21 -- # val= 00:05:21.432 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.432 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.432 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.432 11:29:41 -- accel/accel.sh@21 -- # val= 00:05:21.432 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.432 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.432 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.432 11:29:41 -- accel/accel.sh@21 -- # val=xor 00:05:21.432 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.432 11:29:41 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:21.432 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.432 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.432 11:29:41 -- accel/accel.sh@21 -- # val=2 00:05:21.432 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.432 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.432 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.432 11:29:41 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:21.433 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.433 11:29:41 -- accel/accel.sh@21 -- # val= 00:05:21.433 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.433 11:29:41 -- accel/accel.sh@21 -- # val=software 00:05:21.433 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.433 11:29:41 -- accel/accel.sh@23 -- # accel_module=software 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.433 11:29:41 -- accel/accel.sh@21 -- # val=32 00:05:21.433 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.433 11:29:41 -- accel/accel.sh@21 -- # val=32 00:05:21.433 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.433 11:29:41 -- accel/accel.sh@21 -- # val=1 00:05:21.433 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.433 11:29:41 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:21.433 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.433 11:29:41 -- accel/accel.sh@21 -- # val=Yes 00:05:21.433 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.433 11:29:41 -- accel/accel.sh@21 -- # val= 00:05:21.433 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:21.433 11:29:41 -- accel/accel.sh@21 -- # val= 00:05:21.433 11:29:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # IFS=: 00:05:21.433 11:29:41 -- accel/accel.sh@20 -- # read -r var val 00:05:22.806 11:29:42 -- accel/accel.sh@21 -- # val= 00:05:22.806 11:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.806 11:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:22.806 11:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:22.806 11:29:42 -- accel/accel.sh@21 -- # val= 00:05:22.806 11:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.806 11:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:22.806 11:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:22.806 11:29:42 -- accel/accel.sh@21 -- # val= 00:05:22.806 11:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.806 11:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:22.806 11:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:22.806 11:29:42 -- accel/accel.sh@21 -- # val= 00:05:22.806 11:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.806 11:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:22.806 11:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:22.806 11:29:42 -- accel/accel.sh@21 -- # val= 00:05:22.806 11:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.806 11:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:22.806 11:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:22.806 11:29:42 -- accel/accel.sh@21 -- # val= 00:05:22.806 11:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.806 11:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:22.806 11:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:22.806 11:29:42 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:22.806 11:29:42 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:22.806 11:29:42 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:22.806 00:05:22.806 real 0m2.973s 00:05:22.806 user 0m2.673s 00:05:22.806 sys 0m0.290s 00:05:22.806 11:29:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.806 11:29:42 -- common/autotest_common.sh@10 -- # set +x 00:05:22.806 ************************************ 00:05:22.806 END TEST accel_xor 00:05:22.806 ************************************ 00:05:22.806 11:29:42 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:22.806 11:29:42 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:22.806 11:29:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.806 11:29:42 -- common/autotest_common.sh@10 -- # set +x 00:05:22.806 ************************************ 00:05:22.806 START TEST accel_xor 00:05:22.806 ************************************ 00:05:22.806 11:29:42 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:05:22.806 11:29:42 -- accel/accel.sh@16 -- # local accel_opc 00:05:22.806 11:29:42 -- accel/accel.sh@17 -- # local accel_module 00:05:22.806 11:29:42 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:22.806 11:29:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:22.806 11:29:42 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.806 11:29:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.806 11:29:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.806 11:29:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.806 11:29:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.806 11:29:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.806 11:29:42 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.806 11:29:42 -- accel/accel.sh@42 -- # jq -r . 00:05:22.806 [2024-11-28 11:29:42.634387] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.806 [2024-11-28 11:29:42.634471] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3696128 ] 00:05:22.806 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.806 [2024-11-28 11:29:42.697187] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.806 [2024-11-28 11:29:42.817633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.180 11:29:44 -- accel/accel.sh@18 -- # out=' 00:05:24.180 SPDK Configuration: 00:05:24.180 Core mask: 0x1 00:05:24.180 00:05:24.180 Accel Perf Configuration: 00:05:24.180 Workload Type: xor 00:05:24.180 Source buffers: 3 00:05:24.180 Transfer size: 4096 bytes 00:05:24.180 Vector count 1 00:05:24.180 Module: software 00:05:24.180 Queue depth: 32 00:05:24.180 Allocate depth: 32 00:05:24.180 # threads/core: 1 00:05:24.180 Run time: 1 seconds 00:05:24.180 Verify: Yes 00:05:24.180 00:05:24.180 Running for 1 seconds... 00:05:24.180 00:05:24.180 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:24.180 ------------------------------------------------------------------------------------ 00:05:24.180 0,0 183136/s 715 MiB/s 0 0 00:05:24.180 ==================================================================================== 00:05:24.180 Total 183136/s 715 MiB/s 0 0' 00:05:24.180 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.180 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.180 11:29:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:24.180 11:29:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:24.180 11:29:44 -- accel/accel.sh@12 -- # build_accel_config 00:05:24.180 11:29:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:24.180 11:29:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:24.180 11:29:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:24.180 11:29:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:24.180 11:29:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:24.180 11:29:44 -- accel/accel.sh@41 -- # local IFS=, 00:05:24.180 11:29:44 -- accel/accel.sh@42 -- # jq -r . 00:05:24.180 [2024-11-28 11:29:44.112978] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:24.180 [2024-11-28 11:29:44.113059] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3696389 ] 00:05:24.180 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.180 [2024-11-28 11:29:44.178497] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.438 [2024-11-28 11:29:44.296233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.438 11:29:44 -- accel/accel.sh@21 -- # val= 00:05:24.438 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.438 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.438 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.438 11:29:44 -- accel/accel.sh@21 -- # val= 00:05:24.438 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.438 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.438 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.438 11:29:44 -- accel/accel.sh@21 -- # val=0x1 00:05:24.438 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.438 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.438 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.438 11:29:44 -- accel/accel.sh@21 -- # val= 00:05:24.438 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.438 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.438 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.438 11:29:44 -- accel/accel.sh@21 -- # val= 00:05:24.438 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.438 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.438 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.438 11:29:44 -- accel/accel.sh@21 -- # val=xor 00:05:24.438 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.438 11:29:44 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:24.438 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.438 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.438 11:29:44 -- accel/accel.sh@21 -- # val=3 00:05:24.438 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.439 11:29:44 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:24.439 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.439 11:29:44 -- accel/accel.sh@21 -- # val= 00:05:24.439 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.439 11:29:44 -- accel/accel.sh@21 -- # val=software 00:05:24.439 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.439 11:29:44 -- accel/accel.sh@23 -- # accel_module=software 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.439 11:29:44 -- accel/accel.sh@21 -- # val=32 00:05:24.439 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.439 11:29:44 -- accel/accel.sh@21 -- # val=32 00:05:24.439 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.439 11:29:44 -- accel/accel.sh@21 -- # val=1 00:05:24.439 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.439 11:29:44 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:24.439 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.439 11:29:44 -- accel/accel.sh@21 -- # val=Yes 00:05:24.439 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.439 11:29:44 -- accel/accel.sh@21 -- # val= 00:05:24.439 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:24.439 11:29:44 -- accel/accel.sh@21 -- # val= 00:05:24.439 11:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # IFS=: 00:05:24.439 11:29:44 -- accel/accel.sh@20 -- # read -r var val 00:05:25.809 11:29:45 -- accel/accel.sh@21 -- # val= 00:05:25.809 11:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.809 11:29:45 -- accel/accel.sh@20 -- # IFS=: 00:05:25.809 11:29:45 -- accel/accel.sh@20 -- # read -r var val 00:05:25.809 11:29:45 -- accel/accel.sh@21 -- # val= 00:05:25.809 11:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.809 11:29:45 -- accel/accel.sh@20 -- # IFS=: 00:05:25.809 11:29:45 -- accel/accel.sh@20 -- # read -r var val 00:05:25.809 11:29:45 -- accel/accel.sh@21 -- # val= 00:05:25.809 11:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.809 11:29:45 -- accel/accel.sh@20 -- # IFS=: 00:05:25.809 11:29:45 -- accel/accel.sh@20 -- # read -r var val 00:05:25.809 11:29:45 -- accel/accel.sh@21 -- # val= 00:05:25.809 11:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.809 11:29:45 -- accel/accel.sh@20 -- # IFS=: 00:05:25.809 11:29:45 -- accel/accel.sh@20 -- # read -r var val 00:05:25.809 11:29:45 -- accel/accel.sh@21 -- # val= 00:05:25.809 11:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.809 11:29:45 -- accel/accel.sh@20 -- # IFS=: 00:05:25.809 11:29:45 -- accel/accel.sh@20 -- # read -r var val 00:05:25.809 11:29:45 -- accel/accel.sh@21 -- # val= 00:05:25.809 11:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.809 11:29:45 -- accel/accel.sh@20 -- # IFS=: 00:05:25.809 11:29:45 -- accel/accel.sh@20 -- # read -r var val 00:05:25.809 11:29:45 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:25.809 11:29:45 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:25.809 11:29:45 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:25.809 00:05:25.809 real 0m2.951s 00:05:25.809 user 0m2.639s 00:05:25.809 sys 0m0.302s 00:05:25.809 11:29:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.809 11:29:45 -- common/autotest_common.sh@10 -- # set +x 00:05:25.809 ************************************ 00:05:25.809 END TEST accel_xor 00:05:25.809 ************************************ 00:05:25.809 11:29:45 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:25.809 11:29:45 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:25.809 11:29:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.809 11:29:45 -- common/autotest_common.sh@10 -- # set +x 00:05:25.809 ************************************ 00:05:25.809 START TEST accel_dif_verify 00:05:25.809 ************************************ 00:05:25.809 11:29:45 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:05:25.809 11:29:45 -- accel/accel.sh@16 -- # local accel_opc 00:05:25.809 11:29:45 -- accel/accel.sh@17 -- # local accel_module 00:05:25.809 11:29:45 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:25.809 11:29:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:25.809 11:29:45 -- accel/accel.sh@12 -- # build_accel_config 00:05:25.809 11:29:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:25.809 11:29:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:25.809 11:29:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:25.809 11:29:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:25.809 11:29:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:25.809 11:29:45 -- accel/accel.sh@41 -- # local IFS=, 00:05:25.809 11:29:45 -- accel/accel.sh@42 -- # jq -r . 00:05:25.809 [2024-11-28 11:29:45.610451] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.809 [2024-11-28 11:29:45.610545] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3696556 ] 00:05:25.809 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.809 [2024-11-28 11:29:45.671991] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.809 [2024-11-28 11:29:45.792249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.183 11:29:47 -- accel/accel.sh@18 -- # out=' 00:05:27.183 SPDK Configuration: 00:05:27.183 Core mask: 0x1 00:05:27.183 00:05:27.183 Accel Perf Configuration: 00:05:27.183 Workload Type: dif_verify 00:05:27.183 Vector size: 4096 bytes 00:05:27.183 Transfer size: 4096 bytes 00:05:27.183 Block size: 512 bytes 00:05:27.183 Metadata size: 8 bytes 00:05:27.183 Vector count 1 00:05:27.183 Module: software 00:05:27.183 Queue depth: 32 00:05:27.183 Allocate depth: 32 00:05:27.183 # threads/core: 1 00:05:27.183 Run time: 1 seconds 00:05:27.183 Verify: No 00:05:27.183 00:05:27.183 Running for 1 seconds... 00:05:27.183 00:05:27.183 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:27.183 ------------------------------------------------------------------------------------ 00:05:27.183 0,0 81984/s 325 MiB/s 0 0 00:05:27.183 ==================================================================================== 00:05:27.183 Total 81984/s 320 MiB/s 0 0' 00:05:27.183 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.183 11:29:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:27.183 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.183 11:29:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:27.183 11:29:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.183 11:29:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.183 11:29:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.183 11:29:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.183 11:29:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.183 11:29:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.183 11:29:47 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.183 11:29:47 -- accel/accel.sh@42 -- # jq -r . 00:05:27.183 [2024-11-28 11:29:47.095308] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:27.183 [2024-11-28 11:29:47.095390] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3696694 ] 00:05:27.183 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.183 [2024-11-28 11:29:47.161885] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.441 [2024-11-28 11:29:47.284907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val= 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val= 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val=0x1 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val= 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val= 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val=dif_verify 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val= 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val=software 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@23 -- # accel_module=software 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val=32 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val=32 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val=1 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val=No 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val= 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:27.441 11:29:47 -- accel/accel.sh@21 -- # val= 00:05:27.441 11:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # IFS=: 00:05:27.441 11:29:47 -- accel/accel.sh@20 -- # read -r var val 00:05:28.815 11:29:48 -- accel/accel.sh@21 -- # val= 00:05:28.815 11:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.815 11:29:48 -- accel/accel.sh@20 -- # IFS=: 00:05:28.815 11:29:48 -- accel/accel.sh@20 -- # read -r var val 00:05:28.815 11:29:48 -- accel/accel.sh@21 -- # val= 00:05:28.815 11:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.815 11:29:48 -- accel/accel.sh@20 -- # IFS=: 00:05:28.816 11:29:48 -- accel/accel.sh@20 -- # read -r var val 00:05:28.816 11:29:48 -- accel/accel.sh@21 -- # val= 00:05:28.816 11:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.816 11:29:48 -- accel/accel.sh@20 -- # IFS=: 00:05:28.816 11:29:48 -- accel/accel.sh@20 -- # read -r var val 00:05:28.816 11:29:48 -- accel/accel.sh@21 -- # val= 00:05:28.816 11:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.816 11:29:48 -- accel/accel.sh@20 -- # IFS=: 00:05:28.816 11:29:48 -- accel/accel.sh@20 -- # read -r var val 00:05:28.816 11:29:48 -- accel/accel.sh@21 -- # val= 00:05:28.816 11:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.816 11:29:48 -- accel/accel.sh@20 -- # IFS=: 00:05:28.816 11:29:48 -- accel/accel.sh@20 -- # read -r var val 00:05:28.816 11:29:48 -- accel/accel.sh@21 -- # val= 00:05:28.816 11:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.816 11:29:48 -- accel/accel.sh@20 -- # IFS=: 00:05:28.816 11:29:48 -- accel/accel.sh@20 -- # read -r var val 00:05:28.816 11:29:48 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:28.816 11:29:48 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:05:28.816 11:29:48 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:28.816 00:05:28.816 real 0m2.975s 00:05:28.816 user 0m2.674s 00:05:28.816 sys 0m0.295s 00:05:28.816 11:29:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.816 11:29:48 -- common/autotest_common.sh@10 -- # set +x 00:05:28.816 ************************************ 00:05:28.816 END TEST accel_dif_verify 00:05:28.816 ************************************ 00:05:28.816 11:29:48 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:05:28.816 11:29:48 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:28.816 11:29:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.816 11:29:48 -- common/autotest_common.sh@10 -- # set +x 00:05:28.816 ************************************ 00:05:28.816 START TEST accel_dif_generate 00:05:28.816 ************************************ 00:05:28.816 11:29:48 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:05:28.816 11:29:48 -- accel/accel.sh@16 -- # local accel_opc 00:05:28.816 11:29:48 -- accel/accel.sh@17 -- # local accel_module 00:05:28.816 11:29:48 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:05:28.816 11:29:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:28.816 11:29:48 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.816 11:29:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.816 11:29:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.816 11:29:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.816 11:29:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.816 11:29:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.816 11:29:48 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.816 11:29:48 -- accel/accel.sh@42 -- # jq -r . 00:05:28.816 [2024-11-28 11:29:48.610997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:28.816 [2024-11-28 11:29:48.611075] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3696974 ] 00:05:28.816 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.816 [2024-11-28 11:29:48.676290] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.816 [2024-11-28 11:29:48.795769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.190 11:29:50 -- accel/accel.sh@18 -- # out=' 00:05:30.190 SPDK Configuration: 00:05:30.190 Core mask: 0x1 00:05:30.190 00:05:30.190 Accel Perf Configuration: 00:05:30.190 Workload Type: dif_generate 00:05:30.190 Vector size: 4096 bytes 00:05:30.190 Transfer size: 4096 bytes 00:05:30.190 Block size: 512 bytes 00:05:30.190 Metadata size: 8 bytes 00:05:30.190 Vector count 1 00:05:30.190 Module: software 00:05:30.190 Queue depth: 32 00:05:30.190 Allocate depth: 32 00:05:30.190 # threads/core: 1 00:05:30.190 Run time: 1 seconds 00:05:30.190 Verify: No 00:05:30.190 00:05:30.190 Running for 1 seconds... 00:05:30.190 00:05:30.190 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:30.190 ------------------------------------------------------------------------------------ 00:05:30.190 0,0 96224/s 381 MiB/s 0 0 00:05:30.190 ==================================================================================== 00:05:30.190 Total 96224/s 375 MiB/s 0 0' 00:05:30.190 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.190 11:29:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:05:30.190 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.190 11:29:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:30.190 11:29:50 -- accel/accel.sh@12 -- # build_accel_config 00:05:30.190 11:29:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:30.190 11:29:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:30.190 11:29:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:30.190 11:29:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:30.190 11:29:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:30.190 11:29:50 -- accel/accel.sh@41 -- # local IFS=, 00:05:30.190 11:29:50 -- accel/accel.sh@42 -- # jq -r . 00:05:30.190 [2024-11-28 11:29:50.096398] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:30.190 [2024-11-28 11:29:50.096479] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3697121 ] 00:05:30.190 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.190 [2024-11-28 11:29:50.164226] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.448 [2024-11-28 11:29:50.283699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.448 11:29:50 -- accel/accel.sh@21 -- # val= 00:05:30.448 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.448 11:29:50 -- accel/accel.sh@21 -- # val= 00:05:30.448 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.448 11:29:50 -- accel/accel.sh@21 -- # val=0x1 00:05:30.448 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.448 11:29:50 -- accel/accel.sh@21 -- # val= 00:05:30.448 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.448 11:29:50 -- accel/accel.sh@21 -- # val= 00:05:30.448 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.448 11:29:50 -- accel/accel.sh@21 -- # val=dif_generate 00:05:30.448 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.448 11:29:50 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.448 11:29:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:30.448 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.448 11:29:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:30.448 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.448 11:29:50 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:30.448 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.448 11:29:50 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:30.448 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.448 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.448 11:29:50 -- accel/accel.sh@21 -- # val= 00:05:30.449 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.449 11:29:50 -- accel/accel.sh@21 -- # val=software 00:05:30.449 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.449 11:29:50 -- accel/accel.sh@23 -- # accel_module=software 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.449 11:29:50 -- accel/accel.sh@21 -- # val=32 00:05:30.449 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.449 11:29:50 -- accel/accel.sh@21 -- # val=32 00:05:30.449 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.449 11:29:50 -- accel/accel.sh@21 -- # val=1 00:05:30.449 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.449 11:29:50 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:30.449 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.449 11:29:50 -- accel/accel.sh@21 -- # val=No 00:05:30.449 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.449 11:29:50 -- accel/accel.sh@21 -- # val= 00:05:30.449 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:30.449 11:29:50 -- accel/accel.sh@21 -- # val= 00:05:30.449 11:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # IFS=: 00:05:30.449 11:29:50 -- accel/accel.sh@20 -- # read -r var val 00:05:31.823 11:29:51 -- accel/accel.sh@21 -- # val= 00:05:31.823 11:29:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.823 11:29:51 -- accel/accel.sh@20 -- # IFS=: 00:05:31.823 11:29:51 -- accel/accel.sh@20 -- # read -r var val 00:05:31.823 11:29:51 -- accel/accel.sh@21 -- # val= 00:05:31.823 11:29:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.823 11:29:51 -- accel/accel.sh@20 -- # IFS=: 00:05:31.823 11:29:51 -- accel/accel.sh@20 -- # read -r var val 00:05:31.823 11:29:51 -- accel/accel.sh@21 -- # val= 00:05:31.823 11:29:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.823 11:29:51 -- accel/accel.sh@20 -- # IFS=: 00:05:31.823 11:29:51 -- accel/accel.sh@20 -- # read -r var val 00:05:31.823 11:29:51 -- accel/accel.sh@21 -- # val= 00:05:31.823 11:29:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.823 11:29:51 -- accel/accel.sh@20 -- # IFS=: 00:05:31.823 11:29:51 -- accel/accel.sh@20 -- # read -r var val 00:05:31.823 11:29:51 -- accel/accel.sh@21 -- # val= 00:05:31.823 11:29:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.823 11:29:51 -- accel/accel.sh@20 -- # IFS=: 00:05:31.823 11:29:51 -- accel/accel.sh@20 -- # read -r var val 00:05:31.823 11:29:51 -- accel/accel.sh@21 -- # val= 00:05:31.823 11:29:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.823 11:29:51 -- accel/accel.sh@20 -- # IFS=: 00:05:31.823 11:29:51 -- accel/accel.sh@20 -- # read -r var val 00:05:31.823 11:29:51 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:31.823 11:29:51 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:05:31.823 11:29:51 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:31.823 00:05:31.823 real 0m2.974s 00:05:31.823 user 0m2.670s 00:05:31.823 sys 0m0.297s 00:05:31.823 11:29:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.823 11:29:51 -- common/autotest_common.sh@10 -- # set +x 00:05:31.823 ************************************ 00:05:31.823 END TEST accel_dif_generate 00:05:31.823 ************************************ 00:05:31.823 11:29:51 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:05:31.823 11:29:51 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:31.823 11:29:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.823 11:29:51 -- common/autotest_common.sh@10 -- # set +x 00:05:31.823 ************************************ 00:05:31.823 START TEST accel_dif_generate_copy 00:05:31.823 ************************************ 00:05:31.824 11:29:51 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:05:31.824 11:29:51 -- accel/accel.sh@16 -- # local accel_opc 00:05:31.824 11:29:51 -- accel/accel.sh@17 -- # local accel_module 00:05:31.824 11:29:51 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:05:31.824 11:29:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:31.824 11:29:51 -- accel/accel.sh@12 -- # build_accel_config 00:05:31.824 11:29:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:31.824 11:29:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:31.824 11:29:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:31.824 11:29:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:31.824 11:29:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:31.824 11:29:51 -- accel/accel.sh@41 -- # local IFS=, 00:05:31.824 11:29:51 -- accel/accel.sh@42 -- # jq -r . 00:05:31.824 [2024-11-28 11:29:51.611287] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.824 [2024-11-28 11:29:51.611367] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3697283 ] 00:05:31.824 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.824 [2024-11-28 11:29:51.677239] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.824 [2024-11-28 11:29:51.797854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.196 11:29:53 -- accel/accel.sh@18 -- # out=' 00:05:33.196 SPDK Configuration: 00:05:33.196 Core mask: 0x1 00:05:33.196 00:05:33.196 Accel Perf Configuration: 00:05:33.196 Workload Type: dif_generate_copy 00:05:33.196 Vector size: 4096 bytes 00:05:33.196 Transfer size: 4096 bytes 00:05:33.196 Vector count 1 00:05:33.196 Module: software 00:05:33.196 Queue depth: 32 00:05:33.196 Allocate depth: 32 00:05:33.196 # threads/core: 1 00:05:33.196 Run time: 1 seconds 00:05:33.196 Verify: No 00:05:33.196 00:05:33.196 Running for 1 seconds... 00:05:33.196 00:05:33.196 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:33.196 ------------------------------------------------------------------------------------ 00:05:33.196 0,0 76064/s 301 MiB/s 0 0 00:05:33.196 ==================================================================================== 00:05:33.196 Total 76064/s 297 MiB/s 0 0' 00:05:33.196 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.196 11:29:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:05:33.196 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.196 11:29:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:33.196 11:29:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.196 11:29:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.196 11:29:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.196 11:29:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.196 11:29:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.196 11:29:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.196 11:29:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.196 11:29:53 -- accel/accel.sh@42 -- # jq -r . 00:05:33.196 [2024-11-28 11:29:53.093924] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.196 [2024-11-28 11:29:53.094007] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3697540 ] 00:05:33.196 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.196 [2024-11-28 11:29:53.162123] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.455 [2024-11-28 11:29:53.283625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val= 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val= 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val=0x1 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val= 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val= 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val= 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val=software 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@23 -- # accel_module=software 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val=32 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val=32 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val=1 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val=No 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val= 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:33.455 11:29:53 -- accel/accel.sh@21 -- # val= 00:05:33.455 11:29:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # IFS=: 00:05:33.455 11:29:53 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 11:29:54 -- accel/accel.sh@21 -- # val= 00:05:34.902 11:29:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 11:29:54 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 11:29:54 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 11:29:54 -- accel/accel.sh@21 -- # val= 00:05:34.902 11:29:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 11:29:54 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 11:29:54 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 11:29:54 -- accel/accel.sh@21 -- # val= 00:05:34.902 11:29:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 11:29:54 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 11:29:54 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 11:29:54 -- accel/accel.sh@21 -- # val= 00:05:34.902 11:29:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 11:29:54 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 11:29:54 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 11:29:54 -- accel/accel.sh@21 -- # val= 00:05:34.902 11:29:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 11:29:54 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 11:29:54 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 11:29:54 -- accel/accel.sh@21 -- # val= 00:05:34.902 11:29:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 11:29:54 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 11:29:54 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 11:29:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:34.902 11:29:54 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:05:34.902 11:29:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:34.902 00:05:34.902 real 0m2.972s 00:05:34.902 user 0m2.666s 00:05:34.902 sys 0m0.296s 00:05:34.902 11:29:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.902 11:29:54 -- common/autotest_common.sh@10 -- # set +x 00:05:34.902 ************************************ 00:05:34.902 END TEST accel_dif_generate_copy 00:05:34.902 ************************************ 00:05:34.902 11:29:54 -- accel/accel.sh@107 -- # [[ y == y ]] 00:05:34.902 11:29:54 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:34.902 11:29:54 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:34.902 11:29:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.902 11:29:54 -- common/autotest_common.sh@10 -- # set +x 00:05:34.902 ************************************ 00:05:34.902 START TEST accel_comp 00:05:34.902 ************************************ 00:05:34.902 11:29:54 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:34.902 11:29:54 -- accel/accel.sh@16 -- # local accel_opc 00:05:34.902 11:29:54 -- accel/accel.sh@17 -- # local accel_module 00:05:34.902 11:29:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:34.902 11:29:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:34.902 11:29:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:34.902 11:29:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.902 11:29:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.902 11:29:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.902 11:29:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.902 11:29:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.902 11:29:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.902 11:29:54 -- accel/accel.sh@42 -- # jq -r . 00:05:34.902 [2024-11-28 11:29:54.610023] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:34.902 [2024-11-28 11:29:54.610103] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3697711 ] 00:05:34.902 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.902 [2024-11-28 11:29:54.671986] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.902 [2024-11-28 11:29:54.793392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.302 11:29:56 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:36.302 00:05:36.302 SPDK Configuration: 00:05:36.302 Core mask: 0x1 00:05:36.302 00:05:36.302 Accel Perf Configuration: 00:05:36.302 Workload Type: compress 00:05:36.302 Transfer size: 4096 bytes 00:05:36.302 Vector count 1 00:05:36.302 Module: software 00:05:36.302 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:36.302 Queue depth: 32 00:05:36.302 Allocate depth: 32 00:05:36.302 # threads/core: 1 00:05:36.302 Run time: 1 seconds 00:05:36.302 Verify: No 00:05:36.302 00:05:36.302 Running for 1 seconds... 00:05:36.302 00:05:36.302 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:36.302 ------------------------------------------------------------------------------------ 00:05:36.302 0,0 31456/s 131 MiB/s 0 0 00:05:36.302 ==================================================================================== 00:05:36.302 Total 31456/s 122 MiB/s 0 0' 00:05:36.302 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.302 11:29:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:36.302 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.302 11:29:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:36.302 11:29:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.302 11:29:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.302 11:29:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.302 11:29:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.302 11:29:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.302 11:29:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.302 11:29:56 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.302 11:29:56 -- accel/accel.sh@42 -- # jq -r . 00:05:36.302 [2024-11-28 11:29:56.086163] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.302 [2024-11-28 11:29:56.086242] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3697854 ] 00:05:36.302 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.302 [2024-11-28 11:29:56.152324] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.302 [2024-11-28 11:29:56.273932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.302 11:29:56 -- accel/accel.sh@21 -- # val= 00:05:36.302 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.302 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.302 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.302 11:29:56 -- accel/accel.sh@21 -- # val= 00:05:36.302 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.302 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.302 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.302 11:29:56 -- accel/accel.sh@21 -- # val= 00:05:36.302 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.302 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.302 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.302 11:29:56 -- accel/accel.sh@21 -- # val=0x1 00:05:36.302 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.302 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.302 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.302 11:29:56 -- accel/accel.sh@21 -- # val= 00:05:36.302 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.302 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.302 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.302 11:29:56 -- accel/accel.sh@21 -- # val= 00:05:36.302 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.302 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.302 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.302 11:29:56 -- accel/accel.sh@21 -- # val=compress 00:05:36.303 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.303 11:29:56 -- accel/accel.sh@24 -- # accel_opc=compress 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.303 11:29:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.303 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.303 11:29:56 -- accel/accel.sh@21 -- # val= 00:05:36.303 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.303 11:29:56 -- accel/accel.sh@21 -- # val=software 00:05:36.303 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.303 11:29:56 -- accel/accel.sh@23 -- # accel_module=software 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.303 11:29:56 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:36.303 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.303 11:29:56 -- accel/accel.sh@21 -- # val=32 00:05:36.303 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.303 11:29:56 -- accel/accel.sh@21 -- # val=32 00:05:36.303 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.303 11:29:56 -- accel/accel.sh@21 -- # val=1 00:05:36.303 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.303 11:29:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:36.303 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.303 11:29:56 -- accel/accel.sh@21 -- # val=No 00:05:36.303 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.303 11:29:56 -- accel/accel.sh@21 -- # val= 00:05:36.303 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:36.303 11:29:56 -- accel/accel.sh@21 -- # val= 00:05:36.303 11:29:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # IFS=: 00:05:36.303 11:29:56 -- accel/accel.sh@20 -- # read -r var val 00:05:37.677 11:29:57 -- accel/accel.sh@21 -- # val= 00:05:37.677 11:29:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.677 11:29:57 -- accel/accel.sh@20 -- # IFS=: 00:05:37.677 11:29:57 -- accel/accel.sh@20 -- # read -r var val 00:05:37.677 11:29:57 -- accel/accel.sh@21 -- # val= 00:05:37.677 11:29:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.677 11:29:57 -- accel/accel.sh@20 -- # IFS=: 00:05:37.677 11:29:57 -- accel/accel.sh@20 -- # read -r var val 00:05:37.677 11:29:57 -- accel/accel.sh@21 -- # val= 00:05:37.677 11:29:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.677 11:29:57 -- accel/accel.sh@20 -- # IFS=: 00:05:37.677 11:29:57 -- accel/accel.sh@20 -- # read -r var val 00:05:37.677 11:29:57 -- accel/accel.sh@21 -- # val= 00:05:37.677 11:29:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.677 11:29:57 -- accel/accel.sh@20 -- # IFS=: 00:05:37.677 11:29:57 -- accel/accel.sh@20 -- # read -r var val 00:05:37.677 11:29:57 -- accel/accel.sh@21 -- # val= 00:05:37.677 11:29:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.677 11:29:57 -- accel/accel.sh@20 -- # IFS=: 00:05:37.677 11:29:57 -- accel/accel.sh@20 -- # read -r var val 00:05:37.677 11:29:57 -- accel/accel.sh@21 -- # val= 00:05:37.677 11:29:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.677 11:29:57 -- accel/accel.sh@20 -- # IFS=: 00:05:37.677 11:29:57 -- accel/accel.sh@20 -- # read -r var val 00:05:37.677 11:29:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:37.677 11:29:57 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:05:37.677 11:29:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:37.677 00:05:37.677 real 0m2.970s 00:05:37.677 user 0m2.667s 00:05:37.677 sys 0m0.296s 00:05:37.677 11:29:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:37.677 11:29:57 -- common/autotest_common.sh@10 -- # set +x 00:05:37.677 ************************************ 00:05:37.677 END TEST accel_comp 00:05:37.677 ************************************ 00:05:37.677 11:29:57 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:37.677 11:29:57 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:37.677 11:29:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.677 11:29:57 -- common/autotest_common.sh@10 -- # set +x 00:05:37.677 ************************************ 00:05:37.677 START TEST accel_decomp 00:05:37.677 ************************************ 00:05:37.677 11:29:57 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:37.677 11:29:57 -- accel/accel.sh@16 -- # local accel_opc 00:05:37.677 11:29:57 -- accel/accel.sh@17 -- # local accel_module 00:05:37.677 11:29:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:37.677 11:29:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:37.677 11:29:57 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.677 11:29:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.677 11:29:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.677 11:29:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.677 11:29:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.677 11:29:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.677 11:29:57 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.677 11:29:57 -- accel/accel.sh@42 -- # jq -r . 00:05:37.677 [2024-11-28 11:29:57.606600] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:37.677 [2024-11-28 11:29:57.606680] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3698096 ] 00:05:37.677 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.677 [2024-11-28 11:29:57.668854] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.935 [2024-11-28 11:29:57.790085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.310 11:29:59 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:39.310 00:05:39.310 SPDK Configuration: 00:05:39.310 Core mask: 0x1 00:05:39.310 00:05:39.310 Accel Perf Configuration: 00:05:39.310 Workload Type: decompress 00:05:39.310 Transfer size: 4096 bytes 00:05:39.310 Vector count 1 00:05:39.310 Module: software 00:05:39.310 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:39.310 Queue depth: 32 00:05:39.310 Allocate depth: 32 00:05:39.310 # threads/core: 1 00:05:39.310 Run time: 1 seconds 00:05:39.310 Verify: Yes 00:05:39.310 00:05:39.310 Running for 1 seconds... 00:05:39.310 00:05:39.310 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:39.310 ------------------------------------------------------------------------------------ 00:05:39.310 0,0 55328/s 101 MiB/s 0 0 00:05:39.310 ==================================================================================== 00:05:39.310 Total 55328/s 216 MiB/s 0 0' 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:39.310 11:29:59 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.310 11:29:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.310 11:29:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.310 11:29:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.310 11:29:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.310 11:29:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.310 11:29:59 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.310 11:29:59 -- accel/accel.sh@42 -- # jq -r . 00:05:39.310 [2024-11-28 11:29:59.094268] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.310 [2024-11-28 11:29:59.094350] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3698275 ] 00:05:39.310 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.310 [2024-11-28 11:29:59.159601] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.310 [2024-11-28 11:29:59.280079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val= 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val= 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val= 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val=0x1 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val= 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val= 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val=decompress 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val= 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val=software 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@23 -- # accel_module=software 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val=32 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val=32 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val=1 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val=Yes 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val= 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.310 11:29:59 -- accel/accel.sh@21 -- # val= 00:05:39.310 11:29:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.310 11:29:59 -- accel/accel.sh@20 -- # read -r var val 00:05:40.686 11:30:00 -- accel/accel.sh@21 -- # val= 00:05:40.686 11:30:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.686 11:30:00 -- accel/accel.sh@20 -- # IFS=: 00:05:40.686 11:30:00 -- accel/accel.sh@20 -- # read -r var val 00:05:40.686 11:30:00 -- accel/accel.sh@21 -- # val= 00:05:40.686 11:30:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.686 11:30:00 -- accel/accel.sh@20 -- # IFS=: 00:05:40.686 11:30:00 -- accel/accel.sh@20 -- # read -r var val 00:05:40.686 11:30:00 -- accel/accel.sh@21 -- # val= 00:05:40.686 11:30:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.686 11:30:00 -- accel/accel.sh@20 -- # IFS=: 00:05:40.686 11:30:00 -- accel/accel.sh@20 -- # read -r var val 00:05:40.686 11:30:00 -- accel/accel.sh@21 -- # val= 00:05:40.686 11:30:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.686 11:30:00 -- accel/accel.sh@20 -- # IFS=: 00:05:40.686 11:30:00 -- accel/accel.sh@20 -- # read -r var val 00:05:40.686 11:30:00 -- accel/accel.sh@21 -- # val= 00:05:40.686 11:30:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.686 11:30:00 -- accel/accel.sh@20 -- # IFS=: 00:05:40.686 11:30:00 -- accel/accel.sh@20 -- # read -r var val 00:05:40.686 11:30:00 -- accel/accel.sh@21 -- # val= 00:05:40.686 11:30:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.686 11:30:00 -- accel/accel.sh@20 -- # IFS=: 00:05:40.686 11:30:00 -- accel/accel.sh@20 -- # read -r var val 00:05:40.686 11:30:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:40.686 11:30:00 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:40.686 11:30:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:40.686 00:05:40.686 real 0m2.972s 00:05:40.686 user 0m2.672s 00:05:40.686 sys 0m0.292s 00:05:40.686 11:30:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.686 11:30:00 -- common/autotest_common.sh@10 -- # set +x 00:05:40.686 ************************************ 00:05:40.686 END TEST accel_decomp 00:05:40.686 ************************************ 00:05:40.686 11:30:00 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:40.686 11:30:00 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:40.686 11:30:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.686 11:30:00 -- common/autotest_common.sh@10 -- # set +x 00:05:40.686 ************************************ 00:05:40.686 START TEST accel_decmop_full 00:05:40.686 ************************************ 00:05:40.686 11:30:00 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:40.686 11:30:00 -- accel/accel.sh@16 -- # local accel_opc 00:05:40.686 11:30:00 -- accel/accel.sh@17 -- # local accel_module 00:05:40.686 11:30:00 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:40.686 11:30:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:40.686 11:30:00 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.686 11:30:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.686 11:30:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.686 11:30:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.686 11:30:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.686 11:30:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.686 11:30:00 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.686 11:30:00 -- accel/accel.sh@42 -- # jq -r . 00:05:40.686 [2024-11-28 11:30:00.604968] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.686 [2024-11-28 11:30:00.605047] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3698480 ] 00:05:40.686 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.686 [2024-11-28 11:30:00.667957] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.945 [2024-11-28 11:30:00.786097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.316 11:30:02 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:42.316 00:05:42.316 SPDK Configuration: 00:05:42.316 Core mask: 0x1 00:05:42.316 00:05:42.316 Accel Perf Configuration: 00:05:42.316 Workload Type: decompress 00:05:42.316 Transfer size: 111250 bytes 00:05:42.316 Vector count 1 00:05:42.316 Module: software 00:05:42.316 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:42.316 Queue depth: 32 00:05:42.316 Allocate depth: 32 00:05:42.316 # threads/core: 1 00:05:42.316 Run time: 1 seconds 00:05:42.316 Verify: Yes 00:05:42.316 00:05:42.316 Running for 1 seconds... 00:05:42.316 00:05:42.316 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:42.316 ------------------------------------------------------------------------------------ 00:05:42.316 0,0 3808/s 157 MiB/s 0 0 00:05:42.316 ==================================================================================== 00:05:42.316 Total 3808/s 404 MiB/s 0 0' 00:05:42.316 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.316 11:30:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:42.316 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.316 11:30:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:42.316 11:30:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.316 11:30:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.316 11:30:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.316 11:30:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.316 11:30:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.316 11:30:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.316 11:30:02 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.316 11:30:02 -- accel/accel.sh@42 -- # jq -r . 00:05:42.316 [2024-11-28 11:30:02.091044] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.317 [2024-11-28 11:30:02.091123] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3698714 ] 00:05:42.317 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.317 [2024-11-28 11:30:02.157237] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.317 [2024-11-28 11:30:02.275776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val= 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val= 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val= 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val=0x1 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val= 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val= 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val=decompress 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val= 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val=software 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@23 -- # accel_module=software 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val=32 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val=32 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val=1 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val=Yes 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val= 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.317 11:30:02 -- accel/accel.sh@21 -- # val= 00:05:42.317 11:30:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.317 11:30:02 -- accel/accel.sh@20 -- # read -r var val 00:05:43.692 11:30:03 -- accel/accel.sh@21 -- # val= 00:05:43.692 11:30:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.692 11:30:03 -- accel/accel.sh@20 -- # IFS=: 00:05:43.692 11:30:03 -- accel/accel.sh@20 -- # read -r var val 00:05:43.692 11:30:03 -- accel/accel.sh@21 -- # val= 00:05:43.692 11:30:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.692 11:30:03 -- accel/accel.sh@20 -- # IFS=: 00:05:43.692 11:30:03 -- accel/accel.sh@20 -- # read -r var val 00:05:43.692 11:30:03 -- accel/accel.sh@21 -- # val= 00:05:43.692 11:30:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.692 11:30:03 -- accel/accel.sh@20 -- # IFS=: 00:05:43.692 11:30:03 -- accel/accel.sh@20 -- # read -r var val 00:05:43.692 11:30:03 -- accel/accel.sh@21 -- # val= 00:05:43.692 11:30:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.692 11:30:03 -- accel/accel.sh@20 -- # IFS=: 00:05:43.692 11:30:03 -- accel/accel.sh@20 -- # read -r var val 00:05:43.692 11:30:03 -- accel/accel.sh@21 -- # val= 00:05:43.692 11:30:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.692 11:30:03 -- accel/accel.sh@20 -- # IFS=: 00:05:43.692 11:30:03 -- accel/accel.sh@20 -- # read -r var val 00:05:43.692 11:30:03 -- accel/accel.sh@21 -- # val= 00:05:43.692 11:30:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.692 11:30:03 -- accel/accel.sh@20 -- # IFS=: 00:05:43.692 11:30:03 -- accel/accel.sh@20 -- # read -r var val 00:05:43.692 11:30:03 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:43.692 11:30:03 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:43.692 11:30:03 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:43.692 00:05:43.692 real 0m2.979s 00:05:43.692 user 0m2.694s 00:05:43.692 sys 0m0.274s 00:05:43.692 11:30:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.692 11:30:03 -- common/autotest_common.sh@10 -- # set +x 00:05:43.692 ************************************ 00:05:43.692 END TEST accel_decmop_full 00:05:43.692 ************************************ 00:05:43.692 11:30:03 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:43.692 11:30:03 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:43.692 11:30:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.692 11:30:03 -- common/autotest_common.sh@10 -- # set +x 00:05:43.692 ************************************ 00:05:43.692 START TEST accel_decomp_mcore 00:05:43.692 ************************************ 00:05:43.692 11:30:03 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:43.692 11:30:03 -- accel/accel.sh@16 -- # local accel_opc 00:05:43.692 11:30:03 -- accel/accel.sh@17 -- # local accel_module 00:05:43.692 11:30:03 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:43.692 11:30:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:43.692 11:30:03 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.692 11:30:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.692 11:30:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.692 11:30:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.692 11:30:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.692 11:30:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.692 11:30:03 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.692 11:30:03 -- accel/accel.sh@42 -- # jq -r . 00:05:43.692 [2024-11-28 11:30:03.611768] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:43.692 [2024-11-28 11:30:03.611851] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3698975 ] 00:05:43.692 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.692 [2024-11-28 11:30:03.669225] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:43.950 [2024-11-28 11:30:03.791640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:43.950 [2024-11-28 11:30:03.791694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:43.950 [2024-11-28 11:30:03.791745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:43.950 [2024-11-28 11:30:03.791748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.324 11:30:05 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:45.324 00:05:45.324 SPDK Configuration: 00:05:45.324 Core mask: 0xf 00:05:45.324 00:05:45.324 Accel Perf Configuration: 00:05:45.324 Workload Type: decompress 00:05:45.324 Transfer size: 4096 bytes 00:05:45.324 Vector count 1 00:05:45.324 Module: software 00:05:45.324 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:45.324 Queue depth: 32 00:05:45.324 Allocate depth: 32 00:05:45.324 # threads/core: 1 00:05:45.324 Run time: 1 seconds 00:05:45.324 Verify: Yes 00:05:45.324 00:05:45.324 Running for 1 seconds... 00:05:45.324 00:05:45.324 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:45.324 ------------------------------------------------------------------------------------ 00:05:45.324 0,0 54272/s 100 MiB/s 0 0 00:05:45.324 3,0 54656/s 100 MiB/s 0 0 00:05:45.324 2,0 54720/s 100 MiB/s 0 0 00:05:45.324 1,0 54432/s 100 MiB/s 0 0 00:05:45.324 ==================================================================================== 00:05:45.324 Total 218080/s 851 MiB/s 0 0' 00:05:45.324 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.324 11:30:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:45.324 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.324 11:30:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:45.324 11:30:05 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.324 11:30:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.324 11:30:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.324 11:30:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.324 11:30:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.324 11:30:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.324 11:30:05 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.324 11:30:05 -- accel/accel.sh@42 -- # jq -r . 00:05:45.324 [2024-11-28 11:30:05.088518] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.324 [2024-11-28 11:30:05.088624] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3699120 ] 00:05:45.324 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.324 [2024-11-28 11:30:05.151881] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:45.324 [2024-11-28 11:30:05.275815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:45.324 [2024-11-28 11:30:05.275871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:45.324 [2024-11-28 11:30:05.275924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:45.324 [2024-11-28 11:30:05.275928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.324 11:30:05 -- accel/accel.sh@21 -- # val= 00:05:45.324 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.324 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.324 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.324 11:30:05 -- accel/accel.sh@21 -- # val= 00:05:45.324 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.324 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.324 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.324 11:30:05 -- accel/accel.sh@21 -- # val= 00:05:45.324 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.324 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.324 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.324 11:30:05 -- accel/accel.sh@21 -- # val=0xf 00:05:45.324 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.324 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.324 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.325 11:30:05 -- accel/accel.sh@21 -- # val= 00:05:45.325 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.325 11:30:05 -- accel/accel.sh@21 -- # val= 00:05:45.325 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.325 11:30:05 -- accel/accel.sh@21 -- # val=decompress 00:05:45.325 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.325 11:30:05 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.325 11:30:05 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:45.325 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.325 11:30:05 -- accel/accel.sh@21 -- # val= 00:05:45.325 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.325 11:30:05 -- accel/accel.sh@21 -- # val=software 00:05:45.325 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.325 11:30:05 -- accel/accel.sh@23 -- # accel_module=software 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.325 11:30:05 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:45.325 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.325 11:30:05 -- accel/accel.sh@21 -- # val=32 00:05:45.325 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.325 11:30:05 -- accel/accel.sh@21 -- # val=32 00:05:45.325 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.325 11:30:05 -- accel/accel.sh@21 -- # val=1 00:05:45.325 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.325 11:30:05 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:45.325 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.325 11:30:05 -- accel/accel.sh@21 -- # val=Yes 00:05:45.325 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.325 11:30:05 -- accel/accel.sh@21 -- # val= 00:05:45.325 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.325 11:30:05 -- accel/accel.sh@21 -- # val= 00:05:45.325 11:30:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.325 11:30:05 -- accel/accel.sh@20 -- # read -r var val 00:05:46.700 11:30:06 -- accel/accel.sh@21 -- # val= 00:05:46.700 11:30:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.700 11:30:06 -- accel/accel.sh@20 -- # IFS=: 00:05:46.700 11:30:06 -- accel/accel.sh@20 -- # read -r var val 00:05:46.700 11:30:06 -- accel/accel.sh@21 -- # val= 00:05:46.700 11:30:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.700 11:30:06 -- accel/accel.sh@20 -- # IFS=: 00:05:46.700 11:30:06 -- accel/accel.sh@20 -- # read -r var val 00:05:46.700 11:30:06 -- accel/accel.sh@21 -- # val= 00:05:46.700 11:30:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.700 11:30:06 -- accel/accel.sh@20 -- # IFS=: 00:05:46.700 11:30:06 -- accel/accel.sh@20 -- # read -r var val 00:05:46.700 11:30:06 -- accel/accel.sh@21 -- # val= 00:05:46.700 11:30:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.700 11:30:06 -- accel/accel.sh@20 -- # IFS=: 00:05:46.700 11:30:06 -- accel/accel.sh@20 -- # read -r var val 00:05:46.700 11:30:06 -- accel/accel.sh@21 -- # val= 00:05:46.700 11:30:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.700 11:30:06 -- accel/accel.sh@20 -- # IFS=: 00:05:46.700 11:30:06 -- accel/accel.sh@20 -- # read -r var val 00:05:46.700 11:30:06 -- accel/accel.sh@21 -- # val= 00:05:46.700 11:30:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.700 11:30:06 -- accel/accel.sh@20 -- # IFS=: 00:05:46.700 11:30:06 -- accel/accel.sh@20 -- # read -r var val 00:05:46.700 11:30:06 -- accel/accel.sh@21 -- # val= 00:05:46.701 11:30:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.701 11:30:06 -- accel/accel.sh@20 -- # IFS=: 00:05:46.701 11:30:06 -- accel/accel.sh@20 -- # read -r var val 00:05:46.701 11:30:06 -- accel/accel.sh@21 -- # val= 00:05:46.701 11:30:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.701 11:30:06 -- accel/accel.sh@20 -- # IFS=: 00:05:46.701 11:30:06 -- accel/accel.sh@20 -- # read -r var val 00:05:46.701 11:30:06 -- accel/accel.sh@21 -- # val= 00:05:46.701 11:30:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.701 11:30:06 -- accel/accel.sh@20 -- # IFS=: 00:05:46.701 11:30:06 -- accel/accel.sh@20 -- # read -r var val 00:05:46.701 11:30:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:46.701 11:30:06 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:46.701 11:30:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:46.701 00:05:46.701 real 0m2.979s 00:05:46.701 user 0m9.582s 00:05:46.701 sys 0m0.305s 00:05:46.701 11:30:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.701 11:30:06 -- common/autotest_common.sh@10 -- # set +x 00:05:46.701 ************************************ 00:05:46.701 END TEST accel_decomp_mcore 00:05:46.701 ************************************ 00:05:46.701 11:30:06 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:46.701 11:30:06 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:46.701 11:30:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.701 11:30:06 -- common/autotest_common.sh@10 -- # set +x 00:05:46.701 ************************************ 00:05:46.701 START TEST accel_decomp_full_mcore 00:05:46.701 ************************************ 00:05:46.701 11:30:06 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:46.701 11:30:06 -- accel/accel.sh@16 -- # local accel_opc 00:05:46.701 11:30:06 -- accel/accel.sh@17 -- # local accel_module 00:05:46.701 11:30:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:46.701 11:30:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:46.701 11:30:06 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.701 11:30:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.701 11:30:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.701 11:30:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.701 11:30:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.701 11:30:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.701 11:30:06 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.701 11:30:06 -- accel/accel.sh@42 -- # jq -r . 00:05:46.701 [2024-11-28 11:30:06.617233] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:46.701 [2024-11-28 11:30:06.617314] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3699341 ] 00:05:46.701 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.701 [2024-11-28 11:30:06.677148] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:46.959 [2024-11-28 11:30:06.799173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:46.959 [2024-11-28 11:30:06.799241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:46.959 [2024-11-28 11:30:06.799328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:46.959 [2024-11-28 11:30:06.799331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.333 11:30:08 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:48.333 00:05:48.333 SPDK Configuration: 00:05:48.333 Core mask: 0xf 00:05:48.333 00:05:48.333 Accel Perf Configuration: 00:05:48.333 Workload Type: decompress 00:05:48.333 Transfer size: 111250 bytes 00:05:48.333 Vector count 1 00:05:48.333 Module: software 00:05:48.333 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:48.334 Queue depth: 32 00:05:48.334 Allocate depth: 32 00:05:48.334 # threads/core: 1 00:05:48.334 Run time: 1 seconds 00:05:48.334 Verify: Yes 00:05:48.334 00:05:48.334 Running for 1 seconds... 00:05:48.334 00:05:48.334 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:48.334 ------------------------------------------------------------------------------------ 00:05:48.334 0,0 4256/s 175 MiB/s 0 0 00:05:48.334 3,0 4256/s 175 MiB/s 0 0 00:05:48.334 2,0 4256/s 175 MiB/s 0 0 00:05:48.334 1,0 4256/s 175 MiB/s 0 0 00:05:48.334 ==================================================================================== 00:05:48.334 Total 17024/s 1806 MiB/s 0 0' 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:48.334 11:30:08 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.334 11:30:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.334 11:30:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.334 11:30:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.334 11:30:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.334 11:30:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.334 11:30:08 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.334 11:30:08 -- accel/accel.sh@42 -- # jq -r . 00:05:48.334 [2024-11-28 11:30:08.108817] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.334 [2024-11-28 11:30:08.108899] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3699867 ] 00:05:48.334 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.334 [2024-11-28 11:30:08.173323] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:48.334 [2024-11-28 11:30:08.294860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:48.334 [2024-11-28 11:30:08.294915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:48.334 [2024-11-28 11:30:08.294970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:48.334 [2024-11-28 11:30:08.294973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val= 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val= 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val= 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val=0xf 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val= 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val= 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val=decompress 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val= 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val=software 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@23 -- # accel_module=software 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val=32 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val=32 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val=1 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val=Yes 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val= 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.334 11:30:08 -- accel/accel.sh@21 -- # val= 00:05:48.334 11:30:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.334 11:30:08 -- accel/accel.sh@20 -- # read -r var val 00:05:49.708 11:30:09 -- accel/accel.sh@21 -- # val= 00:05:49.708 11:30:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # IFS=: 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # read -r var val 00:05:49.708 11:30:09 -- accel/accel.sh@21 -- # val= 00:05:49.708 11:30:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # IFS=: 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # read -r var val 00:05:49.708 11:30:09 -- accel/accel.sh@21 -- # val= 00:05:49.708 11:30:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # IFS=: 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # read -r var val 00:05:49.708 11:30:09 -- accel/accel.sh@21 -- # val= 00:05:49.708 11:30:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # IFS=: 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # read -r var val 00:05:49.708 11:30:09 -- accel/accel.sh@21 -- # val= 00:05:49.708 11:30:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # IFS=: 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # read -r var val 00:05:49.708 11:30:09 -- accel/accel.sh@21 -- # val= 00:05:49.708 11:30:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # IFS=: 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # read -r var val 00:05:49.708 11:30:09 -- accel/accel.sh@21 -- # val= 00:05:49.708 11:30:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # IFS=: 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # read -r var val 00:05:49.708 11:30:09 -- accel/accel.sh@21 -- # val= 00:05:49.708 11:30:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # IFS=: 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # read -r var val 00:05:49.708 11:30:09 -- accel/accel.sh@21 -- # val= 00:05:49.708 11:30:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # IFS=: 00:05:49.708 11:30:09 -- accel/accel.sh@20 -- # read -r var val 00:05:49.708 11:30:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:49.708 11:30:09 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:49.708 11:30:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:49.708 00:05:49.708 real 0m2.995s 00:05:49.708 user 0m9.630s 00:05:49.708 sys 0m0.317s 00:05:49.708 11:30:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:49.708 11:30:09 -- common/autotest_common.sh@10 -- # set +x 00:05:49.708 ************************************ 00:05:49.708 END TEST accel_decomp_full_mcore 00:05:49.708 ************************************ 00:05:49.708 11:30:09 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:49.708 11:30:09 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:49.708 11:30:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.708 11:30:09 -- common/autotest_common.sh@10 -- # set +x 00:05:49.708 ************************************ 00:05:49.708 START TEST accel_decomp_mthread 00:05:49.708 ************************************ 00:05:49.708 11:30:09 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:49.708 11:30:09 -- accel/accel.sh@16 -- # local accel_opc 00:05:49.708 11:30:09 -- accel/accel.sh@17 -- # local accel_module 00:05:49.708 11:30:09 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:49.708 11:30:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:49.708 11:30:09 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.708 11:30:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.708 11:30:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.708 11:30:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.709 11:30:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.709 11:30:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.709 11:30:09 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.709 11:30:09 -- accel/accel.sh@42 -- # jq -r . 00:05:49.709 [2024-11-28 11:30:09.636223] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:49.709 [2024-11-28 11:30:09.636301] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3700222 ] 00:05:49.709 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.709 [2024-11-28 11:30:09.699476] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.967 [2024-11-28 11:30:09.819934] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.340 11:30:11 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:51.340 00:05:51.340 SPDK Configuration: 00:05:51.340 Core mask: 0x1 00:05:51.340 00:05:51.340 Accel Perf Configuration: 00:05:51.340 Workload Type: decompress 00:05:51.340 Transfer size: 4096 bytes 00:05:51.340 Vector count 1 00:05:51.340 Module: software 00:05:51.340 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:51.340 Queue depth: 32 00:05:51.340 Allocate depth: 32 00:05:51.340 # threads/core: 2 00:05:51.340 Run time: 1 seconds 00:05:51.340 Verify: Yes 00:05:51.340 00:05:51.340 Running for 1 seconds... 00:05:51.340 00:05:51.340 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:51.340 ------------------------------------------------------------------------------------ 00:05:51.340 0,1 27904/s 51 MiB/s 0 0 00:05:51.340 0,0 27808/s 51 MiB/s 0 0 00:05:51.340 ==================================================================================== 00:05:51.340 Total 55712/s 217 MiB/s 0 0' 00:05:51.340 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.340 11:30:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:51.340 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.340 11:30:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:51.340 11:30:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.340 11:30:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.341 11:30:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.341 11:30:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.341 11:30:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.341 11:30:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.341 11:30:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.341 11:30:11 -- accel/accel.sh@42 -- # jq -r . 00:05:51.341 [2024-11-28 11:30:11.130610] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:51.341 [2024-11-28 11:30:11.130695] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3700406 ] 00:05:51.341 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.341 [2024-11-28 11:30:11.195442] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.341 [2024-11-28 11:30:11.315092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val= 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val= 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val= 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val=0x1 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val= 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val= 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val=decompress 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val= 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val=software 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@23 -- # accel_module=software 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val=32 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val=32 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val=2 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val=Yes 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val= 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:51.341 11:30:11 -- accel/accel.sh@21 -- # val= 00:05:51.341 11:30:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # IFS=: 00:05:51.341 11:30:11 -- accel/accel.sh@20 -- # read -r var val 00:05:52.718 11:30:12 -- accel/accel.sh@21 -- # val= 00:05:52.718 11:30:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.718 11:30:12 -- accel/accel.sh@20 -- # IFS=: 00:05:52.718 11:30:12 -- accel/accel.sh@20 -- # read -r var val 00:05:52.718 11:30:12 -- accel/accel.sh@21 -- # val= 00:05:52.718 11:30:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.718 11:30:12 -- accel/accel.sh@20 -- # IFS=: 00:05:52.718 11:30:12 -- accel/accel.sh@20 -- # read -r var val 00:05:52.718 11:30:12 -- accel/accel.sh@21 -- # val= 00:05:52.718 11:30:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.718 11:30:12 -- accel/accel.sh@20 -- # IFS=: 00:05:52.718 11:30:12 -- accel/accel.sh@20 -- # read -r var val 00:05:52.718 11:30:12 -- accel/accel.sh@21 -- # val= 00:05:52.718 11:30:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.718 11:30:12 -- accel/accel.sh@20 -- # IFS=: 00:05:52.718 11:30:12 -- accel/accel.sh@20 -- # read -r var val 00:05:52.718 11:30:12 -- accel/accel.sh@21 -- # val= 00:05:52.718 11:30:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.718 11:30:12 -- accel/accel.sh@20 -- # IFS=: 00:05:52.718 11:30:12 -- accel/accel.sh@20 -- # read -r var val 00:05:52.718 11:30:12 -- accel/accel.sh@21 -- # val= 00:05:52.718 11:30:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.718 11:30:12 -- accel/accel.sh@20 -- # IFS=: 00:05:52.718 11:30:12 -- accel/accel.sh@20 -- # read -r var val 00:05:52.718 11:30:12 -- accel/accel.sh@21 -- # val= 00:05:52.718 11:30:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.719 11:30:12 -- accel/accel.sh@20 -- # IFS=: 00:05:52.719 11:30:12 -- accel/accel.sh@20 -- # read -r var val 00:05:52.719 11:30:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:52.719 11:30:12 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:52.719 11:30:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.719 00:05:52.719 real 0m2.976s 00:05:52.719 user 0m2.681s 00:05:52.719 sys 0m0.286s 00:05:52.719 11:30:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.719 11:30:12 -- common/autotest_common.sh@10 -- # set +x 00:05:52.719 ************************************ 00:05:52.719 END TEST accel_decomp_mthread 00:05:52.719 ************************************ 00:05:52.719 11:30:12 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:52.719 11:30:12 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:52.719 11:30:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.719 11:30:12 -- common/autotest_common.sh@10 -- # set +x 00:05:52.719 ************************************ 00:05:52.719 START TEST accel_deomp_full_mthread 00:05:52.719 ************************************ 00:05:52.719 11:30:12 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:52.719 11:30:12 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.719 11:30:12 -- accel/accel.sh@17 -- # local accel_module 00:05:52.719 11:30:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:52.719 11:30:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:52.719 11:30:12 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.719 11:30:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.719 11:30:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.719 11:30:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.719 11:30:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.719 11:30:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.719 11:30:12 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.719 11:30:12 -- accel/accel.sh@42 -- # jq -r . 00:05:52.719 [2024-11-28 11:30:12.638732] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.719 [2024-11-28 11:30:12.638812] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3700648 ] 00:05:52.719 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.719 [2024-11-28 11:30:12.705332] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.977 [2024-11-28 11:30:12.826129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.352 11:30:14 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:54.352 00:05:54.352 SPDK Configuration: 00:05:54.352 Core mask: 0x1 00:05:54.352 00:05:54.352 Accel Perf Configuration: 00:05:54.352 Workload Type: decompress 00:05:54.352 Transfer size: 111250 bytes 00:05:54.352 Vector count 1 00:05:54.352 Module: software 00:05:54.352 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:54.352 Queue depth: 32 00:05:54.352 Allocate depth: 32 00:05:54.352 # threads/core: 2 00:05:54.352 Run time: 1 seconds 00:05:54.352 Verify: Yes 00:05:54.352 00:05:54.352 Running for 1 seconds... 00:05:54.352 00:05:54.352 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:54.352 ------------------------------------------------------------------------------------ 00:05:54.352 0,1 1952/s 80 MiB/s 0 0 00:05:54.352 0,0 1920/s 79 MiB/s 0 0 00:05:54.352 ==================================================================================== 00:05:54.352 Total 3872/s 410 MiB/s 0 0' 00:05:54.352 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.352 11:30:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:54.352 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.352 11:30:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:54.352 11:30:14 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.352 11:30:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.352 11:30:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.352 11:30:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.352 11:30:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.352 11:30:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.352 11:30:14 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.352 11:30:14 -- accel/accel.sh@42 -- # jq -r . 00:05:54.353 [2024-11-28 11:30:14.167102] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.353 [2024-11-28 11:30:14.167185] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3700787 ] 00:05:54.353 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.353 [2024-11-28 11:30:14.233105] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.353 [2024-11-28 11:30:14.350972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val= 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val= 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val= 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val=0x1 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val= 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val= 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val=decompress 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val= 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val=software 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@23 -- # accel_module=software 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val=32 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val=32 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val=2 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val=Yes 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val= 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:54.611 11:30:14 -- accel/accel.sh@21 -- # val= 00:05:54.611 11:30:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # IFS=: 00:05:54.611 11:30:14 -- accel/accel.sh@20 -- # read -r var val 00:05:55.984 11:30:15 -- accel/accel.sh@21 -- # val= 00:05:55.984 11:30:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.984 11:30:15 -- accel/accel.sh@20 -- # IFS=: 00:05:55.984 11:30:15 -- accel/accel.sh@20 -- # read -r var val 00:05:55.984 11:30:15 -- accel/accel.sh@21 -- # val= 00:05:55.984 11:30:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.984 11:30:15 -- accel/accel.sh@20 -- # IFS=: 00:05:55.984 11:30:15 -- accel/accel.sh@20 -- # read -r var val 00:05:55.984 11:30:15 -- accel/accel.sh@21 -- # val= 00:05:55.984 11:30:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.984 11:30:15 -- accel/accel.sh@20 -- # IFS=: 00:05:55.984 11:30:15 -- accel/accel.sh@20 -- # read -r var val 00:05:55.984 11:30:15 -- accel/accel.sh@21 -- # val= 00:05:55.984 11:30:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.984 11:30:15 -- accel/accel.sh@20 -- # IFS=: 00:05:55.984 11:30:15 -- accel/accel.sh@20 -- # read -r var val 00:05:55.984 11:30:15 -- accel/accel.sh@21 -- # val= 00:05:55.984 11:30:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.984 11:30:15 -- accel/accel.sh@20 -- # IFS=: 00:05:55.984 11:30:15 -- accel/accel.sh@20 -- # read -r var val 00:05:55.984 11:30:15 -- accel/accel.sh@21 -- # val= 00:05:55.984 11:30:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.984 11:30:15 -- accel/accel.sh@20 -- # IFS=: 00:05:55.984 11:30:15 -- accel/accel.sh@20 -- # read -r var val 00:05:55.984 11:30:15 -- accel/accel.sh@21 -- # val= 00:05:55.984 11:30:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.984 11:30:15 -- accel/accel.sh@20 -- # IFS=: 00:05:55.984 11:30:15 -- accel/accel.sh@20 -- # read -r var val 00:05:55.984 11:30:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:55.984 11:30:15 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:55.984 11:30:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:55.984 00:05:55.984 real 0m3.051s 00:05:55.984 user 0m2.744s 00:05:55.984 sys 0m0.299s 00:05:55.984 11:30:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:55.984 11:30:15 -- common/autotest_common.sh@10 -- # set +x 00:05:55.984 ************************************ 00:05:55.984 END TEST accel_deomp_full_mthread 00:05:55.984 ************************************ 00:05:55.984 11:30:15 -- accel/accel.sh@116 -- # [[ n == y ]] 00:05:55.984 11:30:15 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:05:55.984 11:30:15 -- accel/accel.sh@129 -- # build_accel_config 00:05:55.984 11:30:15 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:55.984 11:30:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.984 11:30:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.984 11:30:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.984 11:30:15 -- common/autotest_common.sh@10 -- # set +x 00:05:55.984 11:30:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.984 11:30:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.984 11:30:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.984 11:30:15 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.984 11:30:15 -- accel/accel.sh@42 -- # jq -r . 00:05:55.984 ************************************ 00:05:55.984 START TEST accel_dif_functional_tests 00:05:55.984 ************************************ 00:05:55.984 11:30:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:05:55.984 [2024-11-28 11:30:15.736832] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:55.984 [2024-11-28 11:30:15.736919] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3701015 ] 00:05:55.984 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.984 [2024-11-28 11:30:15.804329] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:55.984 [2024-11-28 11:30:15.927506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:55.984 [2024-11-28 11:30:15.927560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:55.984 [2024-11-28 11:30:15.927564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.984 00:05:55.984 00:05:55.984 CUnit - A unit testing framework for C - Version 2.1-3 00:05:55.985 http://cunit.sourceforge.net/ 00:05:55.985 00:05:55.985 00:05:55.985 Suite: accel_dif 00:05:55.985 Test: verify: DIF generated, GUARD check ...passed 00:05:55.985 Test: verify: DIF generated, APPTAG check ...passed 00:05:55.985 Test: verify: DIF generated, REFTAG check ...passed 00:05:55.985 Test: verify: DIF not generated, GUARD check ...[2024-11-28 11:30:16.028495] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:05:55.985 [2024-11-28 11:30:16.028567] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:05:55.985 passed 00:05:55.985 Test: verify: DIF not generated, APPTAG check ...[2024-11-28 11:30:16.028621] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:05:55.985 [2024-11-28 11:30:16.028655] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:05:55.985 passed 00:05:55.985 Test: verify: DIF not generated, REFTAG check ...[2024-11-28 11:30:16.028701] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:05:55.985 [2024-11-28 11:30:16.028732] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:05:55.985 passed 00:05:55.985 Test: verify: APPTAG correct, APPTAG check ...passed 00:05:55.985 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-28 11:30:16.028824] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:05:55.985 passed 00:05:55.985 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:05:55.985 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:05:55.985 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:05:55.985 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-28 11:30:16.029024] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:05:55.985 passed 00:05:55.985 Test: generate copy: DIF generated, GUARD check ...passed 00:05:55.985 Test: generate copy: DIF generated, APTTAG check ...passed 00:05:55.985 Test: generate copy: DIF generated, REFTAG check ...passed 00:05:55.985 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:05:55.985 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:05:55.985 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:05:55.985 Test: generate copy: iovecs-len validate ...[2024-11-28 11:30:16.029324] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:05:55.985 passed 00:05:55.985 Test: generate copy: buffer alignment validate ...passed 00:05:55.985 00:05:55.985 Run Summary: Type Total Ran Passed Failed Inactive 00:05:55.985 suites 1 1 n/a 0 0 00:05:55.985 tests 20 20 20 0 0 00:05:55.985 asserts 204 204 204 0 n/a 00:05:55.985 00:05:55.985 Elapsed time = 0.003 seconds 00:05:56.243 00:05:56.243 real 0m0.587s 00:05:56.243 user 0m0.857s 00:05:56.243 sys 0m0.197s 00:05:56.243 11:30:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:56.243 11:30:16 -- common/autotest_common.sh@10 -- # set +x 00:05:56.243 ************************************ 00:05:56.243 END TEST accel_dif_functional_tests 00:05:56.243 ************************************ 00:05:56.503 00:05:56.503 real 1m3.411s 00:05:56.503 user 1m11.211s 00:05:56.503 sys 0m7.352s 00:05:56.503 11:30:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:56.503 11:30:16 -- common/autotest_common.sh@10 -- # set +x 00:05:56.503 ************************************ 00:05:56.503 END TEST accel 00:05:56.503 ************************************ 00:05:56.503 11:30:16 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:05:56.503 11:30:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:56.503 11:30:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.503 11:30:16 -- common/autotest_common.sh@10 -- # set +x 00:05:56.503 ************************************ 00:05:56.503 START TEST accel_rpc 00:05:56.503 ************************************ 00:05:56.503 11:30:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:05:56.503 * Looking for test storage... 00:05:56.503 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:56.503 11:30:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:56.503 11:30:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:56.503 11:30:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:56.503 11:30:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:56.503 11:30:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:56.503 11:30:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:56.503 11:30:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:56.503 11:30:16 -- scripts/common.sh@335 -- # IFS=.-: 00:05:56.503 11:30:16 -- scripts/common.sh@335 -- # read -ra ver1 00:05:56.503 11:30:16 -- scripts/common.sh@336 -- # IFS=.-: 00:05:56.503 11:30:16 -- scripts/common.sh@336 -- # read -ra ver2 00:05:56.503 11:30:16 -- scripts/common.sh@337 -- # local 'op=<' 00:05:56.503 11:30:16 -- scripts/common.sh@339 -- # ver1_l=2 00:05:56.503 11:30:16 -- scripts/common.sh@340 -- # ver2_l=1 00:05:56.503 11:30:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:56.503 11:30:16 -- scripts/common.sh@343 -- # case "$op" in 00:05:56.503 11:30:16 -- scripts/common.sh@344 -- # : 1 00:05:56.503 11:30:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:56.503 11:30:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:56.503 11:30:16 -- scripts/common.sh@364 -- # decimal 1 00:05:56.503 11:30:16 -- scripts/common.sh@352 -- # local d=1 00:05:56.503 11:30:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:56.503 11:30:16 -- scripts/common.sh@354 -- # echo 1 00:05:56.503 11:30:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:56.503 11:30:16 -- scripts/common.sh@365 -- # decimal 2 00:05:56.503 11:30:16 -- scripts/common.sh@352 -- # local d=2 00:05:56.503 11:30:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:56.503 11:30:16 -- scripts/common.sh@354 -- # echo 2 00:05:56.503 11:30:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:56.503 11:30:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:56.503 11:30:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:56.503 11:30:16 -- scripts/common.sh@367 -- # return 0 00:05:56.503 11:30:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:56.503 11:30:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:56.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.503 --rc genhtml_branch_coverage=1 00:05:56.503 --rc genhtml_function_coverage=1 00:05:56.503 --rc genhtml_legend=1 00:05:56.503 --rc geninfo_all_blocks=1 00:05:56.503 --rc geninfo_unexecuted_blocks=1 00:05:56.503 00:05:56.503 ' 00:05:56.503 11:30:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:56.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.503 --rc genhtml_branch_coverage=1 00:05:56.503 --rc genhtml_function_coverage=1 00:05:56.503 --rc genhtml_legend=1 00:05:56.503 --rc geninfo_all_blocks=1 00:05:56.503 --rc geninfo_unexecuted_blocks=1 00:05:56.503 00:05:56.503 ' 00:05:56.503 11:30:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:56.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.503 --rc genhtml_branch_coverage=1 00:05:56.503 --rc genhtml_function_coverage=1 00:05:56.503 --rc genhtml_legend=1 00:05:56.503 --rc geninfo_all_blocks=1 00:05:56.503 --rc geninfo_unexecuted_blocks=1 00:05:56.503 00:05:56.503 ' 00:05:56.503 11:30:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:56.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.503 --rc genhtml_branch_coverage=1 00:05:56.503 --rc genhtml_function_coverage=1 00:05:56.503 --rc genhtml_legend=1 00:05:56.503 --rc geninfo_all_blocks=1 00:05:56.503 --rc geninfo_unexecuted_blocks=1 00:05:56.503 00:05:56.503 ' 00:05:56.503 11:30:16 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:56.503 11:30:16 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3701144 00:05:56.504 11:30:16 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:05:56.504 11:30:16 -- accel/accel_rpc.sh@15 -- # waitforlisten 3701144 00:05:56.504 11:30:16 -- common/autotest_common.sh@829 -- # '[' -z 3701144 ']' 00:05:56.504 11:30:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:56.504 11:30:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:56.504 11:30:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:56.504 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:56.504 11:30:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:56.504 11:30:16 -- common/autotest_common.sh@10 -- # set +x 00:05:56.504 [2024-11-28 11:30:16.537416] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.504 [2024-11-28 11:30:16.537514] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3701144 ] 00:05:56.762 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.762 [2024-11-28 11:30:16.599273] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.762 [2024-11-28 11:30:16.707620] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:56.762 [2024-11-28 11:30:16.707799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.762 11:30:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:56.762 11:30:16 -- common/autotest_common.sh@862 -- # return 0 00:05:56.762 11:30:16 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:05:56.762 11:30:16 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:05:56.762 11:30:16 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:05:56.762 11:30:16 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:05:56.762 11:30:16 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:05:56.762 11:30:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:56.762 11:30:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.762 11:30:16 -- common/autotest_common.sh@10 -- # set +x 00:05:56.762 ************************************ 00:05:56.762 START TEST accel_assign_opcode 00:05:56.762 ************************************ 00:05:56.762 11:30:16 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:05:56.762 11:30:16 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:05:56.762 11:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:56.762 11:30:16 -- common/autotest_common.sh@10 -- # set +x 00:05:56.762 [2024-11-28 11:30:16.764377] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:05:56.762 11:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:56.762 11:30:16 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:05:56.762 11:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:56.762 11:30:16 -- common/autotest_common.sh@10 -- # set +x 00:05:56.762 [2024-11-28 11:30:16.772394] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:05:56.762 11:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:56.762 11:30:16 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:05:56.762 11:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:56.762 11:30:16 -- common/autotest_common.sh@10 -- # set +x 00:05:57.021 11:30:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.021 11:30:17 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:05:57.021 11:30:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.021 11:30:17 -- common/autotest_common.sh@10 -- # set +x 00:05:57.021 11:30:17 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:05:57.021 11:30:17 -- accel/accel_rpc.sh@42 -- # grep software 00:05:57.021 11:30:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.021 software 00:05:57.021 00:05:57.021 real 0m0.305s 00:05:57.021 user 0m0.040s 00:05:57.021 sys 0m0.008s 00:05:57.021 11:30:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:57.021 11:30:17 -- common/autotest_common.sh@10 -- # set +x 00:05:57.021 ************************************ 00:05:57.021 END TEST accel_assign_opcode 00:05:57.021 ************************************ 00:05:57.279 11:30:17 -- accel/accel_rpc.sh@55 -- # killprocess 3701144 00:05:57.279 11:30:17 -- common/autotest_common.sh@936 -- # '[' -z 3701144 ']' 00:05:57.279 11:30:17 -- common/autotest_common.sh@940 -- # kill -0 3701144 00:05:57.279 11:30:17 -- common/autotest_common.sh@941 -- # uname 00:05:57.279 11:30:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:57.279 11:30:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3701144 00:05:57.279 11:30:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:57.279 11:30:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:57.279 11:30:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3701144' 00:05:57.279 killing process with pid 3701144 00:05:57.279 11:30:17 -- common/autotest_common.sh@955 -- # kill 3701144 00:05:57.279 11:30:17 -- common/autotest_common.sh@960 -- # wait 3701144 00:05:57.537 00:05:57.537 real 0m1.256s 00:05:57.537 user 0m1.169s 00:05:57.537 sys 0m0.457s 00:05:57.537 11:30:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:57.537 11:30:17 -- common/autotest_common.sh@10 -- # set +x 00:05:57.537 ************************************ 00:05:57.537 END TEST accel_rpc 00:05:57.537 ************************************ 00:05:57.796 11:30:17 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:05:57.796 11:30:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:57.796 11:30:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.796 11:30:17 -- common/autotest_common.sh@10 -- # set +x 00:05:57.796 ************************************ 00:05:57.796 START TEST app_cmdline 00:05:57.796 ************************************ 00:05:57.796 11:30:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:05:57.796 * Looking for test storage... 00:05:57.796 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:05:57.796 11:30:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:57.796 11:30:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:57.796 11:30:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:57.796 11:30:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:57.796 11:30:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:57.796 11:30:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:57.796 11:30:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:57.796 11:30:17 -- scripts/common.sh@335 -- # IFS=.-: 00:05:57.796 11:30:17 -- scripts/common.sh@335 -- # read -ra ver1 00:05:57.796 11:30:17 -- scripts/common.sh@336 -- # IFS=.-: 00:05:57.796 11:30:17 -- scripts/common.sh@336 -- # read -ra ver2 00:05:57.796 11:30:17 -- scripts/common.sh@337 -- # local 'op=<' 00:05:57.796 11:30:17 -- scripts/common.sh@339 -- # ver1_l=2 00:05:57.796 11:30:17 -- scripts/common.sh@340 -- # ver2_l=1 00:05:57.796 11:30:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:57.796 11:30:17 -- scripts/common.sh@343 -- # case "$op" in 00:05:57.796 11:30:17 -- scripts/common.sh@344 -- # : 1 00:05:57.796 11:30:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:57.796 11:30:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:57.796 11:30:17 -- scripts/common.sh@364 -- # decimal 1 00:05:57.796 11:30:17 -- scripts/common.sh@352 -- # local d=1 00:05:57.796 11:30:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:57.796 11:30:17 -- scripts/common.sh@354 -- # echo 1 00:05:57.796 11:30:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:57.796 11:30:17 -- scripts/common.sh@365 -- # decimal 2 00:05:57.796 11:30:17 -- scripts/common.sh@352 -- # local d=2 00:05:57.796 11:30:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:57.796 11:30:17 -- scripts/common.sh@354 -- # echo 2 00:05:57.796 11:30:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:57.796 11:30:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:57.796 11:30:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:57.796 11:30:17 -- scripts/common.sh@367 -- # return 0 00:05:57.796 11:30:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:57.796 11:30:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:57.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.796 --rc genhtml_branch_coverage=1 00:05:57.796 --rc genhtml_function_coverage=1 00:05:57.796 --rc genhtml_legend=1 00:05:57.796 --rc geninfo_all_blocks=1 00:05:57.796 --rc geninfo_unexecuted_blocks=1 00:05:57.796 00:05:57.796 ' 00:05:57.796 11:30:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:57.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.796 --rc genhtml_branch_coverage=1 00:05:57.796 --rc genhtml_function_coverage=1 00:05:57.796 --rc genhtml_legend=1 00:05:57.796 --rc geninfo_all_blocks=1 00:05:57.796 --rc geninfo_unexecuted_blocks=1 00:05:57.796 00:05:57.796 ' 00:05:57.796 11:30:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:57.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.796 --rc genhtml_branch_coverage=1 00:05:57.796 --rc genhtml_function_coverage=1 00:05:57.796 --rc genhtml_legend=1 00:05:57.796 --rc geninfo_all_blocks=1 00:05:57.796 --rc geninfo_unexecuted_blocks=1 00:05:57.796 00:05:57.796 ' 00:05:57.796 11:30:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:57.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.796 --rc genhtml_branch_coverage=1 00:05:57.796 --rc genhtml_function_coverage=1 00:05:57.796 --rc genhtml_legend=1 00:05:57.796 --rc geninfo_all_blocks=1 00:05:57.796 --rc geninfo_unexecuted_blocks=1 00:05:57.796 00:05:57.796 ' 00:05:57.796 11:30:17 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:05:57.796 11:30:17 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3701367 00:05:57.796 11:30:17 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:05:57.796 11:30:17 -- app/cmdline.sh@18 -- # waitforlisten 3701367 00:05:57.796 11:30:17 -- common/autotest_common.sh@829 -- # '[' -z 3701367 ']' 00:05:57.796 11:30:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:57.796 11:30:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:57.796 11:30:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:57.796 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:57.796 11:30:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:57.796 11:30:17 -- common/autotest_common.sh@10 -- # set +x 00:05:57.796 [2024-11-28 11:30:17.800677] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.797 [2024-11-28 11:30:17.800766] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3701367 ] 00:05:57.797 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.055 [2024-11-28 11:30:17.862051] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.055 [2024-11-28 11:30:17.970632] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:58.055 [2024-11-28 11:30:17.970806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.989 11:30:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:58.989 11:30:18 -- common/autotest_common.sh@862 -- # return 0 00:05:58.989 11:30:18 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:05:59.247 { 00:05:59.247 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:05:59.247 "fields": { 00:05:59.247 "major": 24, 00:05:59.248 "minor": 1, 00:05:59.248 "patch": 1, 00:05:59.248 "suffix": "-pre", 00:05:59.248 "commit": "c13c99a5e" 00:05:59.248 } 00:05:59.248 } 00:05:59.248 11:30:19 -- app/cmdline.sh@22 -- # expected_methods=() 00:05:59.248 11:30:19 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:05:59.248 11:30:19 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:05:59.248 11:30:19 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:05:59.248 11:30:19 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:05:59.248 11:30:19 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:05:59.248 11:30:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:59.248 11:30:19 -- app/cmdline.sh@26 -- # sort 00:05:59.248 11:30:19 -- common/autotest_common.sh@10 -- # set +x 00:05:59.248 11:30:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:59.248 11:30:19 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:05:59.248 11:30:19 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:05:59.248 11:30:19 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:05:59.248 11:30:19 -- common/autotest_common.sh@650 -- # local es=0 00:05:59.248 11:30:19 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:05:59.248 11:30:19 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:05:59.248 11:30:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:59.248 11:30:19 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:05:59.248 11:30:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:59.248 11:30:19 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:05:59.248 11:30:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:59.248 11:30:19 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:05:59.248 11:30:19 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:05:59.248 11:30:19 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:05:59.505 request: 00:05:59.505 { 00:05:59.505 "method": "env_dpdk_get_mem_stats", 00:05:59.505 "req_id": 1 00:05:59.505 } 00:05:59.505 Got JSON-RPC error response 00:05:59.505 response: 00:05:59.505 { 00:05:59.505 "code": -32601, 00:05:59.505 "message": "Method not found" 00:05:59.505 } 00:05:59.505 11:30:19 -- common/autotest_common.sh@653 -- # es=1 00:05:59.505 11:30:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:59.505 11:30:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:59.505 11:30:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:59.505 11:30:19 -- app/cmdline.sh@1 -- # killprocess 3701367 00:05:59.505 11:30:19 -- common/autotest_common.sh@936 -- # '[' -z 3701367 ']' 00:05:59.505 11:30:19 -- common/autotest_common.sh@940 -- # kill -0 3701367 00:05:59.505 11:30:19 -- common/autotest_common.sh@941 -- # uname 00:05:59.505 11:30:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:59.505 11:30:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3701367 00:05:59.505 11:30:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:59.505 11:30:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:59.505 11:30:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3701367' 00:05:59.505 killing process with pid 3701367 00:05:59.505 11:30:19 -- common/autotest_common.sh@955 -- # kill 3701367 00:05:59.505 11:30:19 -- common/autotest_common.sh@960 -- # wait 3701367 00:06:00.071 00:06:00.071 real 0m2.301s 00:06:00.071 user 0m2.952s 00:06:00.071 sys 0m0.507s 00:06:00.071 11:30:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.071 11:30:19 -- common/autotest_common.sh@10 -- # set +x 00:06:00.071 ************************************ 00:06:00.071 END TEST app_cmdline 00:06:00.071 ************************************ 00:06:00.071 11:30:19 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:00.071 11:30:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:00.071 11:30:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.071 11:30:19 -- common/autotest_common.sh@10 -- # set +x 00:06:00.071 ************************************ 00:06:00.071 START TEST version 00:06:00.071 ************************************ 00:06:00.071 11:30:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:00.071 * Looking for test storage... 00:06:00.071 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:00.071 11:30:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:00.071 11:30:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:00.071 11:30:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:00.071 11:30:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:00.071 11:30:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:00.071 11:30:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:00.071 11:30:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:00.071 11:30:20 -- scripts/common.sh@335 -- # IFS=.-: 00:06:00.071 11:30:20 -- scripts/common.sh@335 -- # read -ra ver1 00:06:00.071 11:30:20 -- scripts/common.sh@336 -- # IFS=.-: 00:06:00.071 11:30:20 -- scripts/common.sh@336 -- # read -ra ver2 00:06:00.071 11:30:20 -- scripts/common.sh@337 -- # local 'op=<' 00:06:00.071 11:30:20 -- scripts/common.sh@339 -- # ver1_l=2 00:06:00.071 11:30:20 -- scripts/common.sh@340 -- # ver2_l=1 00:06:00.071 11:30:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:00.072 11:30:20 -- scripts/common.sh@343 -- # case "$op" in 00:06:00.072 11:30:20 -- scripts/common.sh@344 -- # : 1 00:06:00.072 11:30:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:00.072 11:30:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:00.072 11:30:20 -- scripts/common.sh@364 -- # decimal 1 00:06:00.072 11:30:20 -- scripts/common.sh@352 -- # local d=1 00:06:00.072 11:30:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:00.072 11:30:20 -- scripts/common.sh@354 -- # echo 1 00:06:00.072 11:30:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:00.072 11:30:20 -- scripts/common.sh@365 -- # decimal 2 00:06:00.072 11:30:20 -- scripts/common.sh@352 -- # local d=2 00:06:00.072 11:30:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:00.072 11:30:20 -- scripts/common.sh@354 -- # echo 2 00:06:00.072 11:30:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:00.072 11:30:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:00.072 11:30:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:00.072 11:30:20 -- scripts/common.sh@367 -- # return 0 00:06:00.072 11:30:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:00.072 11:30:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:00.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.072 --rc genhtml_branch_coverage=1 00:06:00.072 --rc genhtml_function_coverage=1 00:06:00.072 --rc genhtml_legend=1 00:06:00.072 --rc geninfo_all_blocks=1 00:06:00.072 --rc geninfo_unexecuted_blocks=1 00:06:00.072 00:06:00.072 ' 00:06:00.072 11:30:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:00.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.072 --rc genhtml_branch_coverage=1 00:06:00.072 --rc genhtml_function_coverage=1 00:06:00.072 --rc genhtml_legend=1 00:06:00.072 --rc geninfo_all_blocks=1 00:06:00.072 --rc geninfo_unexecuted_blocks=1 00:06:00.072 00:06:00.072 ' 00:06:00.072 11:30:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:00.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.072 --rc genhtml_branch_coverage=1 00:06:00.072 --rc genhtml_function_coverage=1 00:06:00.072 --rc genhtml_legend=1 00:06:00.072 --rc geninfo_all_blocks=1 00:06:00.072 --rc geninfo_unexecuted_blocks=1 00:06:00.072 00:06:00.072 ' 00:06:00.072 11:30:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:00.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.072 --rc genhtml_branch_coverage=1 00:06:00.072 --rc genhtml_function_coverage=1 00:06:00.072 --rc genhtml_legend=1 00:06:00.072 --rc geninfo_all_blocks=1 00:06:00.072 --rc geninfo_unexecuted_blocks=1 00:06:00.072 00:06:00.072 ' 00:06:00.072 11:30:20 -- app/version.sh@17 -- # get_header_version major 00:06:00.072 11:30:20 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:00.072 11:30:20 -- app/version.sh@14 -- # cut -f2 00:06:00.072 11:30:20 -- app/version.sh@14 -- # tr -d '"' 00:06:00.072 11:30:20 -- app/version.sh@17 -- # major=24 00:06:00.072 11:30:20 -- app/version.sh@18 -- # get_header_version minor 00:06:00.072 11:30:20 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:00.072 11:30:20 -- app/version.sh@14 -- # cut -f2 00:06:00.072 11:30:20 -- app/version.sh@14 -- # tr -d '"' 00:06:00.072 11:30:20 -- app/version.sh@18 -- # minor=1 00:06:00.072 11:30:20 -- app/version.sh@19 -- # get_header_version patch 00:06:00.072 11:30:20 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:00.072 11:30:20 -- app/version.sh@14 -- # cut -f2 00:06:00.072 11:30:20 -- app/version.sh@14 -- # tr -d '"' 00:06:00.072 11:30:20 -- app/version.sh@19 -- # patch=1 00:06:00.072 11:30:20 -- app/version.sh@20 -- # get_header_version suffix 00:06:00.072 11:30:20 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:00.072 11:30:20 -- app/version.sh@14 -- # cut -f2 00:06:00.072 11:30:20 -- app/version.sh@14 -- # tr -d '"' 00:06:00.072 11:30:20 -- app/version.sh@20 -- # suffix=-pre 00:06:00.072 11:30:20 -- app/version.sh@22 -- # version=24.1 00:06:00.072 11:30:20 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:00.072 11:30:20 -- app/version.sh@25 -- # version=24.1.1 00:06:00.072 11:30:20 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:00.072 11:30:20 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:00.072 11:30:20 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:00.331 11:30:20 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:00.331 11:30:20 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:00.331 00:06:00.331 real 0m0.195s 00:06:00.331 user 0m0.140s 00:06:00.331 sys 0m0.081s 00:06:00.331 11:30:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.331 11:30:20 -- common/autotest_common.sh@10 -- # set +x 00:06:00.331 ************************************ 00:06:00.331 END TEST version 00:06:00.331 ************************************ 00:06:00.331 11:30:20 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:00.331 11:30:20 -- spdk/autotest.sh@191 -- # uname -s 00:06:00.331 11:30:20 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:00.331 11:30:20 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:00.331 11:30:20 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:00.331 11:30:20 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:00.331 11:30:20 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:00.331 11:30:20 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:00.331 11:30:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:00.331 11:30:20 -- common/autotest_common.sh@10 -- # set +x 00:06:00.331 11:30:20 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:00.331 11:30:20 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:00.331 11:30:20 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:00.331 11:30:20 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:00.331 11:30:20 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:00.331 11:30:20 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:00.331 11:30:20 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:00.331 11:30:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:00.331 11:30:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.331 11:30:20 -- common/autotest_common.sh@10 -- # set +x 00:06:00.331 ************************************ 00:06:00.331 START TEST nvmf_tcp 00:06:00.331 ************************************ 00:06:00.331 11:30:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:00.331 * Looking for test storage... 00:06:00.331 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:00.331 11:30:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:00.331 11:30:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:00.331 11:30:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:00.331 11:30:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:00.331 11:30:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:00.331 11:30:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:00.331 11:30:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:00.331 11:30:20 -- scripts/common.sh@335 -- # IFS=.-: 00:06:00.331 11:30:20 -- scripts/common.sh@335 -- # read -ra ver1 00:06:00.331 11:30:20 -- scripts/common.sh@336 -- # IFS=.-: 00:06:00.331 11:30:20 -- scripts/common.sh@336 -- # read -ra ver2 00:06:00.331 11:30:20 -- scripts/common.sh@337 -- # local 'op=<' 00:06:00.331 11:30:20 -- scripts/common.sh@339 -- # ver1_l=2 00:06:00.331 11:30:20 -- scripts/common.sh@340 -- # ver2_l=1 00:06:00.331 11:30:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:00.331 11:30:20 -- scripts/common.sh@343 -- # case "$op" in 00:06:00.331 11:30:20 -- scripts/common.sh@344 -- # : 1 00:06:00.331 11:30:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:00.331 11:30:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:00.331 11:30:20 -- scripts/common.sh@364 -- # decimal 1 00:06:00.331 11:30:20 -- scripts/common.sh@352 -- # local d=1 00:06:00.331 11:30:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:00.331 11:30:20 -- scripts/common.sh@354 -- # echo 1 00:06:00.331 11:30:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:00.331 11:30:20 -- scripts/common.sh@365 -- # decimal 2 00:06:00.331 11:30:20 -- scripts/common.sh@352 -- # local d=2 00:06:00.331 11:30:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:00.331 11:30:20 -- scripts/common.sh@354 -- # echo 2 00:06:00.331 11:30:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:00.331 11:30:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:00.331 11:30:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:00.331 11:30:20 -- scripts/common.sh@367 -- # return 0 00:06:00.331 11:30:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:00.331 11:30:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:00.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.331 --rc genhtml_branch_coverage=1 00:06:00.331 --rc genhtml_function_coverage=1 00:06:00.331 --rc genhtml_legend=1 00:06:00.331 --rc geninfo_all_blocks=1 00:06:00.331 --rc geninfo_unexecuted_blocks=1 00:06:00.331 00:06:00.331 ' 00:06:00.331 11:30:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:00.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.331 --rc genhtml_branch_coverage=1 00:06:00.331 --rc genhtml_function_coverage=1 00:06:00.331 --rc genhtml_legend=1 00:06:00.331 --rc geninfo_all_blocks=1 00:06:00.331 --rc geninfo_unexecuted_blocks=1 00:06:00.331 00:06:00.331 ' 00:06:00.331 11:30:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:00.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.331 --rc genhtml_branch_coverage=1 00:06:00.331 --rc genhtml_function_coverage=1 00:06:00.331 --rc genhtml_legend=1 00:06:00.331 --rc geninfo_all_blocks=1 00:06:00.331 --rc geninfo_unexecuted_blocks=1 00:06:00.331 00:06:00.331 ' 00:06:00.331 11:30:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:00.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.332 --rc genhtml_branch_coverage=1 00:06:00.332 --rc genhtml_function_coverage=1 00:06:00.332 --rc genhtml_legend=1 00:06:00.332 --rc geninfo_all_blocks=1 00:06:00.332 --rc geninfo_unexecuted_blocks=1 00:06:00.332 00:06:00.332 ' 00:06:00.332 11:30:20 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:00.332 11:30:20 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:00.332 11:30:20 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:00.332 11:30:20 -- nvmf/common.sh@7 -- # uname -s 00:06:00.332 11:30:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:00.332 11:30:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:00.332 11:30:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:00.332 11:30:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:00.332 11:30:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:00.332 11:30:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:00.332 11:30:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:00.332 11:30:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:00.332 11:30:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:00.332 11:30:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:00.332 11:30:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:00.332 11:30:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:00.332 11:30:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:00.332 11:30:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:00.332 11:30:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:00.332 11:30:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:00.332 11:30:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:00.332 11:30:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:00.332 11:30:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:00.332 11:30:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:00.332 11:30:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:00.332 11:30:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:00.332 11:30:20 -- paths/export.sh@5 -- # export PATH 00:06:00.332 11:30:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:00.332 11:30:20 -- nvmf/common.sh@46 -- # : 0 00:06:00.332 11:30:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:00.332 11:30:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:00.332 11:30:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:00.332 11:30:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:00.332 11:30:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:00.332 11:30:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:00.332 11:30:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:00.332 11:30:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:00.332 11:30:20 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:00.332 11:30:20 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:00.332 11:30:20 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:00.332 11:30:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:00.332 11:30:20 -- common/autotest_common.sh@10 -- # set +x 00:06:00.332 11:30:20 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:00.332 11:30:20 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:00.332 11:30:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:00.332 11:30:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.332 11:30:20 -- common/autotest_common.sh@10 -- # set +x 00:06:00.332 ************************************ 00:06:00.332 START TEST nvmf_example 00:06:00.332 ************************************ 00:06:00.332 11:30:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:00.591 * Looking for test storage... 00:06:00.591 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:00.591 11:30:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:00.591 11:30:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:00.591 11:30:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:00.591 11:30:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:00.591 11:30:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:00.591 11:30:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:00.591 11:30:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:00.591 11:30:20 -- scripts/common.sh@335 -- # IFS=.-: 00:06:00.591 11:30:20 -- scripts/common.sh@335 -- # read -ra ver1 00:06:00.591 11:30:20 -- scripts/common.sh@336 -- # IFS=.-: 00:06:00.591 11:30:20 -- scripts/common.sh@336 -- # read -ra ver2 00:06:00.591 11:30:20 -- scripts/common.sh@337 -- # local 'op=<' 00:06:00.591 11:30:20 -- scripts/common.sh@339 -- # ver1_l=2 00:06:00.591 11:30:20 -- scripts/common.sh@340 -- # ver2_l=1 00:06:00.591 11:30:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:00.591 11:30:20 -- scripts/common.sh@343 -- # case "$op" in 00:06:00.591 11:30:20 -- scripts/common.sh@344 -- # : 1 00:06:00.591 11:30:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:00.591 11:30:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:00.591 11:30:20 -- scripts/common.sh@364 -- # decimal 1 00:06:00.591 11:30:20 -- scripts/common.sh@352 -- # local d=1 00:06:00.591 11:30:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:00.591 11:30:20 -- scripts/common.sh@354 -- # echo 1 00:06:00.591 11:30:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:00.591 11:30:20 -- scripts/common.sh@365 -- # decimal 2 00:06:00.591 11:30:20 -- scripts/common.sh@352 -- # local d=2 00:06:00.591 11:30:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:00.591 11:30:20 -- scripts/common.sh@354 -- # echo 2 00:06:00.591 11:30:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:00.591 11:30:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:00.591 11:30:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:00.591 11:30:20 -- scripts/common.sh@367 -- # return 0 00:06:00.591 11:30:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:00.591 11:30:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:00.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.591 --rc genhtml_branch_coverage=1 00:06:00.591 --rc genhtml_function_coverage=1 00:06:00.591 --rc genhtml_legend=1 00:06:00.591 --rc geninfo_all_blocks=1 00:06:00.591 --rc geninfo_unexecuted_blocks=1 00:06:00.591 00:06:00.591 ' 00:06:00.591 11:30:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:00.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.591 --rc genhtml_branch_coverage=1 00:06:00.591 --rc genhtml_function_coverage=1 00:06:00.591 --rc genhtml_legend=1 00:06:00.591 --rc geninfo_all_blocks=1 00:06:00.591 --rc geninfo_unexecuted_blocks=1 00:06:00.591 00:06:00.591 ' 00:06:00.591 11:30:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:00.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.591 --rc genhtml_branch_coverage=1 00:06:00.591 --rc genhtml_function_coverage=1 00:06:00.591 --rc genhtml_legend=1 00:06:00.591 --rc geninfo_all_blocks=1 00:06:00.591 --rc geninfo_unexecuted_blocks=1 00:06:00.591 00:06:00.591 ' 00:06:00.591 11:30:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:00.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.591 --rc genhtml_branch_coverage=1 00:06:00.591 --rc genhtml_function_coverage=1 00:06:00.591 --rc genhtml_legend=1 00:06:00.591 --rc geninfo_all_blocks=1 00:06:00.591 --rc geninfo_unexecuted_blocks=1 00:06:00.591 00:06:00.591 ' 00:06:00.591 11:30:20 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:00.591 11:30:20 -- nvmf/common.sh@7 -- # uname -s 00:06:00.591 11:30:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:00.591 11:30:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:00.591 11:30:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:00.591 11:30:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:00.591 11:30:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:00.591 11:30:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:00.591 11:30:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:00.591 11:30:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:00.591 11:30:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:00.591 11:30:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:00.591 11:30:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:00.591 11:30:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:00.591 11:30:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:00.591 11:30:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:00.591 11:30:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:00.591 11:30:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:00.591 11:30:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:00.591 11:30:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:00.591 11:30:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:00.591 11:30:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:00.591 11:30:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:00.591 11:30:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:00.591 11:30:20 -- paths/export.sh@5 -- # export PATH 00:06:00.591 11:30:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:00.591 11:30:20 -- nvmf/common.sh@46 -- # : 0 00:06:00.591 11:30:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:00.591 11:30:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:00.591 11:30:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:00.591 11:30:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:00.591 11:30:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:00.592 11:30:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:00.592 11:30:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:00.592 11:30:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:00.592 11:30:20 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:00.592 11:30:20 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:00.592 11:30:20 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:00.592 11:30:20 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:00.592 11:30:20 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:00.592 11:30:20 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:00.592 11:30:20 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:00.592 11:30:20 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:00.592 11:30:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:00.592 11:30:20 -- common/autotest_common.sh@10 -- # set +x 00:06:00.592 11:30:20 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:00.592 11:30:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:00.592 11:30:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:00.592 11:30:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:00.592 11:30:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:00.592 11:30:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:00.592 11:30:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:00.592 11:30:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:00.592 11:30:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:00.592 11:30:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:00.592 11:30:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:00.592 11:30:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:00.592 11:30:20 -- common/autotest_common.sh@10 -- # set +x 00:06:03.123 11:30:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:03.123 11:30:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:03.123 11:30:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:03.123 11:30:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:03.123 11:30:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:03.123 11:30:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:03.123 11:30:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:03.123 11:30:22 -- nvmf/common.sh@294 -- # net_devs=() 00:06:03.123 11:30:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:03.123 11:30:22 -- nvmf/common.sh@295 -- # e810=() 00:06:03.123 11:30:22 -- nvmf/common.sh@295 -- # local -ga e810 00:06:03.123 11:30:22 -- nvmf/common.sh@296 -- # x722=() 00:06:03.123 11:30:22 -- nvmf/common.sh@296 -- # local -ga x722 00:06:03.123 11:30:22 -- nvmf/common.sh@297 -- # mlx=() 00:06:03.123 11:30:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:03.123 11:30:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:03.123 11:30:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:03.123 11:30:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:03.123 11:30:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:03.123 11:30:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:03.123 11:30:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:03.123 11:30:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:03.123 11:30:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:03.123 11:30:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:03.123 11:30:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:03.123 11:30:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:03.123 11:30:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:03.123 11:30:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:03.123 11:30:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:03.123 11:30:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:03.123 11:30:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:03.123 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:03.123 11:30:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:03.123 11:30:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:03.123 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:03.123 11:30:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:03.123 11:30:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:03.123 11:30:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:03.123 11:30:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:03.123 11:30:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:03.123 11:30:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:03.123 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:03.123 11:30:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:03.123 11:30:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:03.123 11:30:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:03.123 11:30:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:03.123 11:30:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:03.123 11:30:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:03.123 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:03.123 11:30:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:03.123 11:30:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:03.123 11:30:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:03.123 11:30:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:03.123 11:30:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:03.123 11:30:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:03.123 11:30:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:03.123 11:30:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:03.123 11:30:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:03.123 11:30:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:03.123 11:30:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:03.123 11:30:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:03.123 11:30:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:03.123 11:30:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:03.123 11:30:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:03.123 11:30:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:03.123 11:30:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:03.123 11:30:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:03.123 11:30:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:03.123 11:30:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:03.123 11:30:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:03.123 11:30:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:03.123 11:30:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:03.123 11:30:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:03.123 11:30:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:03.123 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:03.123 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:06:03.123 00:06:03.123 --- 10.0.0.2 ping statistics --- 00:06:03.123 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:03.123 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:06:03.123 11:30:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:03.123 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:03.123 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:06:03.123 00:06:03.123 --- 10.0.0.1 ping statistics --- 00:06:03.123 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:03.123 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:06:03.124 11:30:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:03.124 11:30:22 -- nvmf/common.sh@410 -- # return 0 00:06:03.124 11:30:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:03.124 11:30:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:03.124 11:30:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:03.124 11:30:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:03.124 11:30:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:03.124 11:30:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:03.124 11:30:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:03.124 11:30:22 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:03.124 11:30:22 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:03.124 11:30:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:03.124 11:30:22 -- common/autotest_common.sh@10 -- # set +x 00:06:03.124 11:30:22 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:03.124 11:30:22 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:03.124 11:30:22 -- target/nvmf_example.sh@34 -- # nvmfpid=3703548 00:06:03.124 11:30:22 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:03.124 11:30:22 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:03.124 11:30:22 -- target/nvmf_example.sh@36 -- # waitforlisten 3703548 00:06:03.124 11:30:22 -- common/autotest_common.sh@829 -- # '[' -z 3703548 ']' 00:06:03.124 11:30:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:03.124 11:30:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:03.124 11:30:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:03.124 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:03.124 11:30:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:03.124 11:30:22 -- common/autotest_common.sh@10 -- # set +x 00:06:03.124 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.054 11:30:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:04.054 11:30:23 -- common/autotest_common.sh@862 -- # return 0 00:06:04.054 11:30:23 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:04.054 11:30:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:04.054 11:30:23 -- common/autotest_common.sh@10 -- # set +x 00:06:04.054 11:30:23 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:04.054 11:30:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.054 11:30:23 -- common/autotest_common.sh@10 -- # set +x 00:06:04.054 11:30:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.054 11:30:23 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:04.054 11:30:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.054 11:30:23 -- common/autotest_common.sh@10 -- # set +x 00:06:04.054 11:30:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.054 11:30:23 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:04.054 11:30:23 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:04.054 11:30:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.054 11:30:23 -- common/autotest_common.sh@10 -- # set +x 00:06:04.054 11:30:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.054 11:30:23 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:04.054 11:30:23 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:04.054 11:30:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.054 11:30:23 -- common/autotest_common.sh@10 -- # set +x 00:06:04.054 11:30:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.054 11:30:23 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:04.054 11:30:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.054 11:30:23 -- common/autotest_common.sh@10 -- # set +x 00:06:04.054 11:30:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.054 11:30:23 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:04.054 11:30:23 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:04.054 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.252 Initializing NVMe Controllers 00:06:16.252 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:16.252 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:16.252 Initialization complete. Launching workers. 00:06:16.252 ======================================================== 00:06:16.252 Latency(us) 00:06:16.252 Device Information : IOPS MiB/s Average min max 00:06:16.252 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15399.32 60.15 4155.57 848.58 16488.95 00:06:16.252 ======================================================== 00:06:16.252 Total : 15399.32 60.15 4155.57 848.58 16488.95 00:06:16.252 00:06:16.252 11:30:34 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:16.252 11:30:34 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:16.252 11:30:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:16.252 11:30:34 -- nvmf/common.sh@116 -- # sync 00:06:16.252 11:30:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:16.252 11:30:34 -- nvmf/common.sh@119 -- # set +e 00:06:16.252 11:30:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:16.252 11:30:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:16.252 rmmod nvme_tcp 00:06:16.252 rmmod nvme_fabrics 00:06:16.252 rmmod nvme_keyring 00:06:16.252 11:30:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:16.252 11:30:34 -- nvmf/common.sh@123 -- # set -e 00:06:16.252 11:30:34 -- nvmf/common.sh@124 -- # return 0 00:06:16.252 11:30:34 -- nvmf/common.sh@477 -- # '[' -n 3703548 ']' 00:06:16.252 11:30:34 -- nvmf/common.sh@478 -- # killprocess 3703548 00:06:16.252 11:30:34 -- common/autotest_common.sh@936 -- # '[' -z 3703548 ']' 00:06:16.252 11:30:34 -- common/autotest_common.sh@940 -- # kill -0 3703548 00:06:16.252 11:30:34 -- common/autotest_common.sh@941 -- # uname 00:06:16.252 11:30:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:16.252 11:30:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3703548 00:06:16.252 11:30:34 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:16.252 11:30:34 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:16.252 11:30:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3703548' 00:06:16.252 killing process with pid 3703548 00:06:16.252 11:30:34 -- common/autotest_common.sh@955 -- # kill 3703548 00:06:16.252 11:30:34 -- common/autotest_common.sh@960 -- # wait 3703548 00:06:16.252 nvmf threads initialize successfully 00:06:16.252 bdev subsystem init successfully 00:06:16.252 created a nvmf target service 00:06:16.252 create targets's poll groups done 00:06:16.252 all subsystems of target started 00:06:16.252 nvmf target is running 00:06:16.252 all subsystems of target stopped 00:06:16.252 destroy targets's poll groups done 00:06:16.252 destroyed the nvmf target service 00:06:16.252 bdev subsystem finish successfully 00:06:16.252 nvmf threads destroy successfully 00:06:16.252 11:30:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:16.252 11:30:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:16.252 11:30:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:16.252 11:30:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:16.252 11:30:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:16.252 11:30:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:16.252 11:30:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:16.252 11:30:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:16.510 11:30:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:16.801 11:30:36 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:16.801 11:30:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:16.801 11:30:36 -- common/autotest_common.sh@10 -- # set +x 00:06:16.801 00:06:16.801 real 0m16.228s 00:06:16.801 user 0m45.986s 00:06:16.801 sys 0m3.286s 00:06:16.801 11:30:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:16.801 11:30:36 -- common/autotest_common.sh@10 -- # set +x 00:06:16.801 ************************************ 00:06:16.801 END TEST nvmf_example 00:06:16.801 ************************************ 00:06:16.801 11:30:36 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:16.801 11:30:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:16.801 11:30:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.801 11:30:36 -- common/autotest_common.sh@10 -- # set +x 00:06:16.801 ************************************ 00:06:16.801 START TEST nvmf_filesystem 00:06:16.801 ************************************ 00:06:16.801 11:30:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:16.801 * Looking for test storage... 00:06:16.801 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:16.801 11:30:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:16.801 11:30:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:16.801 11:30:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:16.801 11:30:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:16.801 11:30:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:16.801 11:30:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:16.801 11:30:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:16.801 11:30:36 -- scripts/common.sh@335 -- # IFS=.-: 00:06:16.801 11:30:36 -- scripts/common.sh@335 -- # read -ra ver1 00:06:16.801 11:30:36 -- scripts/common.sh@336 -- # IFS=.-: 00:06:16.801 11:30:36 -- scripts/common.sh@336 -- # read -ra ver2 00:06:16.801 11:30:36 -- scripts/common.sh@337 -- # local 'op=<' 00:06:16.801 11:30:36 -- scripts/common.sh@339 -- # ver1_l=2 00:06:16.801 11:30:36 -- scripts/common.sh@340 -- # ver2_l=1 00:06:16.801 11:30:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:16.801 11:30:36 -- scripts/common.sh@343 -- # case "$op" in 00:06:16.801 11:30:36 -- scripts/common.sh@344 -- # : 1 00:06:16.801 11:30:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:16.801 11:30:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:16.801 11:30:36 -- scripts/common.sh@364 -- # decimal 1 00:06:16.801 11:30:36 -- scripts/common.sh@352 -- # local d=1 00:06:16.801 11:30:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:16.801 11:30:36 -- scripts/common.sh@354 -- # echo 1 00:06:16.801 11:30:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:16.801 11:30:36 -- scripts/common.sh@365 -- # decimal 2 00:06:16.801 11:30:36 -- scripts/common.sh@352 -- # local d=2 00:06:16.801 11:30:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:16.801 11:30:36 -- scripts/common.sh@354 -- # echo 2 00:06:16.801 11:30:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:16.801 11:30:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:16.801 11:30:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:16.801 11:30:36 -- scripts/common.sh@367 -- # return 0 00:06:16.801 11:30:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:16.801 11:30:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:16.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:16.801 --rc genhtml_branch_coverage=1 00:06:16.801 --rc genhtml_function_coverage=1 00:06:16.801 --rc genhtml_legend=1 00:06:16.801 --rc geninfo_all_blocks=1 00:06:16.801 --rc geninfo_unexecuted_blocks=1 00:06:16.801 00:06:16.801 ' 00:06:16.801 11:30:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:16.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:16.801 --rc genhtml_branch_coverage=1 00:06:16.801 --rc genhtml_function_coverage=1 00:06:16.801 --rc genhtml_legend=1 00:06:16.801 --rc geninfo_all_blocks=1 00:06:16.801 --rc geninfo_unexecuted_blocks=1 00:06:16.801 00:06:16.801 ' 00:06:16.801 11:30:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:16.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:16.801 --rc genhtml_branch_coverage=1 00:06:16.801 --rc genhtml_function_coverage=1 00:06:16.801 --rc genhtml_legend=1 00:06:16.801 --rc geninfo_all_blocks=1 00:06:16.801 --rc geninfo_unexecuted_blocks=1 00:06:16.801 00:06:16.801 ' 00:06:16.801 11:30:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:16.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:16.801 --rc genhtml_branch_coverage=1 00:06:16.801 --rc genhtml_function_coverage=1 00:06:16.801 --rc genhtml_legend=1 00:06:16.801 --rc geninfo_all_blocks=1 00:06:16.801 --rc geninfo_unexecuted_blocks=1 00:06:16.801 00:06:16.801 ' 00:06:16.801 11:30:36 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:16.801 11:30:36 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:16.801 11:30:36 -- common/autotest_common.sh@34 -- # set -e 00:06:16.801 11:30:36 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:16.801 11:30:36 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:16.801 11:30:36 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:16.801 11:30:36 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:16.801 11:30:36 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:16.801 11:30:36 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:16.801 11:30:36 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:16.801 11:30:36 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:16.801 11:30:36 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:16.801 11:30:36 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:16.801 11:30:36 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:16.801 11:30:36 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:16.801 11:30:36 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:16.801 11:30:36 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:16.801 11:30:36 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:16.801 11:30:36 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:16.801 11:30:36 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:16.801 11:30:36 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:16.801 11:30:36 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:16.801 11:30:36 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:16.801 11:30:36 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:16.801 11:30:36 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:16.801 11:30:36 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:16.801 11:30:36 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:16.801 11:30:36 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:16.801 11:30:36 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:16.801 11:30:36 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:16.801 11:30:36 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:16.801 11:30:36 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:16.801 11:30:36 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:16.801 11:30:36 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:16.801 11:30:36 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:16.801 11:30:36 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:16.801 11:30:36 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:16.801 11:30:36 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:16.801 11:30:36 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:16.801 11:30:36 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:16.801 11:30:36 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:16.801 11:30:36 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:16.801 11:30:36 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:16.801 11:30:36 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:16.801 11:30:36 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:16.801 11:30:36 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:16.801 11:30:36 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:16.801 11:30:36 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:16.801 11:30:36 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:16.801 11:30:36 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:16.801 11:30:36 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:16.801 11:30:36 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:16.801 11:30:36 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:16.801 11:30:36 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:16.801 11:30:36 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:16.801 11:30:36 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:16.801 11:30:36 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:16.801 11:30:36 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:16.801 11:30:36 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:16.801 11:30:36 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:16.801 11:30:36 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:16.801 11:30:36 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:16.801 11:30:36 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:16.801 11:30:36 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:16.801 11:30:36 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:16.801 11:30:36 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:16.801 11:30:36 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:16.801 11:30:36 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:16.801 11:30:36 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:16.801 11:30:36 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:16.801 11:30:36 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:16.801 11:30:36 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:16.801 11:30:36 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:16.801 11:30:36 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:16.801 11:30:36 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:16.801 11:30:36 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:16.801 11:30:36 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:16.801 11:30:36 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:16.801 11:30:36 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:16.801 11:30:36 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:16.801 11:30:36 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:16.801 11:30:36 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:16.801 11:30:36 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:16.801 11:30:36 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:16.801 11:30:36 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:16.801 11:30:36 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:16.801 11:30:36 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:16.801 11:30:36 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:16.801 11:30:36 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:16.801 11:30:36 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:16.801 11:30:36 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:16.802 11:30:36 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:16.802 11:30:36 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:16.802 11:30:36 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:16.802 11:30:36 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:16.802 11:30:36 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:16.802 11:30:36 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:16.802 11:30:36 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:16.802 11:30:36 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:16.802 11:30:36 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:16.802 11:30:36 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:16.802 11:30:36 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:16.802 #define SPDK_CONFIG_H 00:06:16.802 #define SPDK_CONFIG_APPS 1 00:06:16.802 #define SPDK_CONFIG_ARCH native 00:06:16.802 #undef SPDK_CONFIG_ASAN 00:06:16.802 #undef SPDK_CONFIG_AVAHI 00:06:16.802 #undef SPDK_CONFIG_CET 00:06:16.802 #define SPDK_CONFIG_COVERAGE 1 00:06:16.802 #define SPDK_CONFIG_CROSS_PREFIX 00:06:16.802 #undef SPDK_CONFIG_CRYPTO 00:06:16.802 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:16.802 #undef SPDK_CONFIG_CUSTOMOCF 00:06:16.802 #undef SPDK_CONFIG_DAOS 00:06:16.802 #define SPDK_CONFIG_DAOS_DIR 00:06:16.802 #define SPDK_CONFIG_DEBUG 1 00:06:16.802 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:16.802 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:16.802 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:16.802 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:16.802 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:16.802 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:16.802 #define SPDK_CONFIG_EXAMPLES 1 00:06:16.802 #undef SPDK_CONFIG_FC 00:06:16.802 #define SPDK_CONFIG_FC_PATH 00:06:16.802 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:16.802 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:16.802 #undef SPDK_CONFIG_FUSE 00:06:16.802 #undef SPDK_CONFIG_FUZZER 00:06:16.802 #define SPDK_CONFIG_FUZZER_LIB 00:06:16.802 #undef SPDK_CONFIG_GOLANG 00:06:16.802 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:16.802 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:16.802 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:16.802 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:16.802 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:16.802 #define SPDK_CONFIG_IDXD 1 00:06:16.802 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:16.802 #undef SPDK_CONFIG_IPSEC_MB 00:06:16.802 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:16.802 #define SPDK_CONFIG_ISAL 1 00:06:16.802 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:16.802 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:16.802 #define SPDK_CONFIG_LIBDIR 00:06:16.802 #undef SPDK_CONFIG_LTO 00:06:16.802 #define SPDK_CONFIG_MAX_LCORES 00:06:16.802 #define SPDK_CONFIG_NVME_CUSE 1 00:06:16.802 #undef SPDK_CONFIG_OCF 00:06:16.802 #define SPDK_CONFIG_OCF_PATH 00:06:16.802 #define SPDK_CONFIG_OPENSSL_PATH 00:06:16.802 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:16.802 #undef SPDK_CONFIG_PGO_USE 00:06:16.802 #define SPDK_CONFIG_PREFIX /usr/local 00:06:16.802 #undef SPDK_CONFIG_RAID5F 00:06:16.802 #undef SPDK_CONFIG_RBD 00:06:16.802 #define SPDK_CONFIG_RDMA 1 00:06:16.802 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:16.802 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:16.802 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:16.802 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:16.802 #define SPDK_CONFIG_SHARED 1 00:06:16.802 #undef SPDK_CONFIG_SMA 00:06:16.802 #define SPDK_CONFIG_TESTS 1 00:06:16.802 #undef SPDK_CONFIG_TSAN 00:06:16.802 #define SPDK_CONFIG_UBLK 1 00:06:16.802 #define SPDK_CONFIG_UBSAN 1 00:06:16.802 #undef SPDK_CONFIG_UNIT_TESTS 00:06:16.802 #undef SPDK_CONFIG_URING 00:06:16.802 #define SPDK_CONFIG_URING_PATH 00:06:16.802 #undef SPDK_CONFIG_URING_ZNS 00:06:16.802 #undef SPDK_CONFIG_USDT 00:06:16.802 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:16.802 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:16.802 #undef SPDK_CONFIG_VFIO_USER 00:06:16.802 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:16.802 #define SPDK_CONFIG_VHOST 1 00:06:16.802 #define SPDK_CONFIG_VIRTIO 1 00:06:16.802 #undef SPDK_CONFIG_VTUNE 00:06:16.802 #define SPDK_CONFIG_VTUNE_DIR 00:06:16.802 #define SPDK_CONFIG_WERROR 1 00:06:16.802 #define SPDK_CONFIG_WPDK_DIR 00:06:16.802 #undef SPDK_CONFIG_XNVME 00:06:16.802 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:16.802 11:30:36 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:16.802 11:30:36 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:16.802 11:30:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:16.802 11:30:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:16.802 11:30:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:16.802 11:30:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:16.802 11:30:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:16.802 11:30:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:16.802 11:30:36 -- paths/export.sh@5 -- # export PATH 00:06:16.802 11:30:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:16.802 11:30:36 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:16.802 11:30:36 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:16.802 11:30:36 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:16.802 11:30:36 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:16.802 11:30:36 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:16.802 11:30:36 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:16.802 11:30:36 -- pm/common@16 -- # TEST_TAG=N/A 00:06:16.802 11:30:36 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:16.802 11:30:36 -- common/autotest_common.sh@52 -- # : 1 00:06:16.802 11:30:36 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:16.802 11:30:36 -- common/autotest_common.sh@56 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:16.802 11:30:36 -- common/autotest_common.sh@58 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:16.802 11:30:36 -- common/autotest_common.sh@60 -- # : 1 00:06:16.802 11:30:36 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:16.802 11:30:36 -- common/autotest_common.sh@62 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:16.802 11:30:36 -- common/autotest_common.sh@64 -- # : 00:06:16.802 11:30:36 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:16.802 11:30:36 -- common/autotest_common.sh@66 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:16.802 11:30:36 -- common/autotest_common.sh@68 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:16.802 11:30:36 -- common/autotest_common.sh@70 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:16.802 11:30:36 -- common/autotest_common.sh@72 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:16.802 11:30:36 -- common/autotest_common.sh@74 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:16.802 11:30:36 -- common/autotest_common.sh@76 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:16.802 11:30:36 -- common/autotest_common.sh@78 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:16.802 11:30:36 -- common/autotest_common.sh@80 -- # : 1 00:06:16.802 11:30:36 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:16.802 11:30:36 -- common/autotest_common.sh@82 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:16.802 11:30:36 -- common/autotest_common.sh@84 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:16.802 11:30:36 -- common/autotest_common.sh@86 -- # : 1 00:06:16.802 11:30:36 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:16.802 11:30:36 -- common/autotest_common.sh@88 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:16.802 11:30:36 -- common/autotest_common.sh@90 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:16.802 11:30:36 -- common/autotest_common.sh@92 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:16.802 11:30:36 -- common/autotest_common.sh@94 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:16.802 11:30:36 -- common/autotest_common.sh@96 -- # : tcp 00:06:16.802 11:30:36 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:16.802 11:30:36 -- common/autotest_common.sh@98 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:16.802 11:30:36 -- common/autotest_common.sh@100 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:16.802 11:30:36 -- common/autotest_common.sh@102 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:16.802 11:30:36 -- common/autotest_common.sh@104 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:16.802 11:30:36 -- common/autotest_common.sh@106 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:16.802 11:30:36 -- common/autotest_common.sh@108 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:16.802 11:30:36 -- common/autotest_common.sh@110 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:16.802 11:30:36 -- common/autotest_common.sh@112 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:16.802 11:30:36 -- common/autotest_common.sh@114 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:16.802 11:30:36 -- common/autotest_common.sh@116 -- # : 1 00:06:16.802 11:30:36 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:16.802 11:30:36 -- common/autotest_common.sh@118 -- # : 00:06:16.802 11:30:36 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:16.802 11:30:36 -- common/autotest_common.sh@120 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:16.802 11:30:36 -- common/autotest_common.sh@122 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:16.802 11:30:36 -- common/autotest_common.sh@124 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:16.802 11:30:36 -- common/autotest_common.sh@126 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:16.802 11:30:36 -- common/autotest_common.sh@128 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:16.802 11:30:36 -- common/autotest_common.sh@130 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:16.802 11:30:36 -- common/autotest_common.sh@132 -- # : 00:06:16.802 11:30:36 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:16.802 11:30:36 -- common/autotest_common.sh@134 -- # : true 00:06:16.802 11:30:36 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:16.802 11:30:36 -- common/autotest_common.sh@136 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:16.802 11:30:36 -- common/autotest_common.sh@138 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:16.802 11:30:36 -- common/autotest_common.sh@140 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:16.802 11:30:36 -- common/autotest_common.sh@142 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:16.802 11:30:36 -- common/autotest_common.sh@144 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:16.802 11:30:36 -- common/autotest_common.sh@146 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:16.802 11:30:36 -- common/autotest_common.sh@148 -- # : e810 00:06:16.802 11:30:36 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:16.802 11:30:36 -- common/autotest_common.sh@150 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:16.802 11:30:36 -- common/autotest_common.sh@152 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:16.802 11:30:36 -- common/autotest_common.sh@154 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:16.802 11:30:36 -- common/autotest_common.sh@156 -- # : 0 00:06:16.802 11:30:36 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:16.802 11:30:36 -- common/autotest_common.sh@158 -- # : 0 00:06:16.803 11:30:36 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:16.803 11:30:36 -- common/autotest_common.sh@160 -- # : 0 00:06:16.803 11:30:36 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:16.803 11:30:36 -- common/autotest_common.sh@163 -- # : 00:06:16.803 11:30:36 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:16.803 11:30:36 -- common/autotest_common.sh@165 -- # : 0 00:06:16.803 11:30:36 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:16.803 11:30:36 -- common/autotest_common.sh@167 -- # : 0 00:06:16.803 11:30:36 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:16.803 11:30:36 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:16.803 11:30:36 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:16.803 11:30:36 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:16.803 11:30:36 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:16.803 11:30:36 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:16.803 11:30:36 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:16.803 11:30:36 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:16.803 11:30:36 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:16.803 11:30:36 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:16.803 11:30:36 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:16.803 11:30:36 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:16.803 11:30:36 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:16.803 11:30:36 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:16.803 11:30:36 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:16.803 11:30:36 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:16.803 11:30:36 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:16.803 11:30:36 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:16.803 11:30:36 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:16.803 11:30:36 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:16.803 11:30:36 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:16.803 11:30:36 -- common/autotest_common.sh@196 -- # cat 00:06:16.803 11:30:36 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:16.803 11:30:36 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:16.803 11:30:36 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:16.803 11:30:36 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:16.803 11:30:36 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:16.803 11:30:36 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:16.803 11:30:36 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:16.803 11:30:36 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:16.803 11:30:36 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:16.803 11:30:36 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:16.803 11:30:36 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:16.803 11:30:36 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:16.803 11:30:36 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:16.803 11:30:36 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:16.803 11:30:36 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:16.803 11:30:36 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:16.803 11:30:36 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:16.803 11:30:36 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:16.803 11:30:36 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:16.803 11:30:36 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:16.803 11:30:36 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:16.803 11:30:36 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:16.803 11:30:36 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:16.803 11:30:36 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:16.803 11:30:36 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:16.803 11:30:36 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:16.803 11:30:36 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:16.803 11:30:36 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:16.803 11:30:36 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:16.803 11:30:36 -- common/autotest_common.sh@259 -- # valgrind= 00:06:16.803 11:30:36 -- common/autotest_common.sh@265 -- # uname -s 00:06:16.803 11:30:36 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:16.803 11:30:36 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:16.803 11:30:36 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:16.803 11:30:36 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:16.803 11:30:36 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:16.803 11:30:36 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:16.803 11:30:36 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:16.803 11:30:36 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:16.803 11:30:36 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:16.803 11:30:36 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:16.803 11:30:36 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:16.803 11:30:36 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:16.803 11:30:36 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:16.803 11:30:36 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:16.803 11:30:36 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:16.803 11:30:36 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:16.803 11:30:36 -- common/autotest_common.sh@319 -- # [[ -z 3705298 ]] 00:06:16.803 11:30:36 -- common/autotest_common.sh@319 -- # kill -0 3705298 00:06:16.803 11:30:36 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:16.803 11:30:36 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:16.803 11:30:36 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:16.803 11:30:36 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:16.803 11:30:36 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:16.803 11:30:36 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:16.803 11:30:36 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:16.803 11:30:36 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:16.803 11:30:36 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.9j5RZw 00:06:16.803 11:30:36 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:16.803 11:30:36 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:16.803 11:30:36 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:17.086 11:30:36 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.9j5RZw/tests/target /tmp/spdk.9j5RZw 00:06:17.086 11:30:36 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:17.086 11:30:36 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.086 11:30:36 -- common/autotest_common.sh@328 -- # df -T 00:06:17.086 11:30:36 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:17.086 11:30:36 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:17.086 11:30:36 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:17.086 11:30:36 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:17.086 11:30:36 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:17.086 11:30:36 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:17.086 11:30:36 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.086 11:30:36 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:17.086 11:30:36 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:17.086 11:30:36 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:17.086 11:30:36 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:17.086 11:30:36 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:17.086 11:30:36 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.086 11:30:36 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:17.086 11:30:36 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:17.086 11:30:36 -- common/autotest_common.sh@363 -- # avails["$mount"]=55256621056 00:06:17.086 11:30:36 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988503552 00:06:17.086 11:30:36 -- common/autotest_common.sh@364 -- # uses["$mount"]=6731882496 00:06:17.086 11:30:36 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.086 11:30:36 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:17.086 11:30:36 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:17.086 11:30:36 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991659008 00:06:17.086 11:30:36 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:06:17.086 11:30:36 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:17.086 11:30:36 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.086 11:30:36 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:17.086 11:30:36 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:17.086 11:30:36 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:06:17.086 11:30:36 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:06:17.086 11:30:36 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:17.086 11:30:36 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.086 11:30:36 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:17.086 11:30:36 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:17.086 11:30:36 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993125376 00:06:17.086 11:30:36 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:06:17.086 11:30:36 -- common/autotest_common.sh@364 -- # uses["$mount"]=1126400 00:06:17.086 11:30:36 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.086 11:30:36 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:17.086 11:30:36 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:17.086 11:30:36 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:17.086 11:30:36 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:17.086 11:30:36 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:17.086 11:30:36 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.086 11:30:36 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:17.086 * Looking for test storage... 00:06:17.086 11:30:36 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:17.086 11:30:36 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:17.086 11:30:36 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:17.086 11:30:36 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:17.086 11:30:36 -- common/autotest_common.sh@373 -- # mount=/ 00:06:17.086 11:30:36 -- common/autotest_common.sh@375 -- # target_space=55256621056 00:06:17.086 11:30:36 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:17.086 11:30:36 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:17.086 11:30:36 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:17.086 11:30:36 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:17.086 11:30:36 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:17.086 11:30:36 -- common/autotest_common.sh@382 -- # new_size=8946475008 00:06:17.086 11:30:36 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:17.086 11:30:36 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:17.086 11:30:36 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:17.086 11:30:36 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:17.086 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:17.086 11:30:36 -- common/autotest_common.sh@390 -- # return 0 00:06:17.086 11:30:36 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:17.086 11:30:36 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:17.086 11:30:36 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:17.086 11:30:36 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:17.086 11:30:36 -- common/autotest_common.sh@1682 -- # true 00:06:17.087 11:30:36 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:17.087 11:30:36 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:17.087 11:30:36 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:17.087 11:30:36 -- common/autotest_common.sh@27 -- # exec 00:06:17.087 11:30:36 -- common/autotest_common.sh@29 -- # exec 00:06:17.087 11:30:36 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:17.087 11:30:36 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:17.087 11:30:36 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:17.087 11:30:36 -- common/autotest_common.sh@18 -- # set -x 00:06:17.087 11:30:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:17.087 11:30:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:17.087 11:30:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:17.087 11:30:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:17.087 11:30:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:17.087 11:30:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:17.087 11:30:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:17.087 11:30:36 -- scripts/common.sh@335 -- # IFS=.-: 00:06:17.087 11:30:36 -- scripts/common.sh@335 -- # read -ra ver1 00:06:17.087 11:30:36 -- scripts/common.sh@336 -- # IFS=.-: 00:06:17.087 11:30:36 -- scripts/common.sh@336 -- # read -ra ver2 00:06:17.087 11:30:36 -- scripts/common.sh@337 -- # local 'op=<' 00:06:17.087 11:30:36 -- scripts/common.sh@339 -- # ver1_l=2 00:06:17.087 11:30:36 -- scripts/common.sh@340 -- # ver2_l=1 00:06:17.087 11:30:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:17.087 11:30:36 -- scripts/common.sh@343 -- # case "$op" in 00:06:17.087 11:30:36 -- scripts/common.sh@344 -- # : 1 00:06:17.087 11:30:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:17.087 11:30:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:17.087 11:30:36 -- scripts/common.sh@364 -- # decimal 1 00:06:17.087 11:30:36 -- scripts/common.sh@352 -- # local d=1 00:06:17.087 11:30:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:17.087 11:30:36 -- scripts/common.sh@354 -- # echo 1 00:06:17.087 11:30:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:17.087 11:30:36 -- scripts/common.sh@365 -- # decimal 2 00:06:17.087 11:30:36 -- scripts/common.sh@352 -- # local d=2 00:06:17.087 11:30:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:17.087 11:30:36 -- scripts/common.sh@354 -- # echo 2 00:06:17.087 11:30:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:17.087 11:30:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:17.087 11:30:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:17.087 11:30:36 -- scripts/common.sh@367 -- # return 0 00:06:17.087 11:30:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:17.087 11:30:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:17.087 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:17.087 --rc genhtml_branch_coverage=1 00:06:17.087 --rc genhtml_function_coverage=1 00:06:17.087 --rc genhtml_legend=1 00:06:17.087 --rc geninfo_all_blocks=1 00:06:17.087 --rc geninfo_unexecuted_blocks=1 00:06:17.087 00:06:17.087 ' 00:06:17.087 11:30:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:17.087 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:17.087 --rc genhtml_branch_coverage=1 00:06:17.087 --rc genhtml_function_coverage=1 00:06:17.087 --rc genhtml_legend=1 00:06:17.087 --rc geninfo_all_blocks=1 00:06:17.087 --rc geninfo_unexecuted_blocks=1 00:06:17.087 00:06:17.087 ' 00:06:17.087 11:30:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:17.087 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:17.087 --rc genhtml_branch_coverage=1 00:06:17.087 --rc genhtml_function_coverage=1 00:06:17.087 --rc genhtml_legend=1 00:06:17.087 --rc geninfo_all_blocks=1 00:06:17.087 --rc geninfo_unexecuted_blocks=1 00:06:17.087 00:06:17.087 ' 00:06:17.087 11:30:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:17.087 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:17.087 --rc genhtml_branch_coverage=1 00:06:17.087 --rc genhtml_function_coverage=1 00:06:17.087 --rc genhtml_legend=1 00:06:17.087 --rc geninfo_all_blocks=1 00:06:17.087 --rc geninfo_unexecuted_blocks=1 00:06:17.087 00:06:17.087 ' 00:06:17.087 11:30:36 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:17.087 11:30:36 -- nvmf/common.sh@7 -- # uname -s 00:06:17.087 11:30:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:17.087 11:30:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:17.087 11:30:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:17.087 11:30:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:17.087 11:30:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:17.087 11:30:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:17.087 11:30:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:17.087 11:30:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:17.087 11:30:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:17.087 11:30:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:17.087 11:30:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:17.087 11:30:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:17.087 11:30:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:17.087 11:30:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:17.087 11:30:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:17.087 11:30:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:17.087 11:30:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:17.087 11:30:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:17.087 11:30:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:17.087 11:30:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:17.087 11:30:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:17.087 11:30:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:17.087 11:30:36 -- paths/export.sh@5 -- # export PATH 00:06:17.087 11:30:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:17.087 11:30:36 -- nvmf/common.sh@46 -- # : 0 00:06:17.087 11:30:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:17.087 11:30:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:17.087 11:30:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:17.087 11:30:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:17.087 11:30:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:17.087 11:30:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:17.087 11:30:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:17.087 11:30:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:17.087 11:30:36 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:17.087 11:30:36 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:17.087 11:30:36 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:17.087 11:30:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:17.087 11:30:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:17.087 11:30:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:17.087 11:30:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:17.087 11:30:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:17.087 11:30:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:17.087 11:30:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:17.087 11:30:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:17.087 11:30:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:17.087 11:30:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:17.087 11:30:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:17.087 11:30:36 -- common/autotest_common.sh@10 -- # set +x 00:06:19.623 11:30:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:19.623 11:30:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:19.623 11:30:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:19.623 11:30:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:19.623 11:30:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:19.623 11:30:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:19.623 11:30:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:19.623 11:30:39 -- nvmf/common.sh@294 -- # net_devs=() 00:06:19.623 11:30:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:19.623 11:30:39 -- nvmf/common.sh@295 -- # e810=() 00:06:19.623 11:30:39 -- nvmf/common.sh@295 -- # local -ga e810 00:06:19.623 11:30:39 -- nvmf/common.sh@296 -- # x722=() 00:06:19.623 11:30:39 -- nvmf/common.sh@296 -- # local -ga x722 00:06:19.623 11:30:39 -- nvmf/common.sh@297 -- # mlx=() 00:06:19.623 11:30:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:19.623 11:30:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:19.623 11:30:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:19.623 11:30:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:19.623 11:30:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:19.623 11:30:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:19.623 11:30:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:19.623 11:30:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:19.623 11:30:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:19.623 11:30:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:19.623 11:30:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:19.623 11:30:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:19.623 11:30:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:19.623 11:30:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:19.623 11:30:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:19.623 11:30:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:19.623 11:30:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:19.623 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:19.623 11:30:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:19.623 11:30:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:19.623 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:19.623 11:30:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:19.623 11:30:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:19.623 11:30:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:19.623 11:30:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:19.623 11:30:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:19.623 11:30:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:19.623 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:19.623 11:30:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:19.623 11:30:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:19.623 11:30:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:19.623 11:30:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:19.623 11:30:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:19.623 11:30:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:19.623 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:19.623 11:30:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:19.623 11:30:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:19.623 11:30:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:19.623 11:30:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:19.623 11:30:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:19.623 11:30:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:19.623 11:30:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:19.623 11:30:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:19.623 11:30:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:19.623 11:30:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:19.623 11:30:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:19.623 11:30:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:19.623 11:30:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:19.623 11:30:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:19.623 11:30:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:19.623 11:30:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:19.623 11:30:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:19.623 11:30:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:19.623 11:30:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:19.623 11:30:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:19.624 11:30:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:19.624 11:30:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:19.624 11:30:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:19.624 11:30:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:19.624 11:30:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:19.624 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:19.624 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.365 ms 00:06:19.624 00:06:19.624 --- 10.0.0.2 ping statistics --- 00:06:19.624 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:19.624 rtt min/avg/max/mdev = 0.365/0.365/0.365/0.000 ms 00:06:19.624 11:30:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:19.624 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:19.624 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:06:19.624 00:06:19.624 --- 10.0.0.1 ping statistics --- 00:06:19.624 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:19.624 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:06:19.624 11:30:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:19.624 11:30:39 -- nvmf/common.sh@410 -- # return 0 00:06:19.624 11:30:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:19.624 11:30:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:19.624 11:30:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:19.624 11:30:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:19.624 11:30:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:19.624 11:30:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:19.624 11:30:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:19.624 11:30:39 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:19.624 11:30:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:19.624 11:30:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.624 11:30:39 -- common/autotest_common.sh@10 -- # set +x 00:06:19.624 ************************************ 00:06:19.624 START TEST nvmf_filesystem_no_in_capsule 00:06:19.624 ************************************ 00:06:19.624 11:30:39 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:19.624 11:30:39 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:19.624 11:30:39 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:19.624 11:30:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:19.624 11:30:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:19.624 11:30:39 -- common/autotest_common.sh@10 -- # set +x 00:06:19.624 11:30:39 -- nvmf/common.sh@469 -- # nvmfpid=3706952 00:06:19.624 11:30:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:19.624 11:30:39 -- nvmf/common.sh@470 -- # waitforlisten 3706952 00:06:19.624 11:30:39 -- common/autotest_common.sh@829 -- # '[' -z 3706952 ']' 00:06:19.624 11:30:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:19.624 11:30:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:19.624 11:30:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:19.624 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:19.624 11:30:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:19.624 11:30:39 -- common/autotest_common.sh@10 -- # set +x 00:06:19.624 [2024-11-28 11:30:39.356847] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.624 [2024-11-28 11:30:39.356920] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:19.624 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.624 [2024-11-28 11:30:39.423499] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:19.624 [2024-11-28 11:30:39.533565] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:19.624 [2024-11-28 11:30:39.533732] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:19.624 [2024-11-28 11:30:39.533750] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:19.624 [2024-11-28 11:30:39.533763] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:19.624 [2024-11-28 11:30:39.533830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:19.624 [2024-11-28 11:30:39.533922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:19.624 [2024-11-28 11:30:39.533988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:19.624 [2024-11-28 11:30:39.533991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.557 11:30:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:20.557 11:30:40 -- common/autotest_common.sh@862 -- # return 0 00:06:20.557 11:30:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:20.557 11:30:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:20.557 11:30:40 -- common/autotest_common.sh@10 -- # set +x 00:06:20.557 11:30:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:20.557 11:30:40 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:20.557 11:30:40 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:20.557 11:30:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:20.557 11:30:40 -- common/autotest_common.sh@10 -- # set +x 00:06:20.557 [2024-11-28 11:30:40.411311] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:20.557 11:30:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:20.557 11:30:40 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:20.558 11:30:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:20.558 11:30:40 -- common/autotest_common.sh@10 -- # set +x 00:06:20.558 Malloc1 00:06:20.558 11:30:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:20.558 11:30:40 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:20.558 11:30:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:20.558 11:30:40 -- common/autotest_common.sh@10 -- # set +x 00:06:20.558 11:30:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:20.558 11:30:40 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:20.558 11:30:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:20.558 11:30:40 -- common/autotest_common.sh@10 -- # set +x 00:06:20.558 11:30:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:20.558 11:30:40 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:20.558 11:30:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:20.558 11:30:40 -- common/autotest_common.sh@10 -- # set +x 00:06:20.558 [2024-11-28 11:30:40.600224] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:20.558 11:30:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:20.558 11:30:40 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:20.558 11:30:40 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:20.558 11:30:40 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:20.558 11:30:40 -- common/autotest_common.sh@1369 -- # local bs 00:06:20.558 11:30:40 -- common/autotest_common.sh@1370 -- # local nb 00:06:20.558 11:30:40 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:20.558 11:30:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:20.558 11:30:40 -- common/autotest_common.sh@10 -- # set +x 00:06:20.815 11:30:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:20.815 11:30:40 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:20.815 { 00:06:20.815 "name": "Malloc1", 00:06:20.815 "aliases": [ 00:06:20.815 "c5ff922d-d348-41ad-b841-4a2f828fe801" 00:06:20.815 ], 00:06:20.815 "product_name": "Malloc disk", 00:06:20.815 "block_size": 512, 00:06:20.815 "num_blocks": 1048576, 00:06:20.815 "uuid": "c5ff922d-d348-41ad-b841-4a2f828fe801", 00:06:20.815 "assigned_rate_limits": { 00:06:20.815 "rw_ios_per_sec": 0, 00:06:20.815 "rw_mbytes_per_sec": 0, 00:06:20.815 "r_mbytes_per_sec": 0, 00:06:20.815 "w_mbytes_per_sec": 0 00:06:20.815 }, 00:06:20.815 "claimed": true, 00:06:20.815 "claim_type": "exclusive_write", 00:06:20.815 "zoned": false, 00:06:20.815 "supported_io_types": { 00:06:20.815 "read": true, 00:06:20.815 "write": true, 00:06:20.815 "unmap": true, 00:06:20.815 "write_zeroes": true, 00:06:20.815 "flush": true, 00:06:20.815 "reset": true, 00:06:20.815 "compare": false, 00:06:20.815 "compare_and_write": false, 00:06:20.815 "abort": true, 00:06:20.815 "nvme_admin": false, 00:06:20.815 "nvme_io": false 00:06:20.815 }, 00:06:20.815 "memory_domains": [ 00:06:20.815 { 00:06:20.815 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:20.815 "dma_device_type": 2 00:06:20.815 } 00:06:20.815 ], 00:06:20.815 "driver_specific": {} 00:06:20.815 } 00:06:20.815 ]' 00:06:20.815 11:30:40 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:20.815 11:30:40 -- common/autotest_common.sh@1372 -- # bs=512 00:06:20.815 11:30:40 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:20.816 11:30:40 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:20.816 11:30:40 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:20.816 11:30:40 -- common/autotest_common.sh@1377 -- # echo 512 00:06:20.816 11:30:40 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:20.816 11:30:40 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:21.381 11:30:41 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:21.381 11:30:41 -- common/autotest_common.sh@1187 -- # local i=0 00:06:21.381 11:30:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:21.381 11:30:41 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:21.381 11:30:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:23.911 11:30:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:23.911 11:30:43 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:23.911 11:30:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:23.911 11:30:43 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:23.911 11:30:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:23.911 11:30:43 -- common/autotest_common.sh@1197 -- # return 0 00:06:23.911 11:30:43 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:23.911 11:30:43 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:23.911 11:30:43 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:23.911 11:30:43 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:23.911 11:30:43 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:23.911 11:30:43 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:23.911 11:30:43 -- setup/common.sh@80 -- # echo 536870912 00:06:23.911 11:30:43 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:23.911 11:30:43 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:23.911 11:30:43 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:23.911 11:30:43 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:23.911 11:30:43 -- target/filesystem.sh@69 -- # partprobe 00:06:23.911 11:30:43 -- target/filesystem.sh@70 -- # sleep 1 00:06:25.284 11:30:44 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:25.284 11:30:44 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:25.284 11:30:44 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:25.284 11:30:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.284 11:30:44 -- common/autotest_common.sh@10 -- # set +x 00:06:25.284 ************************************ 00:06:25.284 START TEST filesystem_ext4 00:06:25.284 ************************************ 00:06:25.284 11:30:44 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:25.284 11:30:44 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:25.284 11:30:44 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:25.284 11:30:44 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:25.284 11:30:44 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:25.284 11:30:44 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:25.284 11:30:44 -- common/autotest_common.sh@914 -- # local i=0 00:06:25.284 11:30:44 -- common/autotest_common.sh@915 -- # local force 00:06:25.284 11:30:44 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:25.284 11:30:44 -- common/autotest_common.sh@918 -- # force=-F 00:06:25.284 11:30:44 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:25.284 mke2fs 1.47.0 (5-Feb-2023) 00:06:25.284 Discarding device blocks: 0/522240 done 00:06:25.284 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:25.284 Filesystem UUID: 69f4d252-cf72-41a4-ac82-24e19f8d4305 00:06:25.284 Superblock backups stored on blocks: 00:06:25.284 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:25.284 00:06:25.284 Allocating group tables: 0/64 done 00:06:25.284 Writing inode tables: 0/64 done 00:06:26.216 Creating journal (8192 blocks): done 00:06:28.339 Writing superblocks and filesystem accounting information: 0/6450/64 done 00:06:28.339 00:06:28.339 11:30:48 -- common/autotest_common.sh@931 -- # return 0 00:06:28.339 11:30:48 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:34.893 11:30:54 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:34.893 11:30:54 -- target/filesystem.sh@25 -- # sync 00:06:34.893 11:30:54 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:34.893 11:30:54 -- target/filesystem.sh@27 -- # sync 00:06:34.893 11:30:54 -- target/filesystem.sh@29 -- # i=0 00:06:34.893 11:30:54 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:34.893 11:30:54 -- target/filesystem.sh@37 -- # kill -0 3706952 00:06:34.893 11:30:54 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:34.893 11:30:54 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:34.893 11:30:54 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:34.893 11:30:54 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:34.893 00:06:34.893 real 0m9.375s 00:06:34.893 user 0m0.015s 00:06:34.893 sys 0m0.067s 00:06:34.893 11:30:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:34.893 11:30:54 -- common/autotest_common.sh@10 -- # set +x 00:06:34.893 ************************************ 00:06:34.893 END TEST filesystem_ext4 00:06:34.893 ************************************ 00:06:34.893 11:30:54 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:34.893 11:30:54 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:34.893 11:30:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.893 11:30:54 -- common/autotest_common.sh@10 -- # set +x 00:06:34.893 ************************************ 00:06:34.893 START TEST filesystem_btrfs 00:06:34.893 ************************************ 00:06:34.893 11:30:54 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:34.893 11:30:54 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:34.893 11:30:54 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:34.893 11:30:54 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:34.893 11:30:54 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:06:34.893 11:30:54 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:34.893 11:30:54 -- common/autotest_common.sh@914 -- # local i=0 00:06:34.893 11:30:54 -- common/autotest_common.sh@915 -- # local force 00:06:34.893 11:30:54 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:06:34.893 11:30:54 -- common/autotest_common.sh@920 -- # force=-f 00:06:34.893 11:30:54 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:34.893 btrfs-progs v6.8.1 00:06:34.893 See https://btrfs.readthedocs.io for more information. 00:06:34.893 00:06:34.893 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:34.893 NOTE: several default settings have changed in version 5.15, please make sure 00:06:34.893 this does not affect your deployments: 00:06:34.893 - DUP for metadata (-m dup) 00:06:34.893 - enabled no-holes (-O no-holes) 00:06:34.893 - enabled free-space-tree (-R free-space-tree) 00:06:34.893 00:06:34.893 Label: (null) 00:06:34.893 UUID: 2de6e94c-77f9-4fe2-9d3a-3089f1e3b09b 00:06:34.893 Node size: 16384 00:06:34.893 Sector size: 4096 (CPU page size: 4096) 00:06:34.893 Filesystem size: 510.00MiB 00:06:34.893 Block group profiles: 00:06:34.893 Data: single 8.00MiB 00:06:34.893 Metadata: DUP 32.00MiB 00:06:34.893 System: DUP 8.00MiB 00:06:34.893 SSD detected: yes 00:06:34.893 Zoned device: no 00:06:34.893 Features: extref, skinny-metadata, no-holes, free-space-tree 00:06:34.893 Checksum: crc32c 00:06:34.893 Number of devices: 1 00:06:34.893 Devices: 00:06:34.893 ID SIZE PATH 00:06:34.893 1 510.00MiB /dev/nvme0n1p1 00:06:34.893 00:06:34.893 11:30:54 -- common/autotest_common.sh@931 -- # return 0 00:06:34.893 11:30:54 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:34.893 11:30:54 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:34.893 11:30:54 -- target/filesystem.sh@25 -- # sync 00:06:34.893 11:30:54 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:34.893 11:30:54 -- target/filesystem.sh@27 -- # sync 00:06:34.893 11:30:54 -- target/filesystem.sh@29 -- # i=0 00:06:34.893 11:30:54 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:34.893 11:30:54 -- target/filesystem.sh@37 -- # kill -0 3706952 00:06:34.893 11:30:54 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:34.893 11:30:54 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:34.893 11:30:54 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:34.893 11:30:54 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:34.893 00:06:34.893 real 0m0.549s 00:06:34.893 user 0m0.012s 00:06:34.893 sys 0m0.107s 00:06:34.893 11:30:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:34.893 11:30:54 -- common/autotest_common.sh@10 -- # set +x 00:06:34.893 ************************************ 00:06:34.893 END TEST filesystem_btrfs 00:06:34.893 ************************************ 00:06:34.893 11:30:54 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:06:34.893 11:30:54 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:34.893 11:30:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.893 11:30:54 -- common/autotest_common.sh@10 -- # set +x 00:06:34.893 ************************************ 00:06:34.893 START TEST filesystem_xfs 00:06:34.893 ************************************ 00:06:34.893 11:30:54 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:06:34.893 11:30:54 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:34.893 11:30:54 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:34.893 11:30:54 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:34.893 11:30:54 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:06:34.893 11:30:54 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:34.893 11:30:54 -- common/autotest_common.sh@914 -- # local i=0 00:06:34.893 11:30:54 -- common/autotest_common.sh@915 -- # local force 00:06:34.893 11:30:54 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:06:34.893 11:30:54 -- common/autotest_common.sh@920 -- # force=-f 00:06:34.893 11:30:54 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:35.151 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:35.151 = sectsz=512 attr=2, projid32bit=1 00:06:35.151 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:35.151 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:35.151 data = bsize=4096 blocks=130560, imaxpct=25 00:06:35.151 = sunit=0 swidth=0 blks 00:06:35.151 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:35.151 log =internal log bsize=4096 blocks=16384, version=2 00:06:35.151 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:35.151 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:36.523 Discarding blocks...Done. 00:06:36.523 11:30:56 -- common/autotest_common.sh@931 -- # return 0 00:06:36.523 11:30:56 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:39.052 11:30:58 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:39.052 11:30:58 -- target/filesystem.sh@25 -- # sync 00:06:39.052 11:30:58 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:39.052 11:30:58 -- target/filesystem.sh@27 -- # sync 00:06:39.052 11:30:58 -- target/filesystem.sh@29 -- # i=0 00:06:39.052 11:30:58 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:39.052 11:30:58 -- target/filesystem.sh@37 -- # kill -0 3706952 00:06:39.052 11:30:58 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:39.052 11:30:58 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:39.052 11:30:58 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:39.052 11:30:58 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:39.052 00:06:39.052 real 0m3.767s 00:06:39.052 user 0m0.021s 00:06:39.052 sys 0m0.062s 00:06:39.052 11:30:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.052 11:30:58 -- common/autotest_common.sh@10 -- # set +x 00:06:39.052 ************************************ 00:06:39.052 END TEST filesystem_xfs 00:06:39.052 ************************************ 00:06:39.052 11:30:58 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:39.052 11:30:58 -- target/filesystem.sh@93 -- # sync 00:06:39.052 11:30:58 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:39.052 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:39.052 11:30:58 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:39.052 11:30:58 -- common/autotest_common.sh@1208 -- # local i=0 00:06:39.052 11:30:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:06:39.052 11:30:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:39.052 11:30:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:06:39.052 11:30:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:39.052 11:30:58 -- common/autotest_common.sh@1220 -- # return 0 00:06:39.052 11:30:58 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:39.052 11:30:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:39.052 11:30:58 -- common/autotest_common.sh@10 -- # set +x 00:06:39.052 11:30:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:39.052 11:30:58 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:39.052 11:30:58 -- target/filesystem.sh@101 -- # killprocess 3706952 00:06:39.052 11:30:58 -- common/autotest_common.sh@936 -- # '[' -z 3706952 ']' 00:06:39.052 11:30:58 -- common/autotest_common.sh@940 -- # kill -0 3706952 00:06:39.052 11:30:58 -- common/autotest_common.sh@941 -- # uname 00:06:39.052 11:30:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:39.052 11:30:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3706952 00:06:39.052 11:30:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:39.052 11:30:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:39.052 11:30:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3706952' 00:06:39.052 killing process with pid 3706952 00:06:39.052 11:30:58 -- common/autotest_common.sh@955 -- # kill 3706952 00:06:39.052 11:30:58 -- common/autotest_common.sh@960 -- # wait 3706952 00:06:39.619 11:30:59 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:39.619 00:06:39.619 real 0m20.071s 00:06:39.619 user 1m17.799s 00:06:39.619 sys 0m2.313s 00:06:39.619 11:30:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.619 11:30:59 -- common/autotest_common.sh@10 -- # set +x 00:06:39.619 ************************************ 00:06:39.619 END TEST nvmf_filesystem_no_in_capsule 00:06:39.619 ************************************ 00:06:39.619 11:30:59 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:06:39.619 11:30:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:39.619 11:30:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.619 11:30:59 -- common/autotest_common.sh@10 -- # set +x 00:06:39.619 ************************************ 00:06:39.619 START TEST nvmf_filesystem_in_capsule 00:06:39.619 ************************************ 00:06:39.619 11:30:59 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:06:39.619 11:30:59 -- target/filesystem.sh@47 -- # in_capsule=4096 00:06:39.619 11:30:59 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:39.619 11:30:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:39.619 11:30:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:39.619 11:30:59 -- common/autotest_common.sh@10 -- # set +x 00:06:39.619 11:30:59 -- nvmf/common.sh@469 -- # nvmfpid=3709657 00:06:39.619 11:30:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:39.619 11:30:59 -- nvmf/common.sh@470 -- # waitforlisten 3709657 00:06:39.619 11:30:59 -- common/autotest_common.sh@829 -- # '[' -z 3709657 ']' 00:06:39.619 11:30:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:39.619 11:30:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:39.619 11:30:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:39.619 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:39.619 11:30:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:39.619 11:30:59 -- common/autotest_common.sh@10 -- # set +x 00:06:39.619 [2024-11-28 11:30:59.458942] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:39.619 [2024-11-28 11:30:59.459028] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:39.619 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.619 [2024-11-28 11:30:59.526670] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:39.619 [2024-11-28 11:30:59.640897] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:39.619 [2024-11-28 11:30:59.641078] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:39.619 [2024-11-28 11:30:59.641107] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:39.619 [2024-11-28 11:30:59.641129] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:39.619 [2024-11-28 11:30:59.641236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:39.619 [2024-11-28 11:30:59.641298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:39.619 [2024-11-28 11:30:59.641362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.619 [2024-11-28 11:30:59.641357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:40.555 11:31:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:40.555 11:31:00 -- common/autotest_common.sh@862 -- # return 0 00:06:40.555 11:31:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:40.555 11:31:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:40.555 11:31:00 -- common/autotest_common.sh@10 -- # set +x 00:06:40.555 11:31:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:40.555 11:31:00 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:40.555 11:31:00 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:06:40.555 11:31:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.555 11:31:00 -- common/autotest_common.sh@10 -- # set +x 00:06:40.555 [2024-11-28 11:31:00.452089] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:40.555 11:31:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.555 11:31:00 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:40.555 11:31:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.555 11:31:00 -- common/autotest_common.sh@10 -- # set +x 00:06:40.813 Malloc1 00:06:40.813 11:31:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.813 11:31:00 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:40.813 11:31:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.813 11:31:00 -- common/autotest_common.sh@10 -- # set +x 00:06:40.813 11:31:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.813 11:31:00 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:40.813 11:31:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.813 11:31:00 -- common/autotest_common.sh@10 -- # set +x 00:06:40.813 11:31:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.813 11:31:00 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:40.813 11:31:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.813 11:31:00 -- common/autotest_common.sh@10 -- # set +x 00:06:40.813 [2024-11-28 11:31:00.636306] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:40.813 11:31:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.813 11:31:00 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:40.814 11:31:00 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:40.814 11:31:00 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:40.814 11:31:00 -- common/autotest_common.sh@1369 -- # local bs 00:06:40.814 11:31:00 -- common/autotest_common.sh@1370 -- # local nb 00:06:40.814 11:31:00 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:40.814 11:31:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.814 11:31:00 -- common/autotest_common.sh@10 -- # set +x 00:06:40.814 11:31:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.814 11:31:00 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:40.814 { 00:06:40.814 "name": "Malloc1", 00:06:40.814 "aliases": [ 00:06:40.814 "0cb6d433-c7d8-4959-84e9-028196daf353" 00:06:40.814 ], 00:06:40.814 "product_name": "Malloc disk", 00:06:40.814 "block_size": 512, 00:06:40.814 "num_blocks": 1048576, 00:06:40.814 "uuid": "0cb6d433-c7d8-4959-84e9-028196daf353", 00:06:40.814 "assigned_rate_limits": { 00:06:40.814 "rw_ios_per_sec": 0, 00:06:40.814 "rw_mbytes_per_sec": 0, 00:06:40.814 "r_mbytes_per_sec": 0, 00:06:40.814 "w_mbytes_per_sec": 0 00:06:40.814 }, 00:06:40.814 "claimed": true, 00:06:40.814 "claim_type": "exclusive_write", 00:06:40.814 "zoned": false, 00:06:40.814 "supported_io_types": { 00:06:40.814 "read": true, 00:06:40.814 "write": true, 00:06:40.814 "unmap": true, 00:06:40.814 "write_zeroes": true, 00:06:40.814 "flush": true, 00:06:40.814 "reset": true, 00:06:40.814 "compare": false, 00:06:40.814 "compare_and_write": false, 00:06:40.814 "abort": true, 00:06:40.814 "nvme_admin": false, 00:06:40.814 "nvme_io": false 00:06:40.814 }, 00:06:40.814 "memory_domains": [ 00:06:40.814 { 00:06:40.814 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:40.814 "dma_device_type": 2 00:06:40.814 } 00:06:40.814 ], 00:06:40.814 "driver_specific": {} 00:06:40.814 } 00:06:40.814 ]' 00:06:40.814 11:31:00 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:40.814 11:31:00 -- common/autotest_common.sh@1372 -- # bs=512 00:06:40.814 11:31:00 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:40.814 11:31:00 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:40.814 11:31:00 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:40.814 11:31:00 -- common/autotest_common.sh@1377 -- # echo 512 00:06:40.814 11:31:00 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:40.814 11:31:00 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:41.379 11:31:01 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:41.379 11:31:01 -- common/autotest_common.sh@1187 -- # local i=0 00:06:41.379 11:31:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:41.379 11:31:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:41.379 11:31:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:43.909 11:31:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:43.909 11:31:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:43.909 11:31:03 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:43.909 11:31:03 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:43.909 11:31:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:43.909 11:31:03 -- common/autotest_common.sh@1197 -- # return 0 00:06:43.909 11:31:03 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:43.909 11:31:03 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:43.909 11:31:03 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:43.909 11:31:03 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:43.909 11:31:03 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:43.909 11:31:03 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:43.909 11:31:03 -- setup/common.sh@80 -- # echo 536870912 00:06:43.909 11:31:03 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:43.909 11:31:03 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:43.909 11:31:03 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:43.909 11:31:03 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:43.909 11:31:03 -- target/filesystem.sh@69 -- # partprobe 00:06:44.166 11:31:04 -- target/filesystem.sh@70 -- # sleep 1 00:06:45.539 11:31:05 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:06:45.539 11:31:05 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:45.539 11:31:05 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:45.539 11:31:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.539 11:31:05 -- common/autotest_common.sh@10 -- # set +x 00:06:45.539 ************************************ 00:06:45.539 START TEST filesystem_in_capsule_ext4 00:06:45.539 ************************************ 00:06:45.539 11:31:05 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:45.539 11:31:05 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:45.539 11:31:05 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:45.539 11:31:05 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:45.539 11:31:05 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:45.539 11:31:05 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:45.539 11:31:05 -- common/autotest_common.sh@914 -- # local i=0 00:06:45.539 11:31:05 -- common/autotest_common.sh@915 -- # local force 00:06:45.539 11:31:05 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:45.539 11:31:05 -- common/autotest_common.sh@918 -- # force=-F 00:06:45.539 11:31:05 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:45.539 mke2fs 1.47.0 (5-Feb-2023) 00:06:45.539 Discarding device blocks: 0/522240 done 00:06:45.539 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:45.539 Filesystem UUID: 492d9612-2599-48f5-a4f8-1b428a429110 00:06:45.539 Superblock backups stored on blocks: 00:06:45.539 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:45.539 00:06:45.539 Allocating group tables: 0/64 done 00:06:45.539 Writing inode tables: 0/64 done 00:06:47.436 Creating journal (8192 blocks): done 00:06:49.889 Writing superblocks and filesystem accounting information: 0/64 2/64 done 00:06:49.889 00:06:49.889 11:31:09 -- common/autotest_common.sh@931 -- # return 0 00:06:49.889 11:31:09 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:56.444 11:31:15 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:56.444 11:31:15 -- target/filesystem.sh@25 -- # sync 00:06:56.444 11:31:15 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:56.444 11:31:15 -- target/filesystem.sh@27 -- # sync 00:06:56.444 11:31:15 -- target/filesystem.sh@29 -- # i=0 00:06:56.444 11:31:15 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:56.444 11:31:15 -- target/filesystem.sh@37 -- # kill -0 3709657 00:06:56.444 11:31:15 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:56.444 11:31:15 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:56.444 11:31:15 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:56.444 11:31:15 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:56.444 00:06:56.444 real 0m10.319s 00:06:56.444 user 0m0.014s 00:06:56.444 sys 0m0.077s 00:06:56.444 11:31:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.444 11:31:15 -- common/autotest_common.sh@10 -- # set +x 00:06:56.444 ************************************ 00:06:56.444 END TEST filesystem_in_capsule_ext4 00:06:56.444 ************************************ 00:06:56.444 11:31:15 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:56.444 11:31:15 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:56.444 11:31:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.444 11:31:15 -- common/autotest_common.sh@10 -- # set +x 00:06:56.444 ************************************ 00:06:56.444 START TEST filesystem_in_capsule_btrfs 00:06:56.444 ************************************ 00:06:56.444 11:31:15 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:56.444 11:31:15 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:56.444 11:31:15 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:56.444 11:31:15 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:56.444 11:31:15 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:06:56.444 11:31:15 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:56.444 11:31:15 -- common/autotest_common.sh@914 -- # local i=0 00:06:56.444 11:31:15 -- common/autotest_common.sh@915 -- # local force 00:06:56.444 11:31:15 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:06:56.444 11:31:15 -- common/autotest_common.sh@920 -- # force=-f 00:06:56.444 11:31:15 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:56.444 btrfs-progs v6.8.1 00:06:56.444 See https://btrfs.readthedocs.io for more information. 00:06:56.444 00:06:56.444 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:56.444 NOTE: several default settings have changed in version 5.15, please make sure 00:06:56.444 this does not affect your deployments: 00:06:56.444 - DUP for metadata (-m dup) 00:06:56.444 - enabled no-holes (-O no-holes) 00:06:56.444 - enabled free-space-tree (-R free-space-tree) 00:06:56.444 00:06:56.444 Label: (null) 00:06:56.444 UUID: 12058c35-32fc-4967-bfad-77c75e804493 00:06:56.444 Node size: 16384 00:06:56.444 Sector size: 4096 (CPU page size: 4096) 00:06:56.444 Filesystem size: 510.00MiB 00:06:56.444 Block group profiles: 00:06:56.444 Data: single 8.00MiB 00:06:56.444 Metadata: DUP 32.00MiB 00:06:56.444 System: DUP 8.00MiB 00:06:56.444 SSD detected: yes 00:06:56.444 Zoned device: no 00:06:56.444 Features: extref, skinny-metadata, no-holes, free-space-tree 00:06:56.444 Checksum: crc32c 00:06:56.444 Number of devices: 1 00:06:56.444 Devices: 00:06:56.444 ID SIZE PATH 00:06:56.444 1 510.00MiB /dev/nvme0n1p1 00:06:56.444 00:06:56.444 11:31:15 -- common/autotest_common.sh@931 -- # return 0 00:06:56.444 11:31:15 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:56.444 11:31:16 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:56.444 11:31:16 -- target/filesystem.sh@25 -- # sync 00:06:56.444 11:31:16 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:56.444 11:31:16 -- target/filesystem.sh@27 -- # sync 00:06:56.444 11:31:16 -- target/filesystem.sh@29 -- # i=0 00:06:56.444 11:31:16 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:56.444 11:31:16 -- target/filesystem.sh@37 -- # kill -0 3709657 00:06:56.444 11:31:16 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:56.444 11:31:16 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:56.444 11:31:16 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:56.444 11:31:16 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:56.444 00:06:56.444 real 0m0.834s 00:06:56.444 user 0m0.016s 00:06:56.444 sys 0m0.102s 00:06:56.444 11:31:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.444 11:31:16 -- common/autotest_common.sh@10 -- # set +x 00:06:56.444 ************************************ 00:06:56.444 END TEST filesystem_in_capsule_btrfs 00:06:56.444 ************************************ 00:06:56.444 11:31:16 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:06:56.444 11:31:16 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:56.444 11:31:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.444 11:31:16 -- common/autotest_common.sh@10 -- # set +x 00:06:56.444 ************************************ 00:06:56.444 START TEST filesystem_in_capsule_xfs 00:06:56.444 ************************************ 00:06:56.444 11:31:16 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:06:56.444 11:31:16 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:56.444 11:31:16 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:56.444 11:31:16 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:56.444 11:31:16 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:06:56.444 11:31:16 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:56.444 11:31:16 -- common/autotest_common.sh@914 -- # local i=0 00:06:56.444 11:31:16 -- common/autotest_common.sh@915 -- # local force 00:06:56.444 11:31:16 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:06:56.444 11:31:16 -- common/autotest_common.sh@920 -- # force=-f 00:06:56.444 11:31:16 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:56.444 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:56.444 = sectsz=512 attr=2, projid32bit=1 00:06:56.444 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:56.444 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:56.444 data = bsize=4096 blocks=130560, imaxpct=25 00:06:56.444 = sunit=0 swidth=0 blks 00:06:56.444 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:56.444 log =internal log bsize=4096 blocks=16384, version=2 00:06:56.444 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:56.444 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:57.379 Discarding blocks...Done. 00:06:57.379 11:31:17 -- common/autotest_common.sh@931 -- # return 0 00:06:57.379 11:31:17 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:59.907 11:31:19 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:59.907 11:31:19 -- target/filesystem.sh@25 -- # sync 00:06:59.907 11:31:19 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:59.907 11:31:19 -- target/filesystem.sh@27 -- # sync 00:06:59.907 11:31:19 -- target/filesystem.sh@29 -- # i=0 00:06:59.907 11:31:19 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:59.907 11:31:19 -- target/filesystem.sh@37 -- # kill -0 3709657 00:06:59.907 11:31:19 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:59.907 11:31:19 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:59.907 11:31:19 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:59.907 11:31:19 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:59.907 00:06:59.907 real 0m3.539s 00:06:59.907 user 0m0.014s 00:06:59.907 sys 0m0.067s 00:06:59.907 11:31:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:59.907 11:31:19 -- common/autotest_common.sh@10 -- # set +x 00:06:59.908 ************************************ 00:06:59.908 END TEST filesystem_in_capsule_xfs 00:06:59.908 ************************************ 00:06:59.908 11:31:19 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:00.166 11:31:19 -- target/filesystem.sh@93 -- # sync 00:07:00.166 11:31:19 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:00.166 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:00.166 11:31:20 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:00.166 11:31:20 -- common/autotest_common.sh@1208 -- # local i=0 00:07:00.166 11:31:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:00.166 11:31:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:00.166 11:31:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:00.166 11:31:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:00.166 11:31:20 -- common/autotest_common.sh@1220 -- # return 0 00:07:00.166 11:31:20 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:00.166 11:31:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:00.166 11:31:20 -- common/autotest_common.sh@10 -- # set +x 00:07:00.166 11:31:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:00.166 11:31:20 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:00.166 11:31:20 -- target/filesystem.sh@101 -- # killprocess 3709657 00:07:00.166 11:31:20 -- common/autotest_common.sh@936 -- # '[' -z 3709657 ']' 00:07:00.166 11:31:20 -- common/autotest_common.sh@940 -- # kill -0 3709657 00:07:00.166 11:31:20 -- common/autotest_common.sh@941 -- # uname 00:07:00.166 11:31:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:00.166 11:31:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3709657 00:07:00.166 11:31:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:00.166 11:31:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:00.166 11:31:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3709657' 00:07:00.166 killing process with pid 3709657 00:07:00.166 11:31:20 -- common/autotest_common.sh@955 -- # kill 3709657 00:07:00.166 11:31:20 -- common/autotest_common.sh@960 -- # wait 3709657 00:07:00.788 11:31:20 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:00.788 00:07:00.788 real 0m21.249s 00:07:00.788 user 1m22.142s 00:07:00.788 sys 0m2.612s 00:07:00.788 11:31:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:00.788 11:31:20 -- common/autotest_common.sh@10 -- # set +x 00:07:00.788 ************************************ 00:07:00.788 END TEST nvmf_filesystem_in_capsule 00:07:00.788 ************************************ 00:07:00.788 11:31:20 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:00.788 11:31:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:00.788 11:31:20 -- nvmf/common.sh@116 -- # sync 00:07:00.788 11:31:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:00.788 11:31:20 -- nvmf/common.sh@119 -- # set +e 00:07:00.788 11:31:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:00.788 11:31:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:00.788 rmmod nvme_tcp 00:07:00.788 rmmod nvme_fabrics 00:07:00.788 rmmod nvme_keyring 00:07:00.788 11:31:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:00.788 11:31:20 -- nvmf/common.sh@123 -- # set -e 00:07:00.788 11:31:20 -- nvmf/common.sh@124 -- # return 0 00:07:00.788 11:31:20 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:00.788 11:31:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:00.788 11:31:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:00.788 11:31:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:00.788 11:31:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:00.788 11:31:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:00.788 11:31:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:00.788 11:31:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:00.788 11:31:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:03.327 11:31:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:03.327 00:07:03.327 real 0m46.153s 00:07:03.327 user 2m41.051s 00:07:03.327 sys 0m6.659s 00:07:03.327 11:31:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:03.327 11:31:22 -- common/autotest_common.sh@10 -- # set +x 00:07:03.327 ************************************ 00:07:03.327 END TEST nvmf_filesystem 00:07:03.327 ************************************ 00:07:03.327 11:31:22 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:03.327 11:31:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:03.327 11:31:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.327 11:31:22 -- common/autotest_common.sh@10 -- # set +x 00:07:03.327 ************************************ 00:07:03.327 START TEST nvmf_discovery 00:07:03.327 ************************************ 00:07:03.327 11:31:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:03.327 * Looking for test storage... 00:07:03.327 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:03.327 11:31:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:03.327 11:31:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:03.327 11:31:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:03.327 11:31:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:03.327 11:31:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:03.327 11:31:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:03.327 11:31:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:03.327 11:31:22 -- scripts/common.sh@335 -- # IFS=.-: 00:07:03.327 11:31:22 -- scripts/common.sh@335 -- # read -ra ver1 00:07:03.327 11:31:22 -- scripts/common.sh@336 -- # IFS=.-: 00:07:03.327 11:31:22 -- scripts/common.sh@336 -- # read -ra ver2 00:07:03.327 11:31:22 -- scripts/common.sh@337 -- # local 'op=<' 00:07:03.327 11:31:22 -- scripts/common.sh@339 -- # ver1_l=2 00:07:03.327 11:31:22 -- scripts/common.sh@340 -- # ver2_l=1 00:07:03.327 11:31:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:03.327 11:31:22 -- scripts/common.sh@343 -- # case "$op" in 00:07:03.327 11:31:22 -- scripts/common.sh@344 -- # : 1 00:07:03.327 11:31:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:03.327 11:31:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:03.327 11:31:22 -- scripts/common.sh@364 -- # decimal 1 00:07:03.327 11:31:22 -- scripts/common.sh@352 -- # local d=1 00:07:03.327 11:31:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:03.328 11:31:22 -- scripts/common.sh@354 -- # echo 1 00:07:03.328 11:31:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:03.328 11:31:22 -- scripts/common.sh@365 -- # decimal 2 00:07:03.328 11:31:22 -- scripts/common.sh@352 -- # local d=2 00:07:03.328 11:31:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:03.328 11:31:22 -- scripts/common.sh@354 -- # echo 2 00:07:03.328 11:31:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:03.328 11:31:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:03.328 11:31:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:03.328 11:31:22 -- scripts/common.sh@367 -- # return 0 00:07:03.328 11:31:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:03.328 11:31:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:03.328 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.328 --rc genhtml_branch_coverage=1 00:07:03.328 --rc genhtml_function_coverage=1 00:07:03.328 --rc genhtml_legend=1 00:07:03.328 --rc geninfo_all_blocks=1 00:07:03.328 --rc geninfo_unexecuted_blocks=1 00:07:03.328 00:07:03.328 ' 00:07:03.328 11:31:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:03.328 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.328 --rc genhtml_branch_coverage=1 00:07:03.328 --rc genhtml_function_coverage=1 00:07:03.328 --rc genhtml_legend=1 00:07:03.328 --rc geninfo_all_blocks=1 00:07:03.328 --rc geninfo_unexecuted_blocks=1 00:07:03.328 00:07:03.328 ' 00:07:03.328 11:31:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:03.328 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.328 --rc genhtml_branch_coverage=1 00:07:03.328 --rc genhtml_function_coverage=1 00:07:03.328 --rc genhtml_legend=1 00:07:03.328 --rc geninfo_all_blocks=1 00:07:03.328 --rc geninfo_unexecuted_blocks=1 00:07:03.328 00:07:03.328 ' 00:07:03.328 11:31:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:03.328 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.328 --rc genhtml_branch_coverage=1 00:07:03.328 --rc genhtml_function_coverage=1 00:07:03.328 --rc genhtml_legend=1 00:07:03.328 --rc geninfo_all_blocks=1 00:07:03.328 --rc geninfo_unexecuted_blocks=1 00:07:03.328 00:07:03.328 ' 00:07:03.328 11:31:22 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:03.328 11:31:22 -- nvmf/common.sh@7 -- # uname -s 00:07:03.328 11:31:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:03.328 11:31:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:03.328 11:31:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:03.328 11:31:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:03.328 11:31:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:03.328 11:31:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:03.328 11:31:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:03.328 11:31:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:03.328 11:31:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:03.328 11:31:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:03.328 11:31:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:03.328 11:31:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:03.328 11:31:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:03.328 11:31:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:03.328 11:31:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:03.328 11:31:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:03.328 11:31:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:03.328 11:31:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:03.328 11:31:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:03.328 11:31:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.328 11:31:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.328 11:31:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.328 11:31:22 -- paths/export.sh@5 -- # export PATH 00:07:03.328 11:31:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.328 11:31:22 -- nvmf/common.sh@46 -- # : 0 00:07:03.328 11:31:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:03.328 11:31:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:03.328 11:31:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:03.328 11:31:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:03.328 11:31:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:03.328 11:31:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:03.328 11:31:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:03.328 11:31:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:03.328 11:31:22 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:03.328 11:31:22 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:03.328 11:31:22 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:03.328 11:31:22 -- target/discovery.sh@15 -- # hash nvme 00:07:03.328 11:31:22 -- target/discovery.sh@20 -- # nvmftestinit 00:07:03.328 11:31:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:03.328 11:31:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:03.328 11:31:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:03.328 11:31:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:03.328 11:31:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:03.328 11:31:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:03.328 11:31:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:03.328 11:31:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:03.328 11:31:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:03.328 11:31:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:03.328 11:31:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:03.328 11:31:22 -- common/autotest_common.sh@10 -- # set +x 00:07:05.231 11:31:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:05.231 11:31:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:05.231 11:31:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:05.231 11:31:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:05.231 11:31:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:05.231 11:31:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:05.231 11:31:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:05.231 11:31:25 -- nvmf/common.sh@294 -- # net_devs=() 00:07:05.231 11:31:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:05.231 11:31:25 -- nvmf/common.sh@295 -- # e810=() 00:07:05.231 11:31:25 -- nvmf/common.sh@295 -- # local -ga e810 00:07:05.231 11:31:25 -- nvmf/common.sh@296 -- # x722=() 00:07:05.231 11:31:25 -- nvmf/common.sh@296 -- # local -ga x722 00:07:05.231 11:31:25 -- nvmf/common.sh@297 -- # mlx=() 00:07:05.231 11:31:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:05.231 11:31:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:05.231 11:31:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:05.231 11:31:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:05.231 11:31:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:05.231 11:31:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:05.231 11:31:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:05.231 11:31:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:05.231 11:31:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:05.231 11:31:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:05.231 11:31:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:05.231 11:31:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:05.231 11:31:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:05.231 11:31:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:05.231 11:31:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:05.231 11:31:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:05.231 11:31:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:05.231 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:05.231 11:31:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:05.231 11:31:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:05.231 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:05.231 11:31:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:05.231 11:31:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:05.231 11:31:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:05.231 11:31:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:05.231 11:31:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:05.231 11:31:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:05.231 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:05.231 11:31:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:05.231 11:31:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:05.231 11:31:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:05.231 11:31:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:05.231 11:31:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:05.231 11:31:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:05.231 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:05.231 11:31:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:05.231 11:31:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:05.231 11:31:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:05.231 11:31:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:05.231 11:31:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:05.231 11:31:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:05.231 11:31:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:05.231 11:31:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:05.231 11:31:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:05.231 11:31:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:05.231 11:31:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:05.231 11:31:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:05.231 11:31:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:05.231 11:31:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:05.231 11:31:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:05.231 11:31:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:05.231 11:31:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:05.231 11:31:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:05.231 11:31:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:05.231 11:31:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:05.231 11:31:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:05.231 11:31:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:05.231 11:31:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:05.231 11:31:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:05.231 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:05.231 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:07:05.231 00:07:05.231 --- 10.0.0.2 ping statistics --- 00:07:05.231 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:05.231 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:07:05.231 11:31:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:05.231 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:05.231 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:07:05.231 00:07:05.231 --- 10.0.0.1 ping statistics --- 00:07:05.231 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:05.231 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:07:05.231 11:31:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:05.231 11:31:25 -- nvmf/common.sh@410 -- # return 0 00:07:05.231 11:31:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:05.231 11:31:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:05.231 11:31:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:05.231 11:31:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:05.231 11:31:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:05.231 11:31:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:05.231 11:31:25 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:05.231 11:31:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:05.231 11:31:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:05.231 11:31:25 -- common/autotest_common.sh@10 -- # set +x 00:07:05.231 11:31:25 -- nvmf/common.sh@469 -- # nvmfpid=3714351 00:07:05.231 11:31:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:05.231 11:31:25 -- nvmf/common.sh@470 -- # waitforlisten 3714351 00:07:05.231 11:31:25 -- common/autotest_common.sh@829 -- # '[' -z 3714351 ']' 00:07:05.231 11:31:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:05.231 11:31:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:05.231 11:31:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:05.231 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:05.231 11:31:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:05.231 11:31:25 -- common/autotest_common.sh@10 -- # set +x 00:07:05.231 [2024-11-28 11:31:25.229769] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:05.231 [2024-11-28 11:31:25.229864] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:05.231 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.488 [2024-11-28 11:31:25.298413] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:05.488 [2024-11-28 11:31:25.416670] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:05.488 [2024-11-28 11:31:25.416841] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:05.488 [2024-11-28 11:31:25.416862] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:05.488 [2024-11-28 11:31:25.416875] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:05.488 [2024-11-28 11:31:25.416939] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:05.488 [2024-11-28 11:31:25.417006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:05.488 [2024-11-28 11:31:25.417058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:05.488 [2024-11-28 11:31:25.417061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.421 11:31:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:06.421 11:31:26 -- common/autotest_common.sh@862 -- # return 0 00:07:06.421 11:31:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:06.421 11:31:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 11:31:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:06.421 11:31:26 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 [2024-11-28 11:31:26.267226] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@26 -- # seq 1 4 00:07:06.421 11:31:26 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:06.421 11:31:26 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 Null1 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 [2024-11-28 11:31:26.307553] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:06.421 11:31:26 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 Null2 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:06.421 11:31:26 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 Null3 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:06.421 11:31:26 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 Null4 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:06.421 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.421 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.421 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.421 11:31:26 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:06.678 00:07:06.678 Discovery Log Number of Records 6, Generation counter 6 00:07:06.678 =====Discovery Log Entry 0====== 00:07:06.678 trtype: tcp 00:07:06.678 adrfam: ipv4 00:07:06.678 subtype: current discovery subsystem 00:07:06.678 treq: not required 00:07:06.678 portid: 0 00:07:06.678 trsvcid: 4420 00:07:06.678 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:06.678 traddr: 10.0.0.2 00:07:06.678 eflags: explicit discovery connections, duplicate discovery information 00:07:06.678 sectype: none 00:07:06.678 =====Discovery Log Entry 1====== 00:07:06.678 trtype: tcp 00:07:06.678 adrfam: ipv4 00:07:06.678 subtype: nvme subsystem 00:07:06.678 treq: not required 00:07:06.678 portid: 0 00:07:06.678 trsvcid: 4420 00:07:06.678 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:06.678 traddr: 10.0.0.2 00:07:06.678 eflags: none 00:07:06.678 sectype: none 00:07:06.678 =====Discovery Log Entry 2====== 00:07:06.678 trtype: tcp 00:07:06.678 adrfam: ipv4 00:07:06.678 subtype: nvme subsystem 00:07:06.678 treq: not required 00:07:06.678 portid: 0 00:07:06.678 trsvcid: 4420 00:07:06.678 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:06.678 traddr: 10.0.0.2 00:07:06.678 eflags: none 00:07:06.678 sectype: none 00:07:06.678 =====Discovery Log Entry 3====== 00:07:06.678 trtype: tcp 00:07:06.678 adrfam: ipv4 00:07:06.678 subtype: nvme subsystem 00:07:06.678 treq: not required 00:07:06.678 portid: 0 00:07:06.678 trsvcid: 4420 00:07:06.678 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:06.678 traddr: 10.0.0.2 00:07:06.678 eflags: none 00:07:06.678 sectype: none 00:07:06.678 =====Discovery Log Entry 4====== 00:07:06.678 trtype: tcp 00:07:06.678 adrfam: ipv4 00:07:06.678 subtype: nvme subsystem 00:07:06.678 treq: not required 00:07:06.678 portid: 0 00:07:06.678 trsvcid: 4420 00:07:06.678 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:06.678 traddr: 10.0.0.2 00:07:06.678 eflags: none 00:07:06.678 sectype: none 00:07:06.678 =====Discovery Log Entry 5====== 00:07:06.678 trtype: tcp 00:07:06.678 adrfam: ipv4 00:07:06.678 subtype: discovery subsystem referral 00:07:06.678 treq: not required 00:07:06.678 portid: 0 00:07:06.678 trsvcid: 4430 00:07:06.678 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:06.678 traddr: 10.0.0.2 00:07:06.678 eflags: none 00:07:06.678 sectype: none 00:07:06.678 11:31:26 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:06.678 Perform nvmf subsystem discovery via RPC 00:07:06.678 11:31:26 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:06.678 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.678 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.678 [2024-11-28 11:31:26.652467] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:06.678 [ 00:07:06.678 { 00:07:06.678 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:06.678 "subtype": "Discovery", 00:07:06.678 "listen_addresses": [ 00:07:06.678 { 00:07:06.678 "transport": "TCP", 00:07:06.678 "trtype": "TCP", 00:07:06.678 "adrfam": "IPv4", 00:07:06.678 "traddr": "10.0.0.2", 00:07:06.678 "trsvcid": "4420" 00:07:06.678 } 00:07:06.678 ], 00:07:06.678 "allow_any_host": true, 00:07:06.678 "hosts": [] 00:07:06.678 }, 00:07:06.678 { 00:07:06.678 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:06.678 "subtype": "NVMe", 00:07:06.678 "listen_addresses": [ 00:07:06.678 { 00:07:06.678 "transport": "TCP", 00:07:06.678 "trtype": "TCP", 00:07:06.678 "adrfam": "IPv4", 00:07:06.678 "traddr": "10.0.0.2", 00:07:06.678 "trsvcid": "4420" 00:07:06.678 } 00:07:06.678 ], 00:07:06.678 "allow_any_host": true, 00:07:06.678 "hosts": [], 00:07:06.678 "serial_number": "SPDK00000000000001", 00:07:06.678 "model_number": "SPDK bdev Controller", 00:07:06.678 "max_namespaces": 32, 00:07:06.678 "min_cntlid": 1, 00:07:06.678 "max_cntlid": 65519, 00:07:06.678 "namespaces": [ 00:07:06.678 { 00:07:06.678 "nsid": 1, 00:07:06.678 "bdev_name": "Null1", 00:07:06.678 "name": "Null1", 00:07:06.678 "nguid": "AAB5027D9C394E13B66C3B2FCFD06507", 00:07:06.678 "uuid": "aab5027d-9c39-4e13-b66c-3b2fcfd06507" 00:07:06.678 } 00:07:06.678 ] 00:07:06.678 }, 00:07:06.678 { 00:07:06.678 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:06.678 "subtype": "NVMe", 00:07:06.678 "listen_addresses": [ 00:07:06.679 { 00:07:06.679 "transport": "TCP", 00:07:06.679 "trtype": "TCP", 00:07:06.679 "adrfam": "IPv4", 00:07:06.679 "traddr": "10.0.0.2", 00:07:06.679 "trsvcid": "4420" 00:07:06.679 } 00:07:06.679 ], 00:07:06.679 "allow_any_host": true, 00:07:06.679 "hosts": [], 00:07:06.679 "serial_number": "SPDK00000000000002", 00:07:06.679 "model_number": "SPDK bdev Controller", 00:07:06.679 "max_namespaces": 32, 00:07:06.679 "min_cntlid": 1, 00:07:06.679 "max_cntlid": 65519, 00:07:06.679 "namespaces": [ 00:07:06.679 { 00:07:06.679 "nsid": 1, 00:07:06.679 "bdev_name": "Null2", 00:07:06.679 "name": "Null2", 00:07:06.679 "nguid": "CFD53782FC7C470E94E5A20073818577", 00:07:06.679 "uuid": "cfd53782-fc7c-470e-94e5-a20073818577" 00:07:06.679 } 00:07:06.679 ] 00:07:06.679 }, 00:07:06.679 { 00:07:06.679 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:06.679 "subtype": "NVMe", 00:07:06.679 "listen_addresses": [ 00:07:06.679 { 00:07:06.679 "transport": "TCP", 00:07:06.679 "trtype": "TCP", 00:07:06.679 "adrfam": "IPv4", 00:07:06.679 "traddr": "10.0.0.2", 00:07:06.679 "trsvcid": "4420" 00:07:06.679 } 00:07:06.679 ], 00:07:06.679 "allow_any_host": true, 00:07:06.679 "hosts": [], 00:07:06.679 "serial_number": "SPDK00000000000003", 00:07:06.679 "model_number": "SPDK bdev Controller", 00:07:06.679 "max_namespaces": 32, 00:07:06.679 "min_cntlid": 1, 00:07:06.679 "max_cntlid": 65519, 00:07:06.679 "namespaces": [ 00:07:06.679 { 00:07:06.679 "nsid": 1, 00:07:06.679 "bdev_name": "Null3", 00:07:06.679 "name": "Null3", 00:07:06.679 "nguid": "39520A7FC88F40A1A281FBF62DB39CC7", 00:07:06.679 "uuid": "39520a7f-c88f-40a1-a281-fbf62db39cc7" 00:07:06.679 } 00:07:06.679 ] 00:07:06.679 }, 00:07:06.679 { 00:07:06.679 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:06.679 "subtype": "NVMe", 00:07:06.679 "listen_addresses": [ 00:07:06.679 { 00:07:06.679 "transport": "TCP", 00:07:06.679 "trtype": "TCP", 00:07:06.679 "adrfam": "IPv4", 00:07:06.679 "traddr": "10.0.0.2", 00:07:06.679 "trsvcid": "4420" 00:07:06.679 } 00:07:06.679 ], 00:07:06.679 "allow_any_host": true, 00:07:06.679 "hosts": [], 00:07:06.679 "serial_number": "SPDK00000000000004", 00:07:06.679 "model_number": "SPDK bdev Controller", 00:07:06.679 "max_namespaces": 32, 00:07:06.679 "min_cntlid": 1, 00:07:06.679 "max_cntlid": 65519, 00:07:06.679 "namespaces": [ 00:07:06.679 { 00:07:06.679 "nsid": 1, 00:07:06.679 "bdev_name": "Null4", 00:07:06.679 "name": "Null4", 00:07:06.679 "nguid": "07C5966051454D1ABA0AEA709958D406", 00:07:06.679 "uuid": "07c59660-5145-4d1a-ba0a-ea709958d406" 00:07:06.679 } 00:07:06.679 ] 00:07:06.679 } 00:07:06.679 ] 00:07:06.679 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.679 11:31:26 -- target/discovery.sh@42 -- # seq 1 4 00:07:06.679 11:31:26 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:06.679 11:31:26 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:06.679 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.679 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.679 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.679 11:31:26 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:06.679 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.679 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.679 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.679 11:31:26 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:06.679 11:31:26 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:06.679 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.679 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.679 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.679 11:31:26 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:06.679 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.679 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.679 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.679 11:31:26 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:06.679 11:31:26 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:06.679 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.679 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.679 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.679 11:31:26 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:06.679 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.679 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.679 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.679 11:31:26 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:06.679 11:31:26 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:06.679 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.679 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.679 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.679 11:31:26 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:06.679 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.679 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.679 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.679 11:31:26 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:06.679 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.936 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.936 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.936 11:31:26 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:06.936 11:31:26 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:06.936 11:31:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.936 11:31:26 -- common/autotest_common.sh@10 -- # set +x 00:07:06.936 11:31:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.936 11:31:26 -- target/discovery.sh@49 -- # check_bdevs= 00:07:06.936 11:31:26 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:06.936 11:31:26 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:06.936 11:31:26 -- target/discovery.sh@57 -- # nvmftestfini 00:07:06.936 11:31:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:06.936 11:31:26 -- nvmf/common.sh@116 -- # sync 00:07:06.936 11:31:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:06.936 11:31:26 -- nvmf/common.sh@119 -- # set +e 00:07:06.936 11:31:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:06.936 11:31:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:06.936 rmmod nvme_tcp 00:07:06.936 rmmod nvme_fabrics 00:07:06.936 rmmod nvme_keyring 00:07:06.936 11:31:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:06.936 11:31:26 -- nvmf/common.sh@123 -- # set -e 00:07:06.936 11:31:26 -- nvmf/common.sh@124 -- # return 0 00:07:06.936 11:31:26 -- nvmf/common.sh@477 -- # '[' -n 3714351 ']' 00:07:06.936 11:31:26 -- nvmf/common.sh@478 -- # killprocess 3714351 00:07:06.936 11:31:26 -- common/autotest_common.sh@936 -- # '[' -z 3714351 ']' 00:07:06.936 11:31:26 -- common/autotest_common.sh@940 -- # kill -0 3714351 00:07:06.936 11:31:26 -- common/autotest_common.sh@941 -- # uname 00:07:06.936 11:31:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:06.936 11:31:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3714351 00:07:06.936 11:31:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:06.936 11:31:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:06.936 11:31:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3714351' 00:07:06.936 killing process with pid 3714351 00:07:06.936 11:31:26 -- common/autotest_common.sh@955 -- # kill 3714351 00:07:06.936 [2024-11-28 11:31:26.867800] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:06.936 11:31:26 -- common/autotest_common.sh@960 -- # wait 3714351 00:07:07.193 11:31:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:07.193 11:31:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:07.193 11:31:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:07.193 11:31:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:07.193 11:31:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:07.193 11:31:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:07.193 11:31:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:07.193 11:31:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:09.724 11:31:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:09.724 00:07:09.724 real 0m6.395s 00:07:09.724 user 0m7.895s 00:07:09.724 sys 0m1.940s 00:07:09.724 11:31:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:09.724 11:31:29 -- common/autotest_common.sh@10 -- # set +x 00:07:09.724 ************************************ 00:07:09.724 END TEST nvmf_discovery 00:07:09.724 ************************************ 00:07:09.724 11:31:29 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:09.724 11:31:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:09.724 11:31:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:09.724 11:31:29 -- common/autotest_common.sh@10 -- # set +x 00:07:09.724 ************************************ 00:07:09.724 START TEST nvmf_referrals 00:07:09.724 ************************************ 00:07:09.724 11:31:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:09.724 * Looking for test storage... 00:07:09.724 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:09.724 11:31:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:09.724 11:31:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:09.724 11:31:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:09.724 11:31:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:09.724 11:31:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:09.724 11:31:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:09.724 11:31:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:09.724 11:31:29 -- scripts/common.sh@335 -- # IFS=.-: 00:07:09.724 11:31:29 -- scripts/common.sh@335 -- # read -ra ver1 00:07:09.724 11:31:29 -- scripts/common.sh@336 -- # IFS=.-: 00:07:09.724 11:31:29 -- scripts/common.sh@336 -- # read -ra ver2 00:07:09.724 11:31:29 -- scripts/common.sh@337 -- # local 'op=<' 00:07:09.724 11:31:29 -- scripts/common.sh@339 -- # ver1_l=2 00:07:09.724 11:31:29 -- scripts/common.sh@340 -- # ver2_l=1 00:07:09.724 11:31:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:09.724 11:31:29 -- scripts/common.sh@343 -- # case "$op" in 00:07:09.724 11:31:29 -- scripts/common.sh@344 -- # : 1 00:07:09.724 11:31:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:09.724 11:31:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:09.724 11:31:29 -- scripts/common.sh@364 -- # decimal 1 00:07:09.724 11:31:29 -- scripts/common.sh@352 -- # local d=1 00:07:09.724 11:31:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:09.724 11:31:29 -- scripts/common.sh@354 -- # echo 1 00:07:09.724 11:31:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:09.724 11:31:29 -- scripts/common.sh@365 -- # decimal 2 00:07:09.724 11:31:29 -- scripts/common.sh@352 -- # local d=2 00:07:09.724 11:31:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:09.724 11:31:29 -- scripts/common.sh@354 -- # echo 2 00:07:09.724 11:31:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:09.724 11:31:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:09.724 11:31:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:09.724 11:31:29 -- scripts/common.sh@367 -- # return 0 00:07:09.724 11:31:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:09.724 11:31:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:09.724 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:09.724 --rc genhtml_branch_coverage=1 00:07:09.724 --rc genhtml_function_coverage=1 00:07:09.724 --rc genhtml_legend=1 00:07:09.724 --rc geninfo_all_blocks=1 00:07:09.724 --rc geninfo_unexecuted_blocks=1 00:07:09.724 00:07:09.724 ' 00:07:09.724 11:31:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:09.724 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:09.724 --rc genhtml_branch_coverage=1 00:07:09.724 --rc genhtml_function_coverage=1 00:07:09.724 --rc genhtml_legend=1 00:07:09.724 --rc geninfo_all_blocks=1 00:07:09.724 --rc geninfo_unexecuted_blocks=1 00:07:09.724 00:07:09.724 ' 00:07:09.724 11:31:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:09.724 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:09.724 --rc genhtml_branch_coverage=1 00:07:09.724 --rc genhtml_function_coverage=1 00:07:09.724 --rc genhtml_legend=1 00:07:09.724 --rc geninfo_all_blocks=1 00:07:09.724 --rc geninfo_unexecuted_blocks=1 00:07:09.724 00:07:09.724 ' 00:07:09.724 11:31:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:09.724 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:09.724 --rc genhtml_branch_coverage=1 00:07:09.724 --rc genhtml_function_coverage=1 00:07:09.724 --rc genhtml_legend=1 00:07:09.724 --rc geninfo_all_blocks=1 00:07:09.724 --rc geninfo_unexecuted_blocks=1 00:07:09.724 00:07:09.724 ' 00:07:09.724 11:31:29 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:09.724 11:31:29 -- nvmf/common.sh@7 -- # uname -s 00:07:09.724 11:31:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:09.724 11:31:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:09.724 11:31:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:09.724 11:31:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:09.724 11:31:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:09.724 11:31:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:09.724 11:31:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:09.724 11:31:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:09.724 11:31:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:09.724 11:31:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:09.724 11:31:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:09.724 11:31:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:09.724 11:31:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:09.724 11:31:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:09.724 11:31:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:09.724 11:31:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:09.724 11:31:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:09.724 11:31:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:09.724 11:31:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:09.724 11:31:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:09.724 11:31:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:09.724 11:31:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:09.724 11:31:29 -- paths/export.sh@5 -- # export PATH 00:07:09.724 11:31:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:09.724 11:31:29 -- nvmf/common.sh@46 -- # : 0 00:07:09.724 11:31:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:09.724 11:31:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:09.724 11:31:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:09.724 11:31:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:09.724 11:31:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:09.724 11:31:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:09.724 11:31:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:09.724 11:31:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:09.724 11:31:29 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:09.724 11:31:29 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:09.724 11:31:29 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:09.724 11:31:29 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:09.724 11:31:29 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:09.724 11:31:29 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:09.724 11:31:29 -- target/referrals.sh@37 -- # nvmftestinit 00:07:09.724 11:31:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:09.724 11:31:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:09.724 11:31:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:09.724 11:31:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:09.724 11:31:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:09.724 11:31:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:09.724 11:31:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:09.724 11:31:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:09.724 11:31:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:09.724 11:31:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:09.724 11:31:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:09.724 11:31:29 -- common/autotest_common.sh@10 -- # set +x 00:07:11.624 11:31:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:11.624 11:31:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:11.624 11:31:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:11.624 11:31:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:11.624 11:31:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:11.624 11:31:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:11.624 11:31:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:11.624 11:31:31 -- nvmf/common.sh@294 -- # net_devs=() 00:07:11.624 11:31:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:11.624 11:31:31 -- nvmf/common.sh@295 -- # e810=() 00:07:11.624 11:31:31 -- nvmf/common.sh@295 -- # local -ga e810 00:07:11.624 11:31:31 -- nvmf/common.sh@296 -- # x722=() 00:07:11.624 11:31:31 -- nvmf/common.sh@296 -- # local -ga x722 00:07:11.624 11:31:31 -- nvmf/common.sh@297 -- # mlx=() 00:07:11.624 11:31:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:11.624 11:31:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:11.624 11:31:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:11.624 11:31:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:11.624 11:31:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:11.624 11:31:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:11.624 11:31:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:11.624 11:31:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:11.624 11:31:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:11.624 11:31:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:11.624 11:31:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:11.624 11:31:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:11.624 11:31:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:11.624 11:31:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:11.624 11:31:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:11.624 11:31:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:11.624 11:31:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:11.624 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:11.624 11:31:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:11.624 11:31:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:11.624 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:11.624 11:31:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:11.624 11:31:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:11.624 11:31:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:11.624 11:31:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:11.624 11:31:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:11.624 11:31:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:11.624 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:11.624 11:31:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:11.624 11:31:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:11.624 11:31:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:11.624 11:31:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:11.624 11:31:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:11.624 11:31:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:11.624 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:11.624 11:31:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:11.624 11:31:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:11.624 11:31:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:11.624 11:31:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:11.624 11:31:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:11.624 11:31:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:11.624 11:31:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:11.624 11:31:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:11.624 11:31:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:11.624 11:31:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:11.624 11:31:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:11.624 11:31:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:11.624 11:31:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:11.624 11:31:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:11.624 11:31:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:11.624 11:31:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:11.624 11:31:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:11.624 11:31:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:11.624 11:31:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:11.624 11:31:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:11.624 11:31:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:11.624 11:31:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:11.624 11:31:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:11.624 11:31:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:11.624 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:11.624 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:07:11.624 00:07:11.624 --- 10.0.0.2 ping statistics --- 00:07:11.624 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:11.624 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:07:11.624 11:31:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:11.624 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:11.624 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:07:11.624 00:07:11.624 --- 10.0.0.1 ping statistics --- 00:07:11.624 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:11.624 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:07:11.624 11:31:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:11.624 11:31:31 -- nvmf/common.sh@410 -- # return 0 00:07:11.624 11:31:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:11.624 11:31:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:11.624 11:31:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:11.624 11:31:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:11.624 11:31:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:11.624 11:31:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:11.624 11:31:31 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:11.624 11:31:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:11.624 11:31:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:11.624 11:31:31 -- common/autotest_common.sh@10 -- # set +x 00:07:11.624 11:31:31 -- nvmf/common.sh@469 -- # nvmfpid=3716572 00:07:11.624 11:31:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:11.624 11:31:31 -- nvmf/common.sh@470 -- # waitforlisten 3716572 00:07:11.624 11:31:31 -- common/autotest_common.sh@829 -- # '[' -z 3716572 ']' 00:07:11.624 11:31:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:11.624 11:31:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:11.624 11:31:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:11.624 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:11.624 11:31:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:11.624 11:31:31 -- common/autotest_common.sh@10 -- # set +x 00:07:11.624 [2024-11-28 11:31:31.664575] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:11.624 [2024-11-28 11:31:31.664641] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:11.882 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.882 [2024-11-28 11:31:31.732339] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:11.882 [2024-11-28 11:31:31.851369] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:11.882 [2024-11-28 11:31:31.851537] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:11.882 [2024-11-28 11:31:31.851558] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:11.882 [2024-11-28 11:31:31.851572] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:11.882 [2024-11-28 11:31:31.851641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:11.882 [2024-11-28 11:31:31.851706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:11.882 [2024-11-28 11:31:31.851761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:11.882 [2024-11-28 11:31:31.851765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.815 11:31:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:12.815 11:31:32 -- common/autotest_common.sh@862 -- # return 0 00:07:12.815 11:31:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:12.815 11:31:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:12.815 11:31:32 -- common/autotest_common.sh@10 -- # set +x 00:07:12.815 11:31:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:12.815 11:31:32 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:12.815 11:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:12.815 11:31:32 -- common/autotest_common.sh@10 -- # set +x 00:07:12.815 [2024-11-28 11:31:32.665034] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:12.815 11:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:12.815 11:31:32 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:12.815 11:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:12.815 11:31:32 -- common/autotest_common.sh@10 -- # set +x 00:07:12.815 [2024-11-28 11:31:32.677220] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:12.815 11:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:12.815 11:31:32 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:12.815 11:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:12.815 11:31:32 -- common/autotest_common.sh@10 -- # set +x 00:07:12.815 11:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:12.815 11:31:32 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:12.815 11:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:12.815 11:31:32 -- common/autotest_common.sh@10 -- # set +x 00:07:12.815 11:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:12.815 11:31:32 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:12.815 11:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:12.815 11:31:32 -- common/autotest_common.sh@10 -- # set +x 00:07:12.815 11:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:12.815 11:31:32 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:12.815 11:31:32 -- target/referrals.sh@48 -- # jq length 00:07:12.815 11:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:12.815 11:31:32 -- common/autotest_common.sh@10 -- # set +x 00:07:12.815 11:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:12.815 11:31:32 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:12.815 11:31:32 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:12.815 11:31:32 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:12.815 11:31:32 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:12.815 11:31:32 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:12.815 11:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:12.815 11:31:32 -- common/autotest_common.sh@10 -- # set +x 00:07:12.815 11:31:32 -- target/referrals.sh@21 -- # sort 00:07:12.815 11:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:12.815 11:31:32 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:12.815 11:31:32 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:12.815 11:31:32 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:12.815 11:31:32 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:12.815 11:31:32 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:12.815 11:31:32 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:12.815 11:31:32 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:12.815 11:31:32 -- target/referrals.sh@26 -- # sort 00:07:13.073 11:31:32 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:13.073 11:31:32 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:13.073 11:31:32 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:13.073 11:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.073 11:31:32 -- common/autotest_common.sh@10 -- # set +x 00:07:13.073 11:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.073 11:31:32 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:13.073 11:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.073 11:31:32 -- common/autotest_common.sh@10 -- # set +x 00:07:13.073 11:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.073 11:31:32 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:13.073 11:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.073 11:31:32 -- common/autotest_common.sh@10 -- # set +x 00:07:13.073 11:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.073 11:31:32 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:13.073 11:31:32 -- target/referrals.sh@56 -- # jq length 00:07:13.073 11:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.073 11:31:32 -- common/autotest_common.sh@10 -- # set +x 00:07:13.073 11:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.073 11:31:32 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:13.073 11:31:32 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:13.073 11:31:32 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:13.073 11:31:32 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:13.073 11:31:32 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:13.073 11:31:32 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:13.073 11:31:32 -- target/referrals.sh@26 -- # sort 00:07:13.332 11:31:33 -- target/referrals.sh@26 -- # echo 00:07:13.332 11:31:33 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:13.332 11:31:33 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:13.332 11:31:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.332 11:31:33 -- common/autotest_common.sh@10 -- # set +x 00:07:13.332 11:31:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.332 11:31:33 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:13.332 11:31:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.332 11:31:33 -- common/autotest_common.sh@10 -- # set +x 00:07:13.332 11:31:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.332 11:31:33 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:13.332 11:31:33 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:13.332 11:31:33 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:13.332 11:31:33 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:13.332 11:31:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.332 11:31:33 -- target/referrals.sh@21 -- # sort 00:07:13.332 11:31:33 -- common/autotest_common.sh@10 -- # set +x 00:07:13.332 11:31:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.332 11:31:33 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:13.332 11:31:33 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:13.332 11:31:33 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:13.332 11:31:33 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:13.332 11:31:33 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:13.332 11:31:33 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:13.332 11:31:33 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:13.332 11:31:33 -- target/referrals.sh@26 -- # sort 00:07:13.590 11:31:33 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:13.590 11:31:33 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:13.590 11:31:33 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:13.590 11:31:33 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:13.590 11:31:33 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:13.590 11:31:33 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:13.590 11:31:33 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:13.590 11:31:33 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:13.590 11:31:33 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:13.590 11:31:33 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:13.590 11:31:33 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:13.590 11:31:33 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:13.590 11:31:33 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:13.847 11:31:33 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:13.847 11:31:33 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:13.847 11:31:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.847 11:31:33 -- common/autotest_common.sh@10 -- # set +x 00:07:13.847 11:31:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.847 11:31:33 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:13.847 11:31:33 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:13.847 11:31:33 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:13.847 11:31:33 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:13.847 11:31:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.847 11:31:33 -- common/autotest_common.sh@10 -- # set +x 00:07:13.847 11:31:33 -- target/referrals.sh@21 -- # sort 00:07:13.847 11:31:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.847 11:31:33 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:13.847 11:31:33 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:13.847 11:31:33 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:13.847 11:31:33 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:13.847 11:31:33 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:13.847 11:31:33 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:13.847 11:31:33 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:13.847 11:31:33 -- target/referrals.sh@26 -- # sort 00:07:14.105 11:31:33 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:14.105 11:31:33 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:14.105 11:31:33 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:14.105 11:31:33 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:14.105 11:31:33 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:14.105 11:31:33 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:14.105 11:31:33 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:14.105 11:31:34 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:14.105 11:31:34 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:14.105 11:31:34 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:14.105 11:31:34 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:14.105 11:31:34 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:14.105 11:31:34 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:14.362 11:31:34 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:14.362 11:31:34 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:14.362 11:31:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:14.362 11:31:34 -- common/autotest_common.sh@10 -- # set +x 00:07:14.363 11:31:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:14.363 11:31:34 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:14.363 11:31:34 -- target/referrals.sh@82 -- # jq length 00:07:14.363 11:31:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:14.363 11:31:34 -- common/autotest_common.sh@10 -- # set +x 00:07:14.363 11:31:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:14.363 11:31:34 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:14.363 11:31:34 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:14.363 11:31:34 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:14.363 11:31:34 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:14.363 11:31:34 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:14.363 11:31:34 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:14.363 11:31:34 -- target/referrals.sh@26 -- # sort 00:07:14.620 11:31:34 -- target/referrals.sh@26 -- # echo 00:07:14.620 11:31:34 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:14.620 11:31:34 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:14.620 11:31:34 -- target/referrals.sh@86 -- # nvmftestfini 00:07:14.620 11:31:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:14.620 11:31:34 -- nvmf/common.sh@116 -- # sync 00:07:14.620 11:31:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:14.620 11:31:34 -- nvmf/common.sh@119 -- # set +e 00:07:14.620 11:31:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:14.620 11:31:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:14.620 rmmod nvme_tcp 00:07:14.620 rmmod nvme_fabrics 00:07:14.620 rmmod nvme_keyring 00:07:14.620 11:31:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:14.620 11:31:34 -- nvmf/common.sh@123 -- # set -e 00:07:14.620 11:31:34 -- nvmf/common.sh@124 -- # return 0 00:07:14.620 11:31:34 -- nvmf/common.sh@477 -- # '[' -n 3716572 ']' 00:07:14.620 11:31:34 -- nvmf/common.sh@478 -- # killprocess 3716572 00:07:14.620 11:31:34 -- common/autotest_common.sh@936 -- # '[' -z 3716572 ']' 00:07:14.620 11:31:34 -- common/autotest_common.sh@940 -- # kill -0 3716572 00:07:14.620 11:31:34 -- common/autotest_common.sh@941 -- # uname 00:07:14.620 11:31:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:14.620 11:31:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3716572 00:07:14.620 11:31:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:14.620 11:31:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:14.620 11:31:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3716572' 00:07:14.620 killing process with pid 3716572 00:07:14.620 11:31:34 -- common/autotest_common.sh@955 -- # kill 3716572 00:07:14.620 11:31:34 -- common/autotest_common.sh@960 -- # wait 3716572 00:07:14.885 11:31:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:14.885 11:31:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:14.885 11:31:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:14.885 11:31:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:14.885 11:31:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:14.885 11:31:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:14.885 11:31:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:14.885 11:31:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:17.422 11:31:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:17.422 00:07:17.422 real 0m7.673s 00:07:17.422 user 0m13.603s 00:07:17.422 sys 0m2.254s 00:07:17.422 11:31:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:17.422 11:31:36 -- common/autotest_common.sh@10 -- # set +x 00:07:17.422 ************************************ 00:07:17.422 END TEST nvmf_referrals 00:07:17.422 ************************************ 00:07:17.422 11:31:36 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:17.422 11:31:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:17.422 11:31:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:17.422 11:31:36 -- common/autotest_common.sh@10 -- # set +x 00:07:17.422 ************************************ 00:07:17.422 START TEST nvmf_connect_disconnect 00:07:17.422 ************************************ 00:07:17.422 11:31:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:17.422 * Looking for test storage... 00:07:17.422 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:17.422 11:31:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:17.422 11:31:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:17.422 11:31:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:17.422 11:31:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:17.422 11:31:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:17.422 11:31:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:17.422 11:31:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:17.422 11:31:37 -- scripts/common.sh@335 -- # IFS=.-: 00:07:17.422 11:31:37 -- scripts/common.sh@335 -- # read -ra ver1 00:07:17.422 11:31:37 -- scripts/common.sh@336 -- # IFS=.-: 00:07:17.422 11:31:37 -- scripts/common.sh@336 -- # read -ra ver2 00:07:17.422 11:31:37 -- scripts/common.sh@337 -- # local 'op=<' 00:07:17.422 11:31:37 -- scripts/common.sh@339 -- # ver1_l=2 00:07:17.422 11:31:37 -- scripts/common.sh@340 -- # ver2_l=1 00:07:17.422 11:31:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:17.422 11:31:37 -- scripts/common.sh@343 -- # case "$op" in 00:07:17.422 11:31:37 -- scripts/common.sh@344 -- # : 1 00:07:17.422 11:31:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:17.422 11:31:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:17.422 11:31:37 -- scripts/common.sh@364 -- # decimal 1 00:07:17.422 11:31:37 -- scripts/common.sh@352 -- # local d=1 00:07:17.422 11:31:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:17.422 11:31:37 -- scripts/common.sh@354 -- # echo 1 00:07:17.422 11:31:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:17.422 11:31:37 -- scripts/common.sh@365 -- # decimal 2 00:07:17.422 11:31:37 -- scripts/common.sh@352 -- # local d=2 00:07:17.422 11:31:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:17.422 11:31:37 -- scripts/common.sh@354 -- # echo 2 00:07:17.422 11:31:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:17.422 11:31:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:17.422 11:31:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:17.422 11:31:37 -- scripts/common.sh@367 -- # return 0 00:07:17.422 11:31:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:17.422 11:31:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:17.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:17.422 --rc genhtml_branch_coverage=1 00:07:17.422 --rc genhtml_function_coverage=1 00:07:17.422 --rc genhtml_legend=1 00:07:17.422 --rc geninfo_all_blocks=1 00:07:17.422 --rc geninfo_unexecuted_blocks=1 00:07:17.422 00:07:17.422 ' 00:07:17.422 11:31:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:17.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:17.422 --rc genhtml_branch_coverage=1 00:07:17.422 --rc genhtml_function_coverage=1 00:07:17.422 --rc genhtml_legend=1 00:07:17.422 --rc geninfo_all_blocks=1 00:07:17.422 --rc geninfo_unexecuted_blocks=1 00:07:17.422 00:07:17.422 ' 00:07:17.422 11:31:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:17.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:17.422 --rc genhtml_branch_coverage=1 00:07:17.422 --rc genhtml_function_coverage=1 00:07:17.422 --rc genhtml_legend=1 00:07:17.422 --rc geninfo_all_blocks=1 00:07:17.422 --rc geninfo_unexecuted_blocks=1 00:07:17.422 00:07:17.422 ' 00:07:17.422 11:31:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:17.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:17.422 --rc genhtml_branch_coverage=1 00:07:17.422 --rc genhtml_function_coverage=1 00:07:17.422 --rc genhtml_legend=1 00:07:17.423 --rc geninfo_all_blocks=1 00:07:17.423 --rc geninfo_unexecuted_blocks=1 00:07:17.423 00:07:17.423 ' 00:07:17.423 11:31:37 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:17.423 11:31:37 -- nvmf/common.sh@7 -- # uname -s 00:07:17.423 11:31:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:17.423 11:31:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:17.423 11:31:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:17.423 11:31:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:17.423 11:31:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:17.423 11:31:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:17.423 11:31:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:17.423 11:31:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:17.423 11:31:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:17.423 11:31:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:17.423 11:31:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:17.423 11:31:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:17.423 11:31:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:17.423 11:31:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:17.423 11:31:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:17.423 11:31:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:17.423 11:31:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:17.423 11:31:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:17.423 11:31:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:17.423 11:31:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:17.423 11:31:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:17.423 11:31:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:17.423 11:31:37 -- paths/export.sh@5 -- # export PATH 00:07:17.423 11:31:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:17.423 11:31:37 -- nvmf/common.sh@46 -- # : 0 00:07:17.423 11:31:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:17.423 11:31:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:17.423 11:31:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:17.423 11:31:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:17.423 11:31:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:17.423 11:31:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:17.423 11:31:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:17.423 11:31:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:17.423 11:31:37 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:17.423 11:31:37 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:17.423 11:31:37 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:17.423 11:31:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:17.423 11:31:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:17.423 11:31:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:17.423 11:31:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:17.423 11:31:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:17.423 11:31:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:17.423 11:31:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:17.423 11:31:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:17.423 11:31:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:17.423 11:31:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:17.423 11:31:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:17.423 11:31:37 -- common/autotest_common.sh@10 -- # set +x 00:07:19.322 11:31:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:19.322 11:31:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:19.322 11:31:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:19.322 11:31:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:19.322 11:31:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:19.322 11:31:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:19.322 11:31:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:19.322 11:31:39 -- nvmf/common.sh@294 -- # net_devs=() 00:07:19.322 11:31:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:19.322 11:31:39 -- nvmf/common.sh@295 -- # e810=() 00:07:19.322 11:31:39 -- nvmf/common.sh@295 -- # local -ga e810 00:07:19.322 11:31:39 -- nvmf/common.sh@296 -- # x722=() 00:07:19.322 11:31:39 -- nvmf/common.sh@296 -- # local -ga x722 00:07:19.322 11:31:39 -- nvmf/common.sh@297 -- # mlx=() 00:07:19.322 11:31:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:19.322 11:31:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:19.322 11:31:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:19.322 11:31:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:19.322 11:31:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:19.322 11:31:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:19.322 11:31:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:19.322 11:31:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:19.323 11:31:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:19.323 11:31:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:19.323 11:31:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:19.323 11:31:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:19.323 11:31:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:19.323 11:31:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:19.323 11:31:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:19.323 11:31:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:19.323 11:31:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:19.323 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:19.323 11:31:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:19.323 11:31:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:19.323 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:19.323 11:31:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:19.323 11:31:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:19.323 11:31:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:19.323 11:31:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:19.323 11:31:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:19.323 11:31:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:19.323 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:19.323 11:31:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:19.323 11:31:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:19.323 11:31:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:19.323 11:31:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:19.323 11:31:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:19.323 11:31:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:19.323 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:19.323 11:31:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:19.323 11:31:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:19.323 11:31:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:19.323 11:31:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:19.323 11:31:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:19.323 11:31:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:19.323 11:31:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:19.323 11:31:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:19.323 11:31:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:19.323 11:31:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:19.323 11:31:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:19.323 11:31:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:19.323 11:31:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:19.323 11:31:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:19.323 11:31:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:19.323 11:31:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:19.323 11:31:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:19.323 11:31:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:19.323 11:31:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:19.323 11:31:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:19.323 11:31:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:19.323 11:31:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:19.323 11:31:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:19.323 11:31:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:19.323 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:19.323 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.337 ms 00:07:19.323 00:07:19.323 --- 10.0.0.2 ping statistics --- 00:07:19.323 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:19.323 rtt min/avg/max/mdev = 0.337/0.337/0.337/0.000 ms 00:07:19.323 11:31:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:19.323 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:19.323 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:07:19.323 00:07:19.323 --- 10.0.0.1 ping statistics --- 00:07:19.323 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:19.323 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:07:19.323 11:31:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:19.323 11:31:39 -- nvmf/common.sh@410 -- # return 0 00:07:19.323 11:31:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:19.323 11:31:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:19.323 11:31:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:19.323 11:31:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:19.323 11:31:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:19.323 11:31:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:19.323 11:31:39 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:19.323 11:31:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:19.323 11:31:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:19.323 11:31:39 -- common/autotest_common.sh@10 -- # set +x 00:07:19.323 11:31:39 -- nvmf/common.sh@469 -- # nvmfpid=3719022 00:07:19.323 11:31:39 -- nvmf/common.sh@470 -- # waitforlisten 3719022 00:07:19.323 11:31:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:19.323 11:31:39 -- common/autotest_common.sh@829 -- # '[' -z 3719022 ']' 00:07:19.323 11:31:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:19.323 11:31:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:19.323 11:31:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:19.323 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:19.323 11:31:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:19.323 11:31:39 -- common/autotest_common.sh@10 -- # set +x 00:07:19.323 [2024-11-28 11:31:39.324472] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:19.323 [2024-11-28 11:31:39.324583] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:19.323 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.581 [2024-11-28 11:31:39.389323] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:19.581 [2024-11-28 11:31:39.498974] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:19.581 [2024-11-28 11:31:39.499146] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:19.581 [2024-11-28 11:31:39.499164] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:19.581 [2024-11-28 11:31:39.499176] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:19.581 [2024-11-28 11:31:39.499234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:19.582 [2024-11-28 11:31:39.499298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:19.582 [2024-11-28 11:31:39.499362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:19.582 [2024-11-28 11:31:39.499364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.514 11:31:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:20.514 11:31:40 -- common/autotest_common.sh@862 -- # return 0 00:07:20.514 11:31:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:20.514 11:31:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:20.514 11:31:40 -- common/autotest_common.sh@10 -- # set +x 00:07:20.514 11:31:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:20.514 11:31:40 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:20.514 11:31:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:20.514 11:31:40 -- common/autotest_common.sh@10 -- # set +x 00:07:20.514 [2024-11-28 11:31:40.345187] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:20.514 11:31:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:20.514 11:31:40 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:20.514 11:31:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:20.514 11:31:40 -- common/autotest_common.sh@10 -- # set +x 00:07:20.514 11:31:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:20.514 11:31:40 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:20.514 11:31:40 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:20.514 11:31:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:20.514 11:31:40 -- common/autotest_common.sh@10 -- # set +x 00:07:20.514 11:31:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:20.514 11:31:40 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:20.514 11:31:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:20.514 11:31:40 -- common/autotest_common.sh@10 -- # set +x 00:07:20.514 11:31:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:20.514 11:31:40 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:20.514 11:31:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:20.514 11:31:40 -- common/autotest_common.sh@10 -- # set +x 00:07:20.514 [2024-11-28 11:31:40.402754] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:20.514 11:31:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:20.514 11:31:40 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:20.514 11:31:40 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:20.514 11:31:40 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:20.514 11:31:40 -- target/connect_disconnect.sh@34 -- # set +x 00:07:23.041 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:25.566 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:27.462 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:29.986 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:31.884 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:34.411 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:36.935 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:39.462 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:41.421 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:43.948 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:46.474 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:48.371 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:50.895 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:52.792 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:55.315 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:57.842 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:59.742 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:02.267 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.792 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:06.689 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:09.214 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.735 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:13.632 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:16.157 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.681 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:20.577 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:23.103 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.056 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:27.582 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.109 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:32.006 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.532 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.055 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:38.954 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.482 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.011 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:45.910 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.438 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:50.338 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:52.864 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.387 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:57.287 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:59.884 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:01.781 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:04.308 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.833 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:08.731 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.255 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.780 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.302 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.196 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:20.723 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.251 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.148 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.670 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.195 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.092 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.618 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.203 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.734 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.631 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.157 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.681 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.580 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.107 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.633 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.532 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.061 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.961 [2024-11-28 11:34:19.963409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129f390 is same with the state(5) to be set 00:09:59.961 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.487 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.014 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.909 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.437 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.966 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.944 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.471 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.996 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.893 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.420 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.947 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.862 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.385 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.912 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.808 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.334 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.860 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.759 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.287 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.186 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.714 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:51.296 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.193 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.718 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.247 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.774 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.672 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.201 [2024-11-28 11:35:24.942447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129f390 is same with the state(5) to be set 00:11:05.201 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.731 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.628 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.155 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.155 11:35:32 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:12.155 11:35:32 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:12.155 11:35:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:12.155 11:35:32 -- nvmf/common.sh@116 -- # sync 00:11:12.155 11:35:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:12.155 11:35:32 -- nvmf/common.sh@119 -- # set +e 00:11:12.155 11:35:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:12.155 11:35:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:12.155 rmmod nvme_tcp 00:11:12.155 rmmod nvme_fabrics 00:11:12.155 rmmod nvme_keyring 00:11:12.155 11:35:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:12.155 11:35:32 -- nvmf/common.sh@123 -- # set -e 00:11:12.155 11:35:32 -- nvmf/common.sh@124 -- # return 0 00:11:12.155 11:35:32 -- nvmf/common.sh@477 -- # '[' -n 3719022 ']' 00:11:12.155 11:35:32 -- nvmf/common.sh@478 -- # killprocess 3719022 00:11:12.155 11:35:32 -- common/autotest_common.sh@936 -- # '[' -z 3719022 ']' 00:11:12.155 11:35:32 -- common/autotest_common.sh@940 -- # kill -0 3719022 00:11:12.155 11:35:32 -- common/autotest_common.sh@941 -- # uname 00:11:12.155 11:35:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:12.155 11:35:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3719022 00:11:12.155 11:35:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:12.155 11:35:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:12.155 11:35:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3719022' 00:11:12.155 killing process with pid 3719022 00:11:12.155 11:35:32 -- common/autotest_common.sh@955 -- # kill 3719022 00:11:12.155 11:35:32 -- common/autotest_common.sh@960 -- # wait 3719022 00:11:12.412 11:35:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:12.412 11:35:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:12.412 11:35:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:12.412 11:35:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:12.412 11:35:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:12.412 11:35:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:12.412 11:35:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:12.412 11:35:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:14.949 11:35:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:14.949 00:11:14.949 real 3m57.518s 00:11:14.949 user 15m5.025s 00:11:14.949 sys 0m35.309s 00:11:14.949 11:35:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:14.949 11:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:14.949 ************************************ 00:11:14.949 END TEST nvmf_connect_disconnect 00:11:14.949 ************************************ 00:11:14.949 11:35:34 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:14.949 11:35:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:14.949 11:35:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:14.949 11:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:14.949 ************************************ 00:11:14.949 START TEST nvmf_multitarget 00:11:14.949 ************************************ 00:11:14.949 11:35:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:14.949 * Looking for test storage... 00:11:14.949 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:14.949 11:35:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:14.949 11:35:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:14.949 11:35:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:14.949 11:35:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:14.949 11:35:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:14.949 11:35:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:14.949 11:35:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:14.949 11:35:34 -- scripts/common.sh@335 -- # IFS=.-: 00:11:14.949 11:35:34 -- scripts/common.sh@335 -- # read -ra ver1 00:11:14.949 11:35:34 -- scripts/common.sh@336 -- # IFS=.-: 00:11:14.949 11:35:34 -- scripts/common.sh@336 -- # read -ra ver2 00:11:14.949 11:35:34 -- scripts/common.sh@337 -- # local 'op=<' 00:11:14.949 11:35:34 -- scripts/common.sh@339 -- # ver1_l=2 00:11:14.949 11:35:34 -- scripts/common.sh@340 -- # ver2_l=1 00:11:14.949 11:35:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:14.949 11:35:34 -- scripts/common.sh@343 -- # case "$op" in 00:11:14.949 11:35:34 -- scripts/common.sh@344 -- # : 1 00:11:14.949 11:35:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:14.949 11:35:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:14.949 11:35:34 -- scripts/common.sh@364 -- # decimal 1 00:11:14.949 11:35:34 -- scripts/common.sh@352 -- # local d=1 00:11:14.949 11:35:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:14.949 11:35:34 -- scripts/common.sh@354 -- # echo 1 00:11:14.949 11:35:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:14.949 11:35:34 -- scripts/common.sh@365 -- # decimal 2 00:11:14.949 11:35:34 -- scripts/common.sh@352 -- # local d=2 00:11:14.950 11:35:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:14.950 11:35:34 -- scripts/common.sh@354 -- # echo 2 00:11:14.950 11:35:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:14.950 11:35:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:14.950 11:35:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:14.950 11:35:34 -- scripts/common.sh@367 -- # return 0 00:11:14.950 11:35:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:14.950 11:35:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:14.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:14.950 --rc genhtml_branch_coverage=1 00:11:14.950 --rc genhtml_function_coverage=1 00:11:14.950 --rc genhtml_legend=1 00:11:14.950 --rc geninfo_all_blocks=1 00:11:14.950 --rc geninfo_unexecuted_blocks=1 00:11:14.950 00:11:14.950 ' 00:11:14.950 11:35:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:14.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:14.950 --rc genhtml_branch_coverage=1 00:11:14.950 --rc genhtml_function_coverage=1 00:11:14.950 --rc genhtml_legend=1 00:11:14.950 --rc geninfo_all_blocks=1 00:11:14.950 --rc geninfo_unexecuted_blocks=1 00:11:14.950 00:11:14.950 ' 00:11:14.950 11:35:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:14.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:14.950 --rc genhtml_branch_coverage=1 00:11:14.950 --rc genhtml_function_coverage=1 00:11:14.950 --rc genhtml_legend=1 00:11:14.950 --rc geninfo_all_blocks=1 00:11:14.950 --rc geninfo_unexecuted_blocks=1 00:11:14.950 00:11:14.950 ' 00:11:14.950 11:35:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:14.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:14.950 --rc genhtml_branch_coverage=1 00:11:14.950 --rc genhtml_function_coverage=1 00:11:14.950 --rc genhtml_legend=1 00:11:14.950 --rc geninfo_all_blocks=1 00:11:14.950 --rc geninfo_unexecuted_blocks=1 00:11:14.950 00:11:14.950 ' 00:11:14.950 11:35:34 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:14.950 11:35:34 -- nvmf/common.sh@7 -- # uname -s 00:11:14.950 11:35:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:14.950 11:35:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:14.950 11:35:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:14.950 11:35:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:14.950 11:35:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:14.950 11:35:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:14.950 11:35:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:14.950 11:35:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:14.950 11:35:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:14.950 11:35:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:14.950 11:35:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:14.950 11:35:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:14.950 11:35:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:14.950 11:35:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:14.950 11:35:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:14.950 11:35:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:14.950 11:35:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:14.950 11:35:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:14.950 11:35:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:14.950 11:35:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:14.950 11:35:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:14.950 11:35:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:14.950 11:35:34 -- paths/export.sh@5 -- # export PATH 00:11:14.950 11:35:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:14.950 11:35:34 -- nvmf/common.sh@46 -- # : 0 00:11:14.950 11:35:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:14.950 11:35:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:14.950 11:35:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:14.950 11:35:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:14.950 11:35:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:14.950 11:35:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:14.950 11:35:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:14.950 11:35:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:14.950 11:35:34 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:14.950 11:35:34 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:14.950 11:35:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:14.950 11:35:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:14.950 11:35:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:14.950 11:35:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:14.950 11:35:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:14.950 11:35:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:14.950 11:35:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:14.950 11:35:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:14.950 11:35:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:14.950 11:35:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:14.950 11:35:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:14.950 11:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:16.851 11:35:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:16.851 11:35:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:16.851 11:35:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:16.851 11:35:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:16.851 11:35:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:16.851 11:35:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:16.851 11:35:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:16.851 11:35:36 -- nvmf/common.sh@294 -- # net_devs=() 00:11:16.851 11:35:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:16.851 11:35:36 -- nvmf/common.sh@295 -- # e810=() 00:11:16.851 11:35:36 -- nvmf/common.sh@295 -- # local -ga e810 00:11:16.851 11:35:36 -- nvmf/common.sh@296 -- # x722=() 00:11:16.851 11:35:36 -- nvmf/common.sh@296 -- # local -ga x722 00:11:16.851 11:35:36 -- nvmf/common.sh@297 -- # mlx=() 00:11:16.851 11:35:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:16.851 11:35:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:16.851 11:35:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:16.851 11:35:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:16.851 11:35:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:16.851 11:35:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:16.851 11:35:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:16.851 11:35:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:16.851 11:35:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:16.851 11:35:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:16.851 11:35:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:16.851 11:35:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:16.851 11:35:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:16.851 11:35:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:16.851 11:35:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:16.851 11:35:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:16.851 11:35:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:16.851 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:16.851 11:35:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:16.851 11:35:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:16.851 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:16.851 11:35:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:16.851 11:35:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:16.851 11:35:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:16.851 11:35:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:16.851 11:35:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:16.851 11:35:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:16.851 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:16.851 11:35:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:16.851 11:35:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:16.851 11:35:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:16.851 11:35:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:16.851 11:35:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:16.851 11:35:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:16.851 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:16.851 11:35:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:16.851 11:35:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:16.851 11:35:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:16.851 11:35:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:16.851 11:35:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:16.851 11:35:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:16.851 11:35:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:16.851 11:35:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:16.851 11:35:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:16.851 11:35:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:16.851 11:35:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:16.851 11:35:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:16.851 11:35:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:16.851 11:35:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:16.851 11:35:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:16.851 11:35:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:16.851 11:35:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:16.851 11:35:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:16.851 11:35:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:16.851 11:35:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:16.851 11:35:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:16.851 11:35:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:16.851 11:35:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:16.851 11:35:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:16.851 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:16.851 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.184 ms 00:11:16.851 00:11:16.851 --- 10.0.0.2 ping statistics --- 00:11:16.851 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:16.851 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:11:16.851 11:35:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:16.851 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:16.851 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:11:16.851 00:11:16.851 --- 10.0.0.1 ping statistics --- 00:11:16.851 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:16.851 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:11:16.851 11:35:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:16.851 11:35:36 -- nvmf/common.sh@410 -- # return 0 00:11:16.851 11:35:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:16.851 11:35:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:16.851 11:35:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:16.851 11:35:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:16.851 11:35:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:16.851 11:35:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:16.851 11:35:36 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:16.851 11:35:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:16.851 11:35:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:16.851 11:35:36 -- common/autotest_common.sh@10 -- # set +x 00:11:16.851 11:35:36 -- nvmf/common.sh@469 -- # nvmfpid=3751072 00:11:16.851 11:35:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:16.851 11:35:36 -- nvmf/common.sh@470 -- # waitforlisten 3751072 00:11:16.851 11:35:36 -- common/autotest_common.sh@829 -- # '[' -z 3751072 ']' 00:11:16.851 11:35:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:16.851 11:35:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:16.851 11:35:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:16.851 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:16.851 11:35:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:16.851 11:35:36 -- common/autotest_common.sh@10 -- # set +x 00:11:17.110 [2024-11-28 11:35:36.947324] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:17.110 [2024-11-28 11:35:36.947398] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:17.110 EAL: No free 2048 kB hugepages reported on node 1 00:11:17.110 [2024-11-28 11:35:37.016478] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:17.110 [2024-11-28 11:35:37.138075] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:17.110 [2024-11-28 11:35:37.138238] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:17.110 [2024-11-28 11:35:37.138258] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:17.110 [2024-11-28 11:35:37.138272] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:17.110 [2024-11-28 11:35:37.138346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:17.110 [2024-11-28 11:35:37.138398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:17.110 [2024-11-28 11:35:37.138449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:17.110 [2024-11-28 11:35:37.138452] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:18.043 11:35:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:18.043 11:35:37 -- common/autotest_common.sh@862 -- # return 0 00:11:18.043 11:35:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:18.043 11:35:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:18.043 11:35:37 -- common/autotest_common.sh@10 -- # set +x 00:11:18.043 11:35:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:18.043 11:35:37 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:18.043 11:35:37 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:18.043 11:35:37 -- target/multitarget.sh@21 -- # jq length 00:11:18.043 11:35:38 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:18.043 11:35:38 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:18.301 "nvmf_tgt_1" 00:11:18.301 11:35:38 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:18.301 "nvmf_tgt_2" 00:11:18.301 11:35:38 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:18.301 11:35:38 -- target/multitarget.sh@28 -- # jq length 00:11:18.560 11:35:38 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:18.560 11:35:38 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:18.560 true 00:11:18.560 11:35:38 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:18.818 true 00:11:18.818 11:35:38 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:18.818 11:35:38 -- target/multitarget.sh@35 -- # jq length 00:11:18.818 11:35:38 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:18.818 11:35:38 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:18.818 11:35:38 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:18.818 11:35:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:18.818 11:35:38 -- nvmf/common.sh@116 -- # sync 00:11:18.818 11:35:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:18.818 11:35:38 -- nvmf/common.sh@119 -- # set +e 00:11:18.818 11:35:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:18.818 11:35:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:18.818 rmmod nvme_tcp 00:11:18.819 rmmod nvme_fabrics 00:11:18.819 rmmod nvme_keyring 00:11:18.819 11:35:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:18.819 11:35:38 -- nvmf/common.sh@123 -- # set -e 00:11:18.819 11:35:38 -- nvmf/common.sh@124 -- # return 0 00:11:18.819 11:35:38 -- nvmf/common.sh@477 -- # '[' -n 3751072 ']' 00:11:18.819 11:35:38 -- nvmf/common.sh@478 -- # killprocess 3751072 00:11:18.819 11:35:38 -- common/autotest_common.sh@936 -- # '[' -z 3751072 ']' 00:11:18.819 11:35:38 -- common/autotest_common.sh@940 -- # kill -0 3751072 00:11:18.819 11:35:38 -- common/autotest_common.sh@941 -- # uname 00:11:18.819 11:35:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:18.819 11:35:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3751072 00:11:18.819 11:35:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:18.819 11:35:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:18.819 11:35:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3751072' 00:11:18.819 killing process with pid 3751072 00:11:18.819 11:35:38 -- common/autotest_common.sh@955 -- # kill 3751072 00:11:18.819 11:35:38 -- common/autotest_common.sh@960 -- # wait 3751072 00:11:19.077 11:35:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:19.077 11:35:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:19.077 11:35:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:19.077 11:35:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:19.077 11:35:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:19.077 11:35:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:19.077 11:35:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:19.077 11:35:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:21.614 11:35:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:21.614 00:11:21.614 real 0m6.698s 00:11:21.614 user 0m9.638s 00:11:21.614 sys 0m1.998s 00:11:21.614 11:35:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:21.614 11:35:41 -- common/autotest_common.sh@10 -- # set +x 00:11:21.614 ************************************ 00:11:21.614 END TEST nvmf_multitarget 00:11:21.614 ************************************ 00:11:21.614 11:35:41 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:21.614 11:35:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:21.614 11:35:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:21.614 11:35:41 -- common/autotest_common.sh@10 -- # set +x 00:11:21.614 ************************************ 00:11:21.614 START TEST nvmf_rpc 00:11:21.614 ************************************ 00:11:21.614 11:35:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:21.614 * Looking for test storage... 00:11:21.614 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:21.614 11:35:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:21.614 11:35:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:21.614 11:35:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:21.614 11:35:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:21.614 11:35:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:21.614 11:35:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:21.614 11:35:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:21.614 11:35:41 -- scripts/common.sh@335 -- # IFS=.-: 00:11:21.614 11:35:41 -- scripts/common.sh@335 -- # read -ra ver1 00:11:21.614 11:35:41 -- scripts/common.sh@336 -- # IFS=.-: 00:11:21.614 11:35:41 -- scripts/common.sh@336 -- # read -ra ver2 00:11:21.614 11:35:41 -- scripts/common.sh@337 -- # local 'op=<' 00:11:21.614 11:35:41 -- scripts/common.sh@339 -- # ver1_l=2 00:11:21.614 11:35:41 -- scripts/common.sh@340 -- # ver2_l=1 00:11:21.614 11:35:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:21.614 11:35:41 -- scripts/common.sh@343 -- # case "$op" in 00:11:21.614 11:35:41 -- scripts/common.sh@344 -- # : 1 00:11:21.614 11:35:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:21.614 11:35:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:21.614 11:35:41 -- scripts/common.sh@364 -- # decimal 1 00:11:21.614 11:35:41 -- scripts/common.sh@352 -- # local d=1 00:11:21.614 11:35:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:21.614 11:35:41 -- scripts/common.sh@354 -- # echo 1 00:11:21.614 11:35:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:21.614 11:35:41 -- scripts/common.sh@365 -- # decimal 2 00:11:21.614 11:35:41 -- scripts/common.sh@352 -- # local d=2 00:11:21.614 11:35:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:21.614 11:35:41 -- scripts/common.sh@354 -- # echo 2 00:11:21.614 11:35:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:21.614 11:35:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:21.614 11:35:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:21.614 11:35:41 -- scripts/common.sh@367 -- # return 0 00:11:21.614 11:35:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:21.614 11:35:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:21.614 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:21.614 --rc genhtml_branch_coverage=1 00:11:21.614 --rc genhtml_function_coverage=1 00:11:21.614 --rc genhtml_legend=1 00:11:21.614 --rc geninfo_all_blocks=1 00:11:21.614 --rc geninfo_unexecuted_blocks=1 00:11:21.614 00:11:21.614 ' 00:11:21.614 11:35:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:21.614 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:21.614 --rc genhtml_branch_coverage=1 00:11:21.614 --rc genhtml_function_coverage=1 00:11:21.614 --rc genhtml_legend=1 00:11:21.614 --rc geninfo_all_blocks=1 00:11:21.614 --rc geninfo_unexecuted_blocks=1 00:11:21.614 00:11:21.614 ' 00:11:21.614 11:35:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:21.614 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:21.614 --rc genhtml_branch_coverage=1 00:11:21.614 --rc genhtml_function_coverage=1 00:11:21.614 --rc genhtml_legend=1 00:11:21.614 --rc geninfo_all_blocks=1 00:11:21.614 --rc geninfo_unexecuted_blocks=1 00:11:21.614 00:11:21.614 ' 00:11:21.614 11:35:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:21.614 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:21.614 --rc genhtml_branch_coverage=1 00:11:21.614 --rc genhtml_function_coverage=1 00:11:21.614 --rc genhtml_legend=1 00:11:21.614 --rc geninfo_all_blocks=1 00:11:21.614 --rc geninfo_unexecuted_blocks=1 00:11:21.614 00:11:21.614 ' 00:11:21.614 11:35:41 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:21.614 11:35:41 -- nvmf/common.sh@7 -- # uname -s 00:11:21.614 11:35:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:21.614 11:35:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:21.614 11:35:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:21.614 11:35:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:21.614 11:35:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:21.614 11:35:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:21.614 11:35:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:21.614 11:35:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:21.614 11:35:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:21.614 11:35:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:21.614 11:35:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:21.614 11:35:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:21.615 11:35:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:21.615 11:35:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:21.615 11:35:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:21.615 11:35:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:21.615 11:35:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:21.615 11:35:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:21.615 11:35:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:21.615 11:35:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:21.615 11:35:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:21.615 11:35:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:21.615 11:35:41 -- paths/export.sh@5 -- # export PATH 00:11:21.615 11:35:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:21.615 11:35:41 -- nvmf/common.sh@46 -- # : 0 00:11:21.615 11:35:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:21.615 11:35:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:21.615 11:35:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:21.615 11:35:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:21.615 11:35:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:21.615 11:35:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:21.615 11:35:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:21.615 11:35:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:21.615 11:35:41 -- target/rpc.sh@11 -- # loops=5 00:11:21.615 11:35:41 -- target/rpc.sh@23 -- # nvmftestinit 00:11:21.615 11:35:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:21.615 11:35:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:21.615 11:35:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:21.615 11:35:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:21.615 11:35:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:21.615 11:35:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:21.615 11:35:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:21.615 11:35:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:21.615 11:35:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:21.615 11:35:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:21.615 11:35:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:21.615 11:35:41 -- common/autotest_common.sh@10 -- # set +x 00:11:23.518 11:35:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:23.518 11:35:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:23.518 11:35:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:23.518 11:35:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:23.518 11:35:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:23.518 11:35:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:23.518 11:35:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:23.518 11:35:43 -- nvmf/common.sh@294 -- # net_devs=() 00:11:23.518 11:35:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:23.518 11:35:43 -- nvmf/common.sh@295 -- # e810=() 00:11:23.518 11:35:43 -- nvmf/common.sh@295 -- # local -ga e810 00:11:23.518 11:35:43 -- nvmf/common.sh@296 -- # x722=() 00:11:23.518 11:35:43 -- nvmf/common.sh@296 -- # local -ga x722 00:11:23.518 11:35:43 -- nvmf/common.sh@297 -- # mlx=() 00:11:23.518 11:35:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:23.518 11:35:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:23.518 11:35:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:23.518 11:35:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:23.518 11:35:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:23.518 11:35:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:23.518 11:35:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:23.518 11:35:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:23.518 11:35:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:23.518 11:35:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:23.518 11:35:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:23.518 11:35:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:23.518 11:35:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:23.518 11:35:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:23.518 11:35:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:23.518 11:35:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:23.518 11:35:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:23.518 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:23.518 11:35:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:23.518 11:35:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:23.518 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:23.518 11:35:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:23.518 11:35:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:23.518 11:35:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:23.518 11:35:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:23.518 11:35:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:23.518 11:35:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:23.518 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:23.518 11:35:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:23.518 11:35:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:23.518 11:35:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:23.518 11:35:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:23.518 11:35:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:23.518 11:35:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:23.518 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:23.518 11:35:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:23.518 11:35:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:23.518 11:35:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:23.518 11:35:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:23.518 11:35:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:23.518 11:35:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:23.518 11:35:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:23.518 11:35:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:23.518 11:35:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:23.518 11:35:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:23.518 11:35:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:23.518 11:35:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:23.518 11:35:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:23.518 11:35:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:23.518 11:35:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:23.518 11:35:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:23.518 11:35:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:23.518 11:35:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:23.518 11:35:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:23.518 11:35:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:23.518 11:35:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:23.518 11:35:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:23.518 11:35:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:23.518 11:35:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:23.518 11:35:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:23.518 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:23.518 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:11:23.518 00:11:23.518 --- 10.0.0.2 ping statistics --- 00:11:23.518 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:23.519 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:11:23.519 11:35:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:23.519 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:23.519 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:11:23.519 00:11:23.519 --- 10.0.0.1 ping statistics --- 00:11:23.519 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:23.519 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:11:23.519 11:35:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:23.519 11:35:43 -- nvmf/common.sh@410 -- # return 0 00:11:23.519 11:35:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:23.519 11:35:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:23.519 11:35:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:23.519 11:35:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:23.519 11:35:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:23.519 11:35:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:23.519 11:35:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:23.519 11:35:43 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:23.519 11:35:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:23.519 11:35:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:23.519 11:35:43 -- common/autotest_common.sh@10 -- # set +x 00:11:23.519 11:35:43 -- nvmf/common.sh@469 -- # nvmfpid=3753323 00:11:23.519 11:35:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:23.519 11:35:43 -- nvmf/common.sh@470 -- # waitforlisten 3753323 00:11:23.519 11:35:43 -- common/autotest_common.sh@829 -- # '[' -z 3753323 ']' 00:11:23.519 11:35:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:23.519 11:35:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:23.519 11:35:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:23.519 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:23.519 11:35:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:23.519 11:35:43 -- common/autotest_common.sh@10 -- # set +x 00:11:23.519 [2024-11-28 11:35:43.559831] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:23.519 [2024-11-28 11:35:43.559915] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:23.777 EAL: No free 2048 kB hugepages reported on node 1 00:11:23.777 [2024-11-28 11:35:43.628979] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:23.777 [2024-11-28 11:35:43.753914] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:23.777 [2024-11-28 11:35:43.754079] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:23.777 [2024-11-28 11:35:43.754099] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:23.777 [2024-11-28 11:35:43.754113] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:23.777 [2024-11-28 11:35:43.754173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:23.777 [2024-11-28 11:35:43.754232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:23.777 [2024-11-28 11:35:43.754285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:23.777 [2024-11-28 11:35:43.754289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:24.787 11:35:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:24.787 11:35:44 -- common/autotest_common.sh@862 -- # return 0 00:11:24.787 11:35:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:24.787 11:35:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:24.787 11:35:44 -- common/autotest_common.sh@10 -- # set +x 00:11:24.787 11:35:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:24.787 11:35:44 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:24.787 11:35:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:24.787 11:35:44 -- common/autotest_common.sh@10 -- # set +x 00:11:24.787 11:35:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:24.787 11:35:44 -- target/rpc.sh@26 -- # stats='{ 00:11:24.787 "tick_rate": 2700000000, 00:11:24.787 "poll_groups": [ 00:11:24.787 { 00:11:24.787 "name": "nvmf_tgt_poll_group_0", 00:11:24.787 "admin_qpairs": 0, 00:11:24.787 "io_qpairs": 0, 00:11:24.787 "current_admin_qpairs": 0, 00:11:24.787 "current_io_qpairs": 0, 00:11:24.787 "pending_bdev_io": 0, 00:11:24.787 "completed_nvme_io": 0, 00:11:24.787 "transports": [] 00:11:24.787 }, 00:11:24.787 { 00:11:24.787 "name": "nvmf_tgt_poll_group_1", 00:11:24.787 "admin_qpairs": 0, 00:11:24.787 "io_qpairs": 0, 00:11:24.787 "current_admin_qpairs": 0, 00:11:24.787 "current_io_qpairs": 0, 00:11:24.787 "pending_bdev_io": 0, 00:11:24.787 "completed_nvme_io": 0, 00:11:24.787 "transports": [] 00:11:24.787 }, 00:11:24.787 { 00:11:24.787 "name": "nvmf_tgt_poll_group_2", 00:11:24.787 "admin_qpairs": 0, 00:11:24.787 "io_qpairs": 0, 00:11:24.787 "current_admin_qpairs": 0, 00:11:24.787 "current_io_qpairs": 0, 00:11:24.787 "pending_bdev_io": 0, 00:11:24.787 "completed_nvme_io": 0, 00:11:24.787 "transports": [] 00:11:24.787 }, 00:11:24.787 { 00:11:24.787 "name": "nvmf_tgt_poll_group_3", 00:11:24.787 "admin_qpairs": 0, 00:11:24.788 "io_qpairs": 0, 00:11:24.788 "current_admin_qpairs": 0, 00:11:24.788 "current_io_qpairs": 0, 00:11:24.788 "pending_bdev_io": 0, 00:11:24.788 "completed_nvme_io": 0, 00:11:24.788 "transports": [] 00:11:24.788 } 00:11:24.788 ] 00:11:24.788 }' 00:11:24.788 11:35:44 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:24.788 11:35:44 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:24.788 11:35:44 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:24.788 11:35:44 -- target/rpc.sh@15 -- # wc -l 00:11:24.788 11:35:44 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:24.788 11:35:44 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:24.788 11:35:44 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:24.788 11:35:44 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:24.788 11:35:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:24.788 11:35:44 -- common/autotest_common.sh@10 -- # set +x 00:11:24.788 [2024-11-28 11:35:44.733657] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:24.788 11:35:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:24.788 11:35:44 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:24.788 11:35:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:24.788 11:35:44 -- common/autotest_common.sh@10 -- # set +x 00:11:24.788 11:35:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:24.788 11:35:44 -- target/rpc.sh@33 -- # stats='{ 00:11:24.788 "tick_rate": 2700000000, 00:11:24.788 "poll_groups": [ 00:11:24.788 { 00:11:24.788 "name": "nvmf_tgt_poll_group_0", 00:11:24.788 "admin_qpairs": 0, 00:11:24.788 "io_qpairs": 0, 00:11:24.788 "current_admin_qpairs": 0, 00:11:24.788 "current_io_qpairs": 0, 00:11:24.788 "pending_bdev_io": 0, 00:11:24.788 "completed_nvme_io": 0, 00:11:24.788 "transports": [ 00:11:24.788 { 00:11:24.788 "trtype": "TCP" 00:11:24.788 } 00:11:24.788 ] 00:11:24.788 }, 00:11:24.788 { 00:11:24.788 "name": "nvmf_tgt_poll_group_1", 00:11:24.788 "admin_qpairs": 0, 00:11:24.788 "io_qpairs": 0, 00:11:24.788 "current_admin_qpairs": 0, 00:11:24.788 "current_io_qpairs": 0, 00:11:24.788 "pending_bdev_io": 0, 00:11:24.788 "completed_nvme_io": 0, 00:11:24.788 "transports": [ 00:11:24.788 { 00:11:24.788 "trtype": "TCP" 00:11:24.788 } 00:11:24.788 ] 00:11:24.788 }, 00:11:24.788 { 00:11:24.788 "name": "nvmf_tgt_poll_group_2", 00:11:24.788 "admin_qpairs": 0, 00:11:24.788 "io_qpairs": 0, 00:11:24.788 "current_admin_qpairs": 0, 00:11:24.788 "current_io_qpairs": 0, 00:11:24.788 "pending_bdev_io": 0, 00:11:24.788 "completed_nvme_io": 0, 00:11:24.788 "transports": [ 00:11:24.788 { 00:11:24.788 "trtype": "TCP" 00:11:24.788 } 00:11:24.788 ] 00:11:24.788 }, 00:11:24.788 { 00:11:24.788 "name": "nvmf_tgt_poll_group_3", 00:11:24.788 "admin_qpairs": 0, 00:11:24.788 "io_qpairs": 0, 00:11:24.788 "current_admin_qpairs": 0, 00:11:24.788 "current_io_qpairs": 0, 00:11:24.788 "pending_bdev_io": 0, 00:11:24.788 "completed_nvme_io": 0, 00:11:24.788 "transports": [ 00:11:24.788 { 00:11:24.788 "trtype": "TCP" 00:11:24.788 } 00:11:24.788 ] 00:11:24.788 } 00:11:24.788 ] 00:11:24.788 }' 00:11:24.788 11:35:44 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:24.788 11:35:44 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:24.788 11:35:44 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:24.788 11:35:44 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:24.788 11:35:44 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:24.788 11:35:44 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:24.788 11:35:44 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:24.788 11:35:44 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:24.788 11:35:44 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:24.788 11:35:44 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:24.788 11:35:44 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:24.788 11:35:44 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:24.788 11:35:44 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:24.788 11:35:44 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:24.788 11:35:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:24.788 11:35:44 -- common/autotest_common.sh@10 -- # set +x 00:11:25.046 Malloc1 00:11:25.046 11:35:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.046 11:35:44 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:25.046 11:35:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.046 11:35:44 -- common/autotest_common.sh@10 -- # set +x 00:11:25.046 11:35:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.046 11:35:44 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:25.046 11:35:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.046 11:35:44 -- common/autotest_common.sh@10 -- # set +x 00:11:25.046 11:35:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.046 11:35:44 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:25.046 11:35:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.046 11:35:44 -- common/autotest_common.sh@10 -- # set +x 00:11:25.046 11:35:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.046 11:35:44 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:25.046 11:35:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.046 11:35:44 -- common/autotest_common.sh@10 -- # set +x 00:11:25.046 [2024-11-28 11:35:44.874089] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:25.046 11:35:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.046 11:35:44 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:25.046 11:35:44 -- common/autotest_common.sh@650 -- # local es=0 00:11:25.046 11:35:44 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:25.046 11:35:44 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:25.046 11:35:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:25.046 11:35:44 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:25.046 11:35:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:25.046 11:35:44 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:25.046 11:35:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:25.046 11:35:44 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:25.046 11:35:44 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:25.046 11:35:44 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:25.046 [2024-11-28 11:35:44.896609] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:25.046 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:25.046 could not add new controller: failed to write to nvme-fabrics device 00:11:25.046 11:35:44 -- common/autotest_common.sh@653 -- # es=1 00:11:25.046 11:35:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:25.046 11:35:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:25.046 11:35:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:25.046 11:35:44 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:25.046 11:35:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.046 11:35:44 -- common/autotest_common.sh@10 -- # set +x 00:11:25.046 11:35:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.046 11:35:44 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:25.609 11:35:45 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:25.609 11:35:45 -- common/autotest_common.sh@1187 -- # local i=0 00:11:25.609 11:35:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:25.609 11:35:45 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:25.609 11:35:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:28.135 11:35:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:28.135 11:35:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:28.135 11:35:47 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:28.135 11:35:47 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:28.135 11:35:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:28.135 11:35:47 -- common/autotest_common.sh@1197 -- # return 0 00:11:28.135 11:35:47 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:28.135 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.135 11:35:47 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:28.135 11:35:47 -- common/autotest_common.sh@1208 -- # local i=0 00:11:28.135 11:35:47 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:28.135 11:35:47 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:28.135 11:35:47 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:28.135 11:35:47 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:28.135 11:35:47 -- common/autotest_common.sh@1220 -- # return 0 00:11:28.135 11:35:47 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:28.135 11:35:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.135 11:35:47 -- common/autotest_common.sh@10 -- # set +x 00:11:28.135 11:35:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.135 11:35:47 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:28.135 11:35:47 -- common/autotest_common.sh@650 -- # local es=0 00:11:28.135 11:35:47 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:28.135 11:35:47 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:28.135 11:35:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:28.135 11:35:47 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:28.135 11:35:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:28.135 11:35:47 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:28.135 11:35:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:28.135 11:35:47 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:28.135 11:35:47 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:28.135 11:35:47 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:28.135 [2024-11-28 11:35:47.725643] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:28.135 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:28.135 could not add new controller: failed to write to nvme-fabrics device 00:11:28.135 11:35:47 -- common/autotest_common.sh@653 -- # es=1 00:11:28.135 11:35:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:28.135 11:35:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:28.135 11:35:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:28.135 11:35:47 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:28.135 11:35:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.135 11:35:47 -- common/autotest_common.sh@10 -- # set +x 00:11:28.136 11:35:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.136 11:35:47 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:28.394 11:35:48 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:28.394 11:35:48 -- common/autotest_common.sh@1187 -- # local i=0 00:11:28.394 11:35:48 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:28.394 11:35:48 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:28.394 11:35:48 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:30.923 11:35:50 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:30.923 11:35:50 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:30.923 11:35:50 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:30.923 11:35:50 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:30.923 11:35:50 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:30.923 11:35:50 -- common/autotest_common.sh@1197 -- # return 0 00:11:30.923 11:35:50 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:30.923 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.923 11:35:50 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:30.923 11:35:50 -- common/autotest_common.sh@1208 -- # local i=0 00:11:30.923 11:35:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:30.923 11:35:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:30.923 11:35:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:30.923 11:35:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:30.923 11:35:50 -- common/autotest_common.sh@1220 -- # return 0 00:11:30.923 11:35:50 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:30.923 11:35:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.923 11:35:50 -- common/autotest_common.sh@10 -- # set +x 00:11:30.923 11:35:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.923 11:35:50 -- target/rpc.sh@81 -- # seq 1 5 00:11:30.923 11:35:50 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:30.923 11:35:50 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:30.923 11:35:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.923 11:35:50 -- common/autotest_common.sh@10 -- # set +x 00:11:30.923 11:35:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.923 11:35:50 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:30.923 11:35:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.923 11:35:50 -- common/autotest_common.sh@10 -- # set +x 00:11:30.923 [2024-11-28 11:35:50.520813] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:30.923 11:35:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.923 11:35:50 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:30.923 11:35:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.923 11:35:50 -- common/autotest_common.sh@10 -- # set +x 00:11:30.923 11:35:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.924 11:35:50 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:30.924 11:35:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:30.924 11:35:50 -- common/autotest_common.sh@10 -- # set +x 00:11:30.924 11:35:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.924 11:35:50 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:31.182 11:35:51 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:31.182 11:35:51 -- common/autotest_common.sh@1187 -- # local i=0 00:11:31.182 11:35:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:31.182 11:35:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:31.182 11:35:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:33.710 11:35:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:33.710 11:35:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:33.710 11:35:53 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:33.710 11:35:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:33.710 11:35:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:33.710 11:35:53 -- common/autotest_common.sh@1197 -- # return 0 00:11:33.710 11:35:53 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:33.710 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.710 11:35:53 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:33.710 11:35:53 -- common/autotest_common.sh@1208 -- # local i=0 00:11:33.710 11:35:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:33.710 11:35:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:33.710 11:35:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:33.710 11:35:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:33.710 11:35:53 -- common/autotest_common.sh@1220 -- # return 0 00:11:33.710 11:35:53 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:33.710 11:35:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:33.710 11:35:53 -- common/autotest_common.sh@10 -- # set +x 00:11:33.710 11:35:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:33.710 11:35:53 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:33.710 11:35:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:33.710 11:35:53 -- common/autotest_common.sh@10 -- # set +x 00:11:33.710 11:35:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:33.710 11:35:53 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:33.710 11:35:53 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:33.710 11:35:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:33.710 11:35:53 -- common/autotest_common.sh@10 -- # set +x 00:11:33.710 11:35:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:33.710 11:35:53 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:33.710 11:35:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:33.710 11:35:53 -- common/autotest_common.sh@10 -- # set +x 00:11:33.710 [2024-11-28 11:35:53.349993] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:33.710 11:35:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:33.710 11:35:53 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:33.710 11:35:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:33.710 11:35:53 -- common/autotest_common.sh@10 -- # set +x 00:11:33.710 11:35:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:33.710 11:35:53 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:33.710 11:35:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:33.710 11:35:53 -- common/autotest_common.sh@10 -- # set +x 00:11:33.710 11:35:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:33.710 11:35:53 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:33.968 11:35:53 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:33.968 11:35:53 -- common/autotest_common.sh@1187 -- # local i=0 00:11:33.968 11:35:53 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:33.968 11:35:53 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:33.968 11:35:53 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:36.497 11:35:55 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:36.497 11:35:55 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:36.497 11:35:55 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:36.497 11:35:55 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:36.497 11:35:55 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:36.497 11:35:55 -- common/autotest_common.sh@1197 -- # return 0 00:11:36.497 11:35:55 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:36.497 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.497 11:35:56 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:36.497 11:35:56 -- common/autotest_common.sh@1208 -- # local i=0 00:11:36.497 11:35:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:36.497 11:35:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:36.497 11:35:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:36.497 11:35:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:36.497 11:35:56 -- common/autotest_common.sh@1220 -- # return 0 00:11:36.497 11:35:56 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:36.497 11:35:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:36.497 11:35:56 -- common/autotest_common.sh@10 -- # set +x 00:11:36.497 11:35:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:36.497 11:35:56 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:36.497 11:35:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:36.497 11:35:56 -- common/autotest_common.sh@10 -- # set +x 00:11:36.497 11:35:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:36.497 11:35:56 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:36.497 11:35:56 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:36.497 11:35:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:36.497 11:35:56 -- common/autotest_common.sh@10 -- # set +x 00:11:36.497 11:35:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:36.497 11:35:56 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:36.497 11:35:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:36.497 11:35:56 -- common/autotest_common.sh@10 -- # set +x 00:11:36.497 [2024-11-28 11:35:56.134145] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:36.497 11:35:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:36.497 11:35:56 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:36.497 11:35:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:36.497 11:35:56 -- common/autotest_common.sh@10 -- # set +x 00:11:36.497 11:35:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:36.497 11:35:56 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:36.497 11:35:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:36.497 11:35:56 -- common/autotest_common.sh@10 -- # set +x 00:11:36.497 11:35:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:36.497 11:35:56 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:37.064 11:35:56 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:37.064 11:35:56 -- common/autotest_common.sh@1187 -- # local i=0 00:11:37.064 11:35:56 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:37.064 11:35:56 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:37.064 11:35:56 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:38.960 11:35:58 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:38.960 11:35:58 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:38.960 11:35:58 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:38.960 11:35:58 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:38.960 11:35:58 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:38.960 11:35:58 -- common/autotest_common.sh@1197 -- # return 0 00:11:38.960 11:35:58 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:38.960 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:38.960 11:35:58 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:38.960 11:35:58 -- common/autotest_common.sh@1208 -- # local i=0 00:11:38.960 11:35:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:38.960 11:35:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:38.960 11:35:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:38.960 11:35:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:38.960 11:35:58 -- common/autotest_common.sh@1220 -- # return 0 00:11:38.960 11:35:58 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:38.960 11:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:38.960 11:35:58 -- common/autotest_common.sh@10 -- # set +x 00:11:38.960 11:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:38.960 11:35:58 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:38.960 11:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:38.960 11:35:58 -- common/autotest_common.sh@10 -- # set +x 00:11:38.960 11:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:38.960 11:35:58 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:38.960 11:35:58 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:38.960 11:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:38.960 11:35:58 -- common/autotest_common.sh@10 -- # set +x 00:11:38.960 11:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:38.960 11:35:58 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:38.960 11:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:38.960 11:35:58 -- common/autotest_common.sh@10 -- # set +x 00:11:38.960 [2024-11-28 11:35:58.959707] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:38.960 11:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:38.960 11:35:58 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:38.960 11:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:38.960 11:35:58 -- common/autotest_common.sh@10 -- # set +x 00:11:38.960 11:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:38.960 11:35:58 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:38.960 11:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:38.960 11:35:58 -- common/autotest_common.sh@10 -- # set +x 00:11:38.960 11:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:38.960 11:35:58 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:39.893 11:35:59 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:39.893 11:35:59 -- common/autotest_common.sh@1187 -- # local i=0 00:11:39.893 11:35:59 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:39.893 11:35:59 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:39.893 11:35:59 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:41.790 11:36:01 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:41.790 11:36:01 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:41.790 11:36:01 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:41.790 11:36:01 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:41.790 11:36:01 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:41.790 11:36:01 -- common/autotest_common.sh@1197 -- # return 0 00:11:41.790 11:36:01 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:41.790 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.790 11:36:01 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:41.790 11:36:01 -- common/autotest_common.sh@1208 -- # local i=0 00:11:41.790 11:36:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:41.790 11:36:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:41.790 11:36:01 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:41.790 11:36:01 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:41.790 11:36:01 -- common/autotest_common.sh@1220 -- # return 0 00:11:41.790 11:36:01 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:41.790 11:36:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:41.790 11:36:01 -- common/autotest_common.sh@10 -- # set +x 00:11:41.790 11:36:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:41.790 11:36:01 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:41.790 11:36:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:41.790 11:36:01 -- common/autotest_common.sh@10 -- # set +x 00:11:41.790 11:36:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:41.790 11:36:01 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:41.790 11:36:01 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:41.790 11:36:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:41.790 11:36:01 -- common/autotest_common.sh@10 -- # set +x 00:11:41.790 11:36:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:41.790 11:36:01 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:41.790 11:36:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:41.790 11:36:01 -- common/autotest_common.sh@10 -- # set +x 00:11:41.790 [2024-11-28 11:36:01.784597] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:41.790 11:36:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:41.790 11:36:01 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:41.790 11:36:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:41.790 11:36:01 -- common/autotest_common.sh@10 -- # set +x 00:11:41.790 11:36:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:41.790 11:36:01 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:41.790 11:36:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:41.790 11:36:01 -- common/autotest_common.sh@10 -- # set +x 00:11:41.790 11:36:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:41.790 11:36:01 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:42.723 11:36:02 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:42.723 11:36:02 -- common/autotest_common.sh@1187 -- # local i=0 00:11:42.723 11:36:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:42.723 11:36:02 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:42.723 11:36:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:44.621 11:36:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:44.621 11:36:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:44.621 11:36:04 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:44.621 11:36:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:44.621 11:36:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:44.621 11:36:04 -- common/autotest_common.sh@1197 -- # return 0 00:11:44.621 11:36:04 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:44.621 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.621 11:36:04 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:44.621 11:36:04 -- common/autotest_common.sh@1208 -- # local i=0 00:11:44.621 11:36:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:44.621 11:36:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:44.621 11:36:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:44.621 11:36:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:44.621 11:36:04 -- common/autotest_common.sh@1220 -- # return 0 00:11:44.621 11:36:04 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:44.621 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.621 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.621 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.621 11:36:04 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:44.621 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.621 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.621 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.621 11:36:04 -- target/rpc.sh@99 -- # seq 1 5 00:11:44.621 11:36:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:44.621 11:36:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:44.621 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.621 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.621 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.621 11:36:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:44.621 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.621 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.621 [2024-11-28 11:36:04.610072] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:44.621 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.621 11:36:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:44.621 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.621 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.621 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.621 11:36:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:44.621 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.621 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.621 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.621 11:36:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:44.621 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.621 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.621 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.621 11:36:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:44.621 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.621 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.621 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.621 11:36:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:44.621 11:36:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:44.621 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.621 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.621 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.621 11:36:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:44.621 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.621 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.621 [2024-11-28 11:36:04.658120] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:44.621 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.621 11:36:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:44.621 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.621 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.621 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.621 11:36:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:44.621 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.621 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:44.879 11:36:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 [2024-11-28 11:36:04.706280] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:44.879 11:36:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 [2024-11-28 11:36:04.754443] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:44.879 11:36:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 [2024-11-28 11:36:04.802630] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:11:44.879 11:36:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:44.879 11:36:04 -- common/autotest_common.sh@10 -- # set +x 00:11:44.879 11:36:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:44.879 11:36:04 -- target/rpc.sh@110 -- # stats='{ 00:11:44.879 "tick_rate": 2700000000, 00:11:44.879 "poll_groups": [ 00:11:44.879 { 00:11:44.879 "name": "nvmf_tgt_poll_group_0", 00:11:44.879 "admin_qpairs": 2, 00:11:44.879 "io_qpairs": 84, 00:11:44.879 "current_admin_qpairs": 0, 00:11:44.879 "current_io_qpairs": 0, 00:11:44.879 "pending_bdev_io": 0, 00:11:44.879 "completed_nvme_io": 183, 00:11:44.879 "transports": [ 00:11:44.879 { 00:11:44.879 "trtype": "TCP" 00:11:44.879 } 00:11:44.879 ] 00:11:44.879 }, 00:11:44.879 { 00:11:44.879 "name": "nvmf_tgt_poll_group_1", 00:11:44.879 "admin_qpairs": 2, 00:11:44.879 "io_qpairs": 84, 00:11:44.879 "current_admin_qpairs": 0, 00:11:44.879 "current_io_qpairs": 0, 00:11:44.879 "pending_bdev_io": 0, 00:11:44.879 "completed_nvme_io": 182, 00:11:44.879 "transports": [ 00:11:44.879 { 00:11:44.879 "trtype": "TCP" 00:11:44.879 } 00:11:44.879 ] 00:11:44.879 }, 00:11:44.879 { 00:11:44.879 "name": "nvmf_tgt_poll_group_2", 00:11:44.879 "admin_qpairs": 1, 00:11:44.879 "io_qpairs": 84, 00:11:44.879 "current_admin_qpairs": 0, 00:11:44.879 "current_io_qpairs": 0, 00:11:44.879 "pending_bdev_io": 0, 00:11:44.879 "completed_nvme_io": 183, 00:11:44.879 "transports": [ 00:11:44.879 { 00:11:44.879 "trtype": "TCP" 00:11:44.879 } 00:11:44.879 ] 00:11:44.879 }, 00:11:44.879 { 00:11:44.879 "name": "nvmf_tgt_poll_group_3", 00:11:44.879 "admin_qpairs": 2, 00:11:44.879 "io_qpairs": 84, 00:11:44.879 "current_admin_qpairs": 0, 00:11:44.879 "current_io_qpairs": 0, 00:11:44.879 "pending_bdev_io": 0, 00:11:44.879 "completed_nvme_io": 138, 00:11:44.879 "transports": [ 00:11:44.879 { 00:11:44.879 "trtype": "TCP" 00:11:44.879 } 00:11:44.879 ] 00:11:44.879 } 00:11:44.879 ] 00:11:44.879 }' 00:11:44.879 11:36:04 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:11:44.879 11:36:04 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:44.880 11:36:04 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:44.880 11:36:04 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:44.880 11:36:04 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:11:44.880 11:36:04 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:11:44.880 11:36:04 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:44.880 11:36:04 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:44.880 11:36:04 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:45.136 11:36:04 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:11:45.136 11:36:04 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:11:45.136 11:36:04 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:11:45.136 11:36:04 -- target/rpc.sh@123 -- # nvmftestfini 00:11:45.136 11:36:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:45.136 11:36:04 -- nvmf/common.sh@116 -- # sync 00:11:45.136 11:36:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:45.136 11:36:04 -- nvmf/common.sh@119 -- # set +e 00:11:45.136 11:36:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:45.136 11:36:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:45.136 rmmod nvme_tcp 00:11:45.136 rmmod nvme_fabrics 00:11:45.136 rmmod nvme_keyring 00:11:45.136 11:36:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:45.136 11:36:05 -- nvmf/common.sh@123 -- # set -e 00:11:45.136 11:36:05 -- nvmf/common.sh@124 -- # return 0 00:11:45.136 11:36:05 -- nvmf/common.sh@477 -- # '[' -n 3753323 ']' 00:11:45.136 11:36:05 -- nvmf/common.sh@478 -- # killprocess 3753323 00:11:45.136 11:36:05 -- common/autotest_common.sh@936 -- # '[' -z 3753323 ']' 00:11:45.136 11:36:05 -- common/autotest_common.sh@940 -- # kill -0 3753323 00:11:45.136 11:36:05 -- common/autotest_common.sh@941 -- # uname 00:11:45.136 11:36:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:45.136 11:36:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3753323 00:11:45.136 11:36:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:45.136 11:36:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:45.136 11:36:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3753323' 00:11:45.136 killing process with pid 3753323 00:11:45.136 11:36:05 -- common/autotest_common.sh@955 -- # kill 3753323 00:11:45.136 11:36:05 -- common/autotest_common.sh@960 -- # wait 3753323 00:11:45.393 11:36:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:45.393 11:36:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:45.393 11:36:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:45.393 11:36:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:45.393 11:36:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:45.393 11:36:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:45.393 11:36:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:45.393 11:36:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:47.930 11:36:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:47.930 00:11:47.930 real 0m26.186s 00:11:47.930 user 1m25.868s 00:11:47.930 sys 0m4.082s 00:11:47.930 11:36:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:47.930 11:36:07 -- common/autotest_common.sh@10 -- # set +x 00:11:47.930 ************************************ 00:11:47.930 END TEST nvmf_rpc 00:11:47.930 ************************************ 00:11:47.930 11:36:07 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:47.930 11:36:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:47.930 11:36:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:47.930 11:36:07 -- common/autotest_common.sh@10 -- # set +x 00:11:47.930 ************************************ 00:11:47.930 START TEST nvmf_invalid 00:11:47.930 ************************************ 00:11:47.930 11:36:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:47.930 * Looking for test storage... 00:11:47.930 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:47.930 11:36:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:47.930 11:36:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:47.930 11:36:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:47.930 11:36:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:47.930 11:36:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:47.930 11:36:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:47.930 11:36:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:47.930 11:36:07 -- scripts/common.sh@335 -- # IFS=.-: 00:11:47.930 11:36:07 -- scripts/common.sh@335 -- # read -ra ver1 00:11:47.930 11:36:07 -- scripts/common.sh@336 -- # IFS=.-: 00:11:47.930 11:36:07 -- scripts/common.sh@336 -- # read -ra ver2 00:11:47.930 11:36:07 -- scripts/common.sh@337 -- # local 'op=<' 00:11:47.930 11:36:07 -- scripts/common.sh@339 -- # ver1_l=2 00:11:47.930 11:36:07 -- scripts/common.sh@340 -- # ver2_l=1 00:11:47.930 11:36:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:47.930 11:36:07 -- scripts/common.sh@343 -- # case "$op" in 00:11:47.930 11:36:07 -- scripts/common.sh@344 -- # : 1 00:11:47.930 11:36:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:47.931 11:36:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:47.931 11:36:07 -- scripts/common.sh@364 -- # decimal 1 00:11:47.931 11:36:07 -- scripts/common.sh@352 -- # local d=1 00:11:47.931 11:36:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:47.931 11:36:07 -- scripts/common.sh@354 -- # echo 1 00:11:47.931 11:36:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:47.931 11:36:07 -- scripts/common.sh@365 -- # decimal 2 00:11:47.931 11:36:07 -- scripts/common.sh@352 -- # local d=2 00:11:47.931 11:36:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:47.931 11:36:07 -- scripts/common.sh@354 -- # echo 2 00:11:47.931 11:36:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:47.931 11:36:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:47.931 11:36:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:47.931 11:36:07 -- scripts/common.sh@367 -- # return 0 00:11:47.931 11:36:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:47.931 11:36:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:47.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:47.931 --rc genhtml_branch_coverage=1 00:11:47.931 --rc genhtml_function_coverage=1 00:11:47.931 --rc genhtml_legend=1 00:11:47.931 --rc geninfo_all_blocks=1 00:11:47.931 --rc geninfo_unexecuted_blocks=1 00:11:47.931 00:11:47.931 ' 00:11:47.931 11:36:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:47.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:47.931 --rc genhtml_branch_coverage=1 00:11:47.931 --rc genhtml_function_coverage=1 00:11:47.931 --rc genhtml_legend=1 00:11:47.931 --rc geninfo_all_blocks=1 00:11:47.931 --rc geninfo_unexecuted_blocks=1 00:11:47.931 00:11:47.931 ' 00:11:47.931 11:36:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:47.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:47.931 --rc genhtml_branch_coverage=1 00:11:47.931 --rc genhtml_function_coverage=1 00:11:47.931 --rc genhtml_legend=1 00:11:47.931 --rc geninfo_all_blocks=1 00:11:47.931 --rc geninfo_unexecuted_blocks=1 00:11:47.931 00:11:47.931 ' 00:11:47.931 11:36:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:47.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:47.931 --rc genhtml_branch_coverage=1 00:11:47.931 --rc genhtml_function_coverage=1 00:11:47.931 --rc genhtml_legend=1 00:11:47.931 --rc geninfo_all_blocks=1 00:11:47.931 --rc geninfo_unexecuted_blocks=1 00:11:47.931 00:11:47.931 ' 00:11:47.931 11:36:07 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:47.931 11:36:07 -- nvmf/common.sh@7 -- # uname -s 00:11:47.931 11:36:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:47.931 11:36:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:47.931 11:36:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:47.931 11:36:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:47.931 11:36:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:47.931 11:36:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:47.931 11:36:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:47.931 11:36:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:47.931 11:36:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:47.931 11:36:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:47.931 11:36:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:47.931 11:36:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:47.931 11:36:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:47.931 11:36:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:47.931 11:36:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:47.931 11:36:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:47.931 11:36:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:47.931 11:36:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:47.931 11:36:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:47.931 11:36:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:47.931 11:36:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:47.931 11:36:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:47.931 11:36:07 -- paths/export.sh@5 -- # export PATH 00:11:47.931 11:36:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:47.931 11:36:07 -- nvmf/common.sh@46 -- # : 0 00:11:47.931 11:36:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:47.931 11:36:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:47.931 11:36:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:47.931 11:36:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:47.931 11:36:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:47.931 11:36:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:47.931 11:36:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:47.931 11:36:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:47.931 11:36:07 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:47.931 11:36:07 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:11:47.931 11:36:07 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:11:47.931 11:36:07 -- target/invalid.sh@14 -- # target=foobar 00:11:47.931 11:36:07 -- target/invalid.sh@16 -- # RANDOM=0 00:11:47.931 11:36:07 -- target/invalid.sh@34 -- # nvmftestinit 00:11:47.931 11:36:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:47.931 11:36:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:47.931 11:36:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:47.931 11:36:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:47.931 11:36:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:47.931 11:36:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:47.931 11:36:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:47.931 11:36:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:47.931 11:36:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:47.931 11:36:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:47.931 11:36:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:47.931 11:36:07 -- common/autotest_common.sh@10 -- # set +x 00:11:49.832 11:36:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:49.832 11:36:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:49.832 11:36:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:49.832 11:36:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:49.832 11:36:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:49.832 11:36:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:49.832 11:36:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:49.832 11:36:09 -- nvmf/common.sh@294 -- # net_devs=() 00:11:49.832 11:36:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:49.832 11:36:09 -- nvmf/common.sh@295 -- # e810=() 00:11:49.832 11:36:09 -- nvmf/common.sh@295 -- # local -ga e810 00:11:49.832 11:36:09 -- nvmf/common.sh@296 -- # x722=() 00:11:49.832 11:36:09 -- nvmf/common.sh@296 -- # local -ga x722 00:11:49.832 11:36:09 -- nvmf/common.sh@297 -- # mlx=() 00:11:49.832 11:36:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:49.832 11:36:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:49.832 11:36:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:49.832 11:36:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:49.832 11:36:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:49.832 11:36:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:49.832 11:36:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:49.832 11:36:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:49.832 11:36:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:49.832 11:36:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:49.832 11:36:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:49.832 11:36:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:49.832 11:36:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:49.832 11:36:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:49.832 11:36:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:49.832 11:36:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:49.832 11:36:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:49.832 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:49.832 11:36:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:49.832 11:36:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:49.832 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:49.832 11:36:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:49.832 11:36:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:49.832 11:36:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:49.832 11:36:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:49.832 11:36:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:49.832 11:36:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:49.832 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:49.832 11:36:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:49.832 11:36:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:49.832 11:36:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:49.832 11:36:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:49.832 11:36:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:49.832 11:36:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:49.832 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:49.832 11:36:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:49.832 11:36:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:49.832 11:36:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:49.832 11:36:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:49.832 11:36:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:49.832 11:36:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:49.832 11:36:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:49.832 11:36:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:49.832 11:36:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:49.832 11:36:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:49.832 11:36:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:49.832 11:36:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:49.832 11:36:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:49.832 11:36:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:49.832 11:36:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:49.832 11:36:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:49.832 11:36:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:49.832 11:36:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:49.832 11:36:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:49.832 11:36:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:49.832 11:36:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:49.832 11:36:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:49.832 11:36:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:49.832 11:36:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:49.832 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:49.832 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.175 ms 00:11:49.832 00:11:49.832 --- 10.0.0.2 ping statistics --- 00:11:49.832 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:49.832 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:11:49.832 11:36:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:49.832 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:49.832 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:11:49.832 00:11:49.832 --- 10.0.0.1 ping statistics --- 00:11:49.832 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:49.832 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:11:49.832 11:36:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:49.832 11:36:09 -- nvmf/common.sh@410 -- # return 0 00:11:49.832 11:36:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:49.832 11:36:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:49.832 11:36:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:49.832 11:36:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:49.832 11:36:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:49.832 11:36:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:49.832 11:36:09 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:11:49.832 11:36:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:49.832 11:36:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:49.832 11:36:09 -- common/autotest_common.sh@10 -- # set +x 00:11:49.832 11:36:09 -- nvmf/common.sh@469 -- # nvmfpid=3758657 00:11:49.832 11:36:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:49.833 11:36:09 -- nvmf/common.sh@470 -- # waitforlisten 3758657 00:11:49.833 11:36:09 -- common/autotest_common.sh@829 -- # '[' -z 3758657 ']' 00:11:49.833 11:36:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:49.833 11:36:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:49.833 11:36:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:49.833 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:49.833 11:36:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:49.833 11:36:09 -- common/autotest_common.sh@10 -- # set +x 00:11:49.833 [2024-11-28 11:36:09.681797] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:49.833 [2024-11-28 11:36:09.681897] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:49.833 EAL: No free 2048 kB hugepages reported on node 1 00:11:49.833 [2024-11-28 11:36:09.748933] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:49.833 [2024-11-28 11:36:09.868878] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:49.833 [2024-11-28 11:36:09.869042] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:49.833 [2024-11-28 11:36:09.869061] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:49.833 [2024-11-28 11:36:09.869076] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:49.833 [2024-11-28 11:36:09.869134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:49.833 [2024-11-28 11:36:09.869166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:49.833 [2024-11-28 11:36:09.869230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:49.833 [2024-11-28 11:36:09.869234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:50.766 11:36:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:50.766 11:36:10 -- common/autotest_common.sh@862 -- # return 0 00:11:50.766 11:36:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:50.766 11:36:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:50.766 11:36:10 -- common/autotest_common.sh@10 -- # set +x 00:11:50.766 11:36:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:50.766 11:36:10 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:50.766 11:36:10 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode27891 00:11:51.023 [2024-11-28 11:36:10.894698] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:11:51.023 11:36:10 -- target/invalid.sh@40 -- # out='request: 00:11:51.023 { 00:11:51.023 "nqn": "nqn.2016-06.io.spdk:cnode27891", 00:11:51.023 "tgt_name": "foobar", 00:11:51.023 "method": "nvmf_create_subsystem", 00:11:51.023 "req_id": 1 00:11:51.023 } 00:11:51.023 Got JSON-RPC error response 00:11:51.023 response: 00:11:51.023 { 00:11:51.023 "code": -32603, 00:11:51.023 "message": "Unable to find target foobar" 00:11:51.023 }' 00:11:51.023 11:36:10 -- target/invalid.sh@41 -- # [[ request: 00:11:51.023 { 00:11:51.023 "nqn": "nqn.2016-06.io.spdk:cnode27891", 00:11:51.023 "tgt_name": "foobar", 00:11:51.023 "method": "nvmf_create_subsystem", 00:11:51.023 "req_id": 1 00:11:51.023 } 00:11:51.023 Got JSON-RPC error response 00:11:51.023 response: 00:11:51.023 { 00:11:51.023 "code": -32603, 00:11:51.023 "message": "Unable to find target foobar" 00:11:51.023 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:11:51.023 11:36:10 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:11:51.023 11:36:10 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode31135 00:11:51.280 [2024-11-28 11:36:11.159598] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode31135: invalid serial number 'SPDKISFASTANDAWESOME' 00:11:51.280 11:36:11 -- target/invalid.sh@45 -- # out='request: 00:11:51.280 { 00:11:51.280 "nqn": "nqn.2016-06.io.spdk:cnode31135", 00:11:51.280 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:51.280 "method": "nvmf_create_subsystem", 00:11:51.280 "req_id": 1 00:11:51.280 } 00:11:51.280 Got JSON-RPC error response 00:11:51.280 response: 00:11:51.280 { 00:11:51.280 "code": -32602, 00:11:51.280 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:51.280 }' 00:11:51.280 11:36:11 -- target/invalid.sh@46 -- # [[ request: 00:11:51.280 { 00:11:51.280 "nqn": "nqn.2016-06.io.spdk:cnode31135", 00:11:51.280 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:51.280 "method": "nvmf_create_subsystem", 00:11:51.280 "req_id": 1 00:11:51.280 } 00:11:51.280 Got JSON-RPC error response 00:11:51.280 response: 00:11:51.280 { 00:11:51.280 "code": -32602, 00:11:51.280 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:51.280 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:51.280 11:36:11 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:11:51.280 11:36:11 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode3517 00:11:51.538 [2024-11-28 11:36:11.416422] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode3517: invalid model number 'SPDK_Controller' 00:11:51.538 11:36:11 -- target/invalid.sh@50 -- # out='request: 00:11:51.538 { 00:11:51.538 "nqn": "nqn.2016-06.io.spdk:cnode3517", 00:11:51.538 "model_number": "SPDK_Controller\u001f", 00:11:51.538 "method": "nvmf_create_subsystem", 00:11:51.538 "req_id": 1 00:11:51.538 } 00:11:51.538 Got JSON-RPC error response 00:11:51.538 response: 00:11:51.538 { 00:11:51.538 "code": -32602, 00:11:51.538 "message": "Invalid MN SPDK_Controller\u001f" 00:11:51.538 }' 00:11:51.538 11:36:11 -- target/invalid.sh@51 -- # [[ request: 00:11:51.538 { 00:11:51.538 "nqn": "nqn.2016-06.io.spdk:cnode3517", 00:11:51.538 "model_number": "SPDK_Controller\u001f", 00:11:51.538 "method": "nvmf_create_subsystem", 00:11:51.538 "req_id": 1 00:11:51.538 } 00:11:51.538 Got JSON-RPC error response 00:11:51.538 response: 00:11:51.538 { 00:11:51.538 "code": -32602, 00:11:51.538 "message": "Invalid MN SPDK_Controller\u001f" 00:11:51.538 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:11:51.538 11:36:11 -- target/invalid.sh@54 -- # gen_random_s 21 00:11:51.538 11:36:11 -- target/invalid.sh@19 -- # local length=21 ll 00:11:51.538 11:36:11 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:51.538 11:36:11 -- target/invalid.sh@21 -- # local chars 00:11:51.538 11:36:11 -- target/invalid.sh@22 -- # local string 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 72 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x48' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+=H 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 76 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+=L 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 114 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x72' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+=r 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 103 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x67' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+=g 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 104 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x68' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+=h 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 111 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+=o 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 79 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+=O 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 62 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+='>' 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 47 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+=/ 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 40 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x28' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+='(' 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 82 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x52' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+=R 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 119 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x77' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+=w 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 117 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x75' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+=u 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 121 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x79' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+=y 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 72 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x48' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+=H 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # printf %x 85 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x55' 00:11:51.538 11:36:11 -- target/invalid.sh@25 -- # string+=U 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.538 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # printf %x 57 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x39' 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # string+=9 00:11:51.539 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.539 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # printf %x 33 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x21' 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # string+='!' 00:11:51.539 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.539 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # printf %x 92 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # string+='\' 00:11:51.539 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.539 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # printf %x 66 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x42' 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # string+=B 00:11:51.539 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.539 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # printf %x 54 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x36' 00:11:51.539 11:36:11 -- target/invalid.sh@25 -- # string+=6 00:11:51.539 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.539 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.539 11:36:11 -- target/invalid.sh@28 -- # [[ H == \- ]] 00:11:51.539 11:36:11 -- target/invalid.sh@31 -- # echo 'HLrghoO>/(RwuyHU9!\B6' 00:11:51.539 11:36:11 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'HLrghoO>/(RwuyHU9!\B6' nqn.2016-06.io.spdk:cnode2648 00:11:51.797 [2024-11-28 11:36:11.749518] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2648: invalid serial number 'HLrghoO>/(RwuyHU9!\B6' 00:11:51.797 11:36:11 -- target/invalid.sh@54 -- # out='request: 00:11:51.797 { 00:11:51.797 "nqn": "nqn.2016-06.io.spdk:cnode2648", 00:11:51.797 "serial_number": "HLrghoO>/(RwuyHU9!\\B6", 00:11:51.797 "method": "nvmf_create_subsystem", 00:11:51.797 "req_id": 1 00:11:51.797 } 00:11:51.797 Got JSON-RPC error response 00:11:51.797 response: 00:11:51.797 { 00:11:51.797 "code": -32602, 00:11:51.797 "message": "Invalid SN HLrghoO>/(RwuyHU9!\\B6" 00:11:51.797 }' 00:11:51.797 11:36:11 -- target/invalid.sh@55 -- # [[ request: 00:11:51.797 { 00:11:51.797 "nqn": "nqn.2016-06.io.spdk:cnode2648", 00:11:51.797 "serial_number": "HLrghoO>/(RwuyHU9!\\B6", 00:11:51.797 "method": "nvmf_create_subsystem", 00:11:51.797 "req_id": 1 00:11:51.797 } 00:11:51.797 Got JSON-RPC error response 00:11:51.797 response: 00:11:51.797 { 00:11:51.797 "code": -32602, 00:11:51.797 "message": "Invalid SN HLrghoO>/(RwuyHU9!\\B6" 00:11:51.797 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:51.797 11:36:11 -- target/invalid.sh@58 -- # gen_random_s 41 00:11:51.797 11:36:11 -- target/invalid.sh@19 -- # local length=41 ll 00:11:51.797 11:36:11 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:51.797 11:36:11 -- target/invalid.sh@21 -- # local chars 00:11:51.797 11:36:11 -- target/invalid.sh@22 -- # local string 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 62 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+='>' 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 107 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+=k 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 34 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x22' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+='"' 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 76 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+=L 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 66 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x42' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+=B 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 33 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x21' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+='!' 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 67 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x43' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+=C 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 52 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x34' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+=4 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 36 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x24' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+='$' 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 107 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+=k 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 106 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+=j 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 64 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x40' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+=@ 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 59 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+=';' 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 111 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+=o 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 82 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x52' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+=R 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 63 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+='?' 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # printf %x 64 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x40' 00:11:51.797 11:36:11 -- target/invalid.sh@25 -- # string+=@ 00:11:51.797 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.798 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.798 11:36:11 -- target/invalid.sh@25 -- # printf %x 56 00:11:51.798 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x38' 00:11:51.798 11:36:11 -- target/invalid.sh@25 -- # string+=8 00:11:51.798 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.798 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.798 11:36:11 -- target/invalid.sh@25 -- # printf %x 53 00:11:51.798 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x35' 00:11:51.798 11:36:11 -- target/invalid.sh@25 -- # string+=5 00:11:51.798 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.798 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.798 11:36:11 -- target/invalid.sh@25 -- # printf %x 111 00:11:51.798 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:11:51.798 11:36:11 -- target/invalid.sh@25 -- # string+=o 00:11:51.798 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.798 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.798 11:36:11 -- target/invalid.sh@25 -- # printf %x 61 00:11:51.798 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:11:51.798 11:36:11 -- target/invalid.sh@25 -- # string+== 00:11:51.798 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.798 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 77 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=M 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 90 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=Z 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 49 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x31' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=1 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 104 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x68' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=h 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 126 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+='~' 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 123 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+='{' 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 109 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=m 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 38 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x26' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+='&' 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 61 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+== 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 86 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x56' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=V 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 74 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=J 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 67 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x43' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=C 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 83 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x53' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=S 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 78 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=N 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 46 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=. 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 122 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=z 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 85 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x55' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=U 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 95 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=_ 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 52 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x34' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=4 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # printf %x 105 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # echo -e '\x69' 00:11:52.057 11:36:11 -- target/invalid.sh@25 -- # string+=i 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.057 11:36:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.057 11:36:11 -- target/invalid.sh@28 -- # [[ > == \- ]] 00:11:52.057 11:36:11 -- target/invalid.sh@31 -- # echo '>k"LB!C4$kj@;oR?@85o=MZ1h~{m&=VJCSN.zU_4i' 00:11:52.057 11:36:11 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d '>k"LB!C4$kj@;oR?@85o=MZ1h~{m&=VJCSN.zU_4i' nqn.2016-06.io.spdk:cnode2796 00:11:52.319 [2024-11-28 11:36:12.174991] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2796: invalid model number '>k"LB!C4$kj@;oR?@85o=MZ1h~{m&=VJCSN.zU_4i' 00:11:52.319 11:36:12 -- target/invalid.sh@58 -- # out='request: 00:11:52.319 { 00:11:52.319 "nqn": "nqn.2016-06.io.spdk:cnode2796", 00:11:52.319 "model_number": ">k\"LB!C4$kj@;oR?@85o=MZ1h~{m&=VJCSN.zU_4i", 00:11:52.319 "method": "nvmf_create_subsystem", 00:11:52.319 "req_id": 1 00:11:52.319 } 00:11:52.319 Got JSON-RPC error response 00:11:52.319 response: 00:11:52.319 { 00:11:52.319 "code": -32602, 00:11:52.319 "message": "Invalid MN >k\"LB!C4$kj@;oR?@85o=MZ1h~{m&=VJCSN.zU_4i" 00:11:52.319 }' 00:11:52.319 11:36:12 -- target/invalid.sh@59 -- # [[ request: 00:11:52.319 { 00:11:52.319 "nqn": "nqn.2016-06.io.spdk:cnode2796", 00:11:52.319 "model_number": ">k\"LB!C4$kj@;oR?@85o=MZ1h~{m&=VJCSN.zU_4i", 00:11:52.319 "method": "nvmf_create_subsystem", 00:11:52.319 "req_id": 1 00:11:52.319 } 00:11:52.319 Got JSON-RPC error response 00:11:52.319 response: 00:11:52.319 { 00:11:52.319 "code": -32602, 00:11:52.319 "message": "Invalid MN >k\"LB!C4$kj@;oR?@85o=MZ1h~{m&=VJCSN.zU_4i" 00:11:52.319 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:11:52.319 11:36:12 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:11:52.577 [2024-11-28 11:36:12.419879] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:52.577 11:36:12 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:11:52.835 11:36:12 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:11:52.835 11:36:12 -- target/invalid.sh@67 -- # echo '' 00:11:52.835 11:36:12 -- target/invalid.sh@67 -- # head -n 1 00:11:52.835 11:36:12 -- target/invalid.sh@67 -- # IP= 00:11:52.835 11:36:12 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:11:53.093 [2024-11-28 11:36:12.925594] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:11:53.093 11:36:12 -- target/invalid.sh@69 -- # out='request: 00:11:53.093 { 00:11:53.093 "nqn": "nqn.2016-06.io.spdk:cnode", 00:11:53.093 "listen_address": { 00:11:53.093 "trtype": "tcp", 00:11:53.093 "traddr": "", 00:11:53.093 "trsvcid": "4421" 00:11:53.093 }, 00:11:53.093 "method": "nvmf_subsystem_remove_listener", 00:11:53.093 "req_id": 1 00:11:53.093 } 00:11:53.093 Got JSON-RPC error response 00:11:53.093 response: 00:11:53.093 { 00:11:53.093 "code": -32602, 00:11:53.093 "message": "Invalid parameters" 00:11:53.093 }' 00:11:53.093 11:36:12 -- target/invalid.sh@70 -- # [[ request: 00:11:53.093 { 00:11:53.093 "nqn": "nqn.2016-06.io.spdk:cnode", 00:11:53.093 "listen_address": { 00:11:53.093 "trtype": "tcp", 00:11:53.093 "traddr": "", 00:11:53.093 "trsvcid": "4421" 00:11:53.093 }, 00:11:53.093 "method": "nvmf_subsystem_remove_listener", 00:11:53.093 "req_id": 1 00:11:53.093 } 00:11:53.093 Got JSON-RPC error response 00:11:53.093 response: 00:11:53.093 { 00:11:53.093 "code": -32602, 00:11:53.093 "message": "Invalid parameters" 00:11:53.093 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:11:53.093 11:36:12 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode196 -i 0 00:11:53.351 [2024-11-28 11:36:13.174391] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode196: invalid cntlid range [0-65519] 00:11:53.351 11:36:13 -- target/invalid.sh@73 -- # out='request: 00:11:53.351 { 00:11:53.351 "nqn": "nqn.2016-06.io.spdk:cnode196", 00:11:53.351 "min_cntlid": 0, 00:11:53.351 "method": "nvmf_create_subsystem", 00:11:53.351 "req_id": 1 00:11:53.351 } 00:11:53.351 Got JSON-RPC error response 00:11:53.351 response: 00:11:53.351 { 00:11:53.351 "code": -32602, 00:11:53.351 "message": "Invalid cntlid range [0-65519]" 00:11:53.351 }' 00:11:53.351 11:36:13 -- target/invalid.sh@74 -- # [[ request: 00:11:53.351 { 00:11:53.351 "nqn": "nqn.2016-06.io.spdk:cnode196", 00:11:53.351 "min_cntlid": 0, 00:11:53.351 "method": "nvmf_create_subsystem", 00:11:53.351 "req_id": 1 00:11:53.351 } 00:11:53.351 Got JSON-RPC error response 00:11:53.351 response: 00:11:53.351 { 00:11:53.351 "code": -32602, 00:11:53.351 "message": "Invalid cntlid range [0-65519]" 00:11:53.352 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:53.352 11:36:13 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode14421 -i 65520 00:11:53.609 [2024-11-28 11:36:13.439300] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14421: invalid cntlid range [65520-65519] 00:11:53.609 11:36:13 -- target/invalid.sh@75 -- # out='request: 00:11:53.609 { 00:11:53.609 "nqn": "nqn.2016-06.io.spdk:cnode14421", 00:11:53.609 "min_cntlid": 65520, 00:11:53.609 "method": "nvmf_create_subsystem", 00:11:53.609 "req_id": 1 00:11:53.609 } 00:11:53.609 Got JSON-RPC error response 00:11:53.609 response: 00:11:53.609 { 00:11:53.609 "code": -32602, 00:11:53.609 "message": "Invalid cntlid range [65520-65519]" 00:11:53.609 }' 00:11:53.609 11:36:13 -- target/invalid.sh@76 -- # [[ request: 00:11:53.609 { 00:11:53.609 "nqn": "nqn.2016-06.io.spdk:cnode14421", 00:11:53.609 "min_cntlid": 65520, 00:11:53.609 "method": "nvmf_create_subsystem", 00:11:53.609 "req_id": 1 00:11:53.609 } 00:11:53.609 Got JSON-RPC error response 00:11:53.609 response: 00:11:53.609 { 00:11:53.609 "code": -32602, 00:11:53.609 "message": "Invalid cntlid range [65520-65519]" 00:11:53.609 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:53.609 11:36:13 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode29288 -I 0 00:11:53.868 [2024-11-28 11:36:13.692149] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode29288: invalid cntlid range [1-0] 00:11:53.868 11:36:13 -- target/invalid.sh@77 -- # out='request: 00:11:53.868 { 00:11:53.868 "nqn": "nqn.2016-06.io.spdk:cnode29288", 00:11:53.868 "max_cntlid": 0, 00:11:53.868 "method": "nvmf_create_subsystem", 00:11:53.868 "req_id": 1 00:11:53.868 } 00:11:53.868 Got JSON-RPC error response 00:11:53.868 response: 00:11:53.868 { 00:11:53.868 "code": -32602, 00:11:53.868 "message": "Invalid cntlid range [1-0]" 00:11:53.868 }' 00:11:53.868 11:36:13 -- target/invalid.sh@78 -- # [[ request: 00:11:53.868 { 00:11:53.868 "nqn": "nqn.2016-06.io.spdk:cnode29288", 00:11:53.868 "max_cntlid": 0, 00:11:53.868 "method": "nvmf_create_subsystem", 00:11:53.868 "req_id": 1 00:11:53.868 } 00:11:53.868 Got JSON-RPC error response 00:11:53.868 response: 00:11:53.868 { 00:11:53.868 "code": -32602, 00:11:53.868 "message": "Invalid cntlid range [1-0]" 00:11:53.868 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:53.868 11:36:13 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9657 -I 65520 00:11:54.126 [2024-11-28 11:36:13.953023] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9657: invalid cntlid range [1-65520] 00:11:54.126 11:36:13 -- target/invalid.sh@79 -- # out='request: 00:11:54.126 { 00:11:54.126 "nqn": "nqn.2016-06.io.spdk:cnode9657", 00:11:54.126 "max_cntlid": 65520, 00:11:54.126 "method": "nvmf_create_subsystem", 00:11:54.126 "req_id": 1 00:11:54.126 } 00:11:54.126 Got JSON-RPC error response 00:11:54.126 response: 00:11:54.126 { 00:11:54.126 "code": -32602, 00:11:54.126 "message": "Invalid cntlid range [1-65520]" 00:11:54.126 }' 00:11:54.126 11:36:13 -- target/invalid.sh@80 -- # [[ request: 00:11:54.126 { 00:11:54.126 "nqn": "nqn.2016-06.io.spdk:cnode9657", 00:11:54.126 "max_cntlid": 65520, 00:11:54.126 "method": "nvmf_create_subsystem", 00:11:54.126 "req_id": 1 00:11:54.126 } 00:11:54.126 Got JSON-RPC error response 00:11:54.126 response: 00:11:54.126 { 00:11:54.126 "code": -32602, 00:11:54.126 "message": "Invalid cntlid range [1-65520]" 00:11:54.126 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:54.126 11:36:13 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode19452 -i 6 -I 5 00:11:54.384 [2024-11-28 11:36:14.201889] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode19452: invalid cntlid range [6-5] 00:11:54.384 11:36:14 -- target/invalid.sh@83 -- # out='request: 00:11:54.384 { 00:11:54.384 "nqn": "nqn.2016-06.io.spdk:cnode19452", 00:11:54.384 "min_cntlid": 6, 00:11:54.384 "max_cntlid": 5, 00:11:54.384 "method": "nvmf_create_subsystem", 00:11:54.384 "req_id": 1 00:11:54.384 } 00:11:54.384 Got JSON-RPC error response 00:11:54.384 response: 00:11:54.384 { 00:11:54.384 "code": -32602, 00:11:54.384 "message": "Invalid cntlid range [6-5]" 00:11:54.384 }' 00:11:54.384 11:36:14 -- target/invalid.sh@84 -- # [[ request: 00:11:54.384 { 00:11:54.384 "nqn": "nqn.2016-06.io.spdk:cnode19452", 00:11:54.384 "min_cntlid": 6, 00:11:54.384 "max_cntlid": 5, 00:11:54.384 "method": "nvmf_create_subsystem", 00:11:54.384 "req_id": 1 00:11:54.384 } 00:11:54.384 Got JSON-RPC error response 00:11:54.384 response: 00:11:54.384 { 00:11:54.384 "code": -32602, 00:11:54.384 "message": "Invalid cntlid range [6-5]" 00:11:54.384 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:54.384 11:36:14 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:11:54.384 11:36:14 -- target/invalid.sh@87 -- # out='request: 00:11:54.384 { 00:11:54.384 "name": "foobar", 00:11:54.384 "method": "nvmf_delete_target", 00:11:54.384 "req_id": 1 00:11:54.384 } 00:11:54.384 Got JSON-RPC error response 00:11:54.384 response: 00:11:54.384 { 00:11:54.384 "code": -32602, 00:11:54.384 "message": "The specified target doesn'\''t exist, cannot delete it." 00:11:54.384 }' 00:11:54.384 11:36:14 -- target/invalid.sh@88 -- # [[ request: 00:11:54.384 { 00:11:54.384 "name": "foobar", 00:11:54.384 "method": "nvmf_delete_target", 00:11:54.384 "req_id": 1 00:11:54.384 } 00:11:54.384 Got JSON-RPC error response 00:11:54.384 response: 00:11:54.384 { 00:11:54.384 "code": -32602, 00:11:54.384 "message": "The specified target doesn't exist, cannot delete it." 00:11:54.384 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:11:54.384 11:36:14 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:11:54.384 11:36:14 -- target/invalid.sh@91 -- # nvmftestfini 00:11:54.384 11:36:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:54.384 11:36:14 -- nvmf/common.sh@116 -- # sync 00:11:54.384 11:36:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:54.384 11:36:14 -- nvmf/common.sh@119 -- # set +e 00:11:54.384 11:36:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:54.384 11:36:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:54.384 rmmod nvme_tcp 00:11:54.384 rmmod nvme_fabrics 00:11:54.384 rmmod nvme_keyring 00:11:54.384 11:36:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:54.384 11:36:14 -- nvmf/common.sh@123 -- # set -e 00:11:54.384 11:36:14 -- nvmf/common.sh@124 -- # return 0 00:11:54.384 11:36:14 -- nvmf/common.sh@477 -- # '[' -n 3758657 ']' 00:11:54.384 11:36:14 -- nvmf/common.sh@478 -- # killprocess 3758657 00:11:54.384 11:36:14 -- common/autotest_common.sh@936 -- # '[' -z 3758657 ']' 00:11:54.384 11:36:14 -- common/autotest_common.sh@940 -- # kill -0 3758657 00:11:54.384 11:36:14 -- common/autotest_common.sh@941 -- # uname 00:11:54.384 11:36:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:54.384 11:36:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3758657 00:11:54.642 11:36:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:54.642 11:36:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:54.642 11:36:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3758657' 00:11:54.642 killing process with pid 3758657 00:11:54.642 11:36:14 -- common/autotest_common.sh@955 -- # kill 3758657 00:11:54.642 11:36:14 -- common/autotest_common.sh@960 -- # wait 3758657 00:11:54.906 11:36:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:54.906 11:36:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:54.906 11:36:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:54.906 11:36:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:54.906 11:36:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:54.906 11:36:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:54.906 11:36:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:54.906 11:36:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:56.914 11:36:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:56.914 00:11:56.914 real 0m9.345s 00:11:56.914 user 0m23.134s 00:11:56.914 sys 0m2.417s 00:11:56.914 11:36:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:56.914 11:36:16 -- common/autotest_common.sh@10 -- # set +x 00:11:56.914 ************************************ 00:11:56.914 END TEST nvmf_invalid 00:11:56.914 ************************************ 00:11:56.914 11:36:16 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:11:56.914 11:36:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:56.914 11:36:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:56.914 11:36:16 -- common/autotest_common.sh@10 -- # set +x 00:11:56.914 ************************************ 00:11:56.914 START TEST nvmf_abort 00:11:56.914 ************************************ 00:11:56.914 11:36:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:11:56.914 * Looking for test storage... 00:11:56.914 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:56.914 11:36:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:56.914 11:36:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:56.914 11:36:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:56.914 11:36:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:56.914 11:36:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:56.914 11:36:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:56.914 11:36:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:56.914 11:36:16 -- scripts/common.sh@335 -- # IFS=.-: 00:11:56.914 11:36:16 -- scripts/common.sh@335 -- # read -ra ver1 00:11:56.914 11:36:16 -- scripts/common.sh@336 -- # IFS=.-: 00:11:56.914 11:36:16 -- scripts/common.sh@336 -- # read -ra ver2 00:11:56.914 11:36:16 -- scripts/common.sh@337 -- # local 'op=<' 00:11:56.914 11:36:16 -- scripts/common.sh@339 -- # ver1_l=2 00:11:56.914 11:36:16 -- scripts/common.sh@340 -- # ver2_l=1 00:11:56.914 11:36:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:56.914 11:36:16 -- scripts/common.sh@343 -- # case "$op" in 00:11:56.914 11:36:16 -- scripts/common.sh@344 -- # : 1 00:11:56.914 11:36:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:56.914 11:36:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:56.914 11:36:16 -- scripts/common.sh@364 -- # decimal 1 00:11:56.914 11:36:16 -- scripts/common.sh@352 -- # local d=1 00:11:56.914 11:36:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:56.914 11:36:16 -- scripts/common.sh@354 -- # echo 1 00:11:56.914 11:36:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:56.914 11:36:16 -- scripts/common.sh@365 -- # decimal 2 00:11:56.914 11:36:16 -- scripts/common.sh@352 -- # local d=2 00:11:56.914 11:36:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:56.914 11:36:16 -- scripts/common.sh@354 -- # echo 2 00:11:56.914 11:36:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:56.914 11:36:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:56.914 11:36:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:56.914 11:36:16 -- scripts/common.sh@367 -- # return 0 00:11:56.914 11:36:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:56.914 11:36:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:56.914 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:56.914 --rc genhtml_branch_coverage=1 00:11:56.914 --rc genhtml_function_coverage=1 00:11:56.914 --rc genhtml_legend=1 00:11:56.914 --rc geninfo_all_blocks=1 00:11:56.914 --rc geninfo_unexecuted_blocks=1 00:11:56.914 00:11:56.914 ' 00:11:56.914 11:36:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:56.914 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:56.914 --rc genhtml_branch_coverage=1 00:11:56.914 --rc genhtml_function_coverage=1 00:11:56.914 --rc genhtml_legend=1 00:11:56.914 --rc geninfo_all_blocks=1 00:11:56.914 --rc geninfo_unexecuted_blocks=1 00:11:56.914 00:11:56.914 ' 00:11:56.914 11:36:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:56.914 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:56.914 --rc genhtml_branch_coverage=1 00:11:56.914 --rc genhtml_function_coverage=1 00:11:56.914 --rc genhtml_legend=1 00:11:56.914 --rc geninfo_all_blocks=1 00:11:56.914 --rc geninfo_unexecuted_blocks=1 00:11:56.914 00:11:56.914 ' 00:11:56.914 11:36:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:56.914 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:56.914 --rc genhtml_branch_coverage=1 00:11:56.914 --rc genhtml_function_coverage=1 00:11:56.914 --rc genhtml_legend=1 00:11:56.914 --rc geninfo_all_blocks=1 00:11:56.914 --rc geninfo_unexecuted_blocks=1 00:11:56.914 00:11:56.914 ' 00:11:56.914 11:36:16 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:56.914 11:36:16 -- nvmf/common.sh@7 -- # uname -s 00:11:56.914 11:36:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:56.914 11:36:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:56.914 11:36:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:56.914 11:36:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:56.914 11:36:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:56.914 11:36:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:56.914 11:36:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:56.914 11:36:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:56.914 11:36:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:56.914 11:36:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:56.914 11:36:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:56.914 11:36:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:56.914 11:36:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:56.914 11:36:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:56.914 11:36:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:56.914 11:36:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:56.914 11:36:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:56.914 11:36:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:56.914 11:36:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:56.914 11:36:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.914 11:36:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.914 11:36:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.914 11:36:16 -- paths/export.sh@5 -- # export PATH 00:11:56.914 11:36:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.914 11:36:16 -- nvmf/common.sh@46 -- # : 0 00:11:56.914 11:36:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:56.914 11:36:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:56.914 11:36:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:56.914 11:36:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:56.914 11:36:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:56.914 11:36:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:56.914 11:36:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:56.914 11:36:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:56.914 11:36:16 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:56.914 11:36:16 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:11:56.914 11:36:16 -- target/abort.sh@14 -- # nvmftestinit 00:11:56.914 11:36:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:56.914 11:36:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:56.914 11:36:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:56.914 11:36:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:56.914 11:36:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:56.914 11:36:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:56.914 11:36:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:56.914 11:36:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:56.914 11:36:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:56.914 11:36:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:56.914 11:36:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:56.914 11:36:16 -- common/autotest_common.sh@10 -- # set +x 00:11:59.443 11:36:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:59.443 11:36:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:59.443 11:36:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:59.443 11:36:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:59.443 11:36:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:59.443 11:36:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:59.443 11:36:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:59.443 11:36:18 -- nvmf/common.sh@294 -- # net_devs=() 00:11:59.443 11:36:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:59.443 11:36:18 -- nvmf/common.sh@295 -- # e810=() 00:11:59.443 11:36:18 -- nvmf/common.sh@295 -- # local -ga e810 00:11:59.443 11:36:18 -- nvmf/common.sh@296 -- # x722=() 00:11:59.443 11:36:18 -- nvmf/common.sh@296 -- # local -ga x722 00:11:59.443 11:36:18 -- nvmf/common.sh@297 -- # mlx=() 00:11:59.443 11:36:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:59.443 11:36:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:59.443 11:36:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:59.443 11:36:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:59.443 11:36:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:59.443 11:36:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:59.443 11:36:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:59.443 11:36:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:59.443 11:36:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:59.443 11:36:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:59.443 11:36:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:59.443 11:36:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:59.443 11:36:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:59.443 11:36:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:59.443 11:36:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:59.443 11:36:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:59.443 11:36:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:59.443 11:36:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:59.443 11:36:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:59.443 11:36:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:59.443 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:59.443 11:36:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:59.444 11:36:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:59.444 11:36:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:59.444 11:36:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:59.444 11:36:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:59.444 11:36:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:59.444 11:36:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:59.444 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:59.444 11:36:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:59.444 11:36:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:59.444 11:36:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:59.444 11:36:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:59.444 11:36:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:59.444 11:36:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:59.444 11:36:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:59.444 11:36:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:59.444 11:36:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:59.444 11:36:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:59.444 11:36:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:59.444 11:36:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:59.444 11:36:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:59.444 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:59.444 11:36:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:59.444 11:36:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:59.444 11:36:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:59.444 11:36:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:59.444 11:36:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:59.444 11:36:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:59.444 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:59.444 11:36:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:59.444 11:36:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:59.444 11:36:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:59.444 11:36:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:59.444 11:36:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:59.444 11:36:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:59.444 11:36:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:59.444 11:36:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:59.444 11:36:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:59.444 11:36:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:59.444 11:36:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:59.444 11:36:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:59.444 11:36:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:59.444 11:36:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:59.444 11:36:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:59.444 11:36:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:59.444 11:36:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:59.444 11:36:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:59.444 11:36:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:59.444 11:36:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:59.444 11:36:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:59.444 11:36:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:59.444 11:36:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:59.444 11:36:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:59.444 11:36:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:59.444 11:36:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:59.444 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:59.444 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:11:59.444 00:11:59.444 --- 10.0.0.2 ping statistics --- 00:11:59.444 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:59.444 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:11:59.444 11:36:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:59.444 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:59.444 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:11:59.444 00:11:59.444 --- 10.0.0.1 ping statistics --- 00:11:59.444 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:59.444 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:11:59.444 11:36:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:59.444 11:36:19 -- nvmf/common.sh@410 -- # return 0 00:11:59.444 11:36:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:59.444 11:36:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:59.444 11:36:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:59.444 11:36:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:59.444 11:36:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:59.444 11:36:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:59.444 11:36:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:59.444 11:36:19 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:11:59.444 11:36:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:59.444 11:36:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:59.444 11:36:19 -- common/autotest_common.sh@10 -- # set +x 00:11:59.444 11:36:19 -- nvmf/common.sh@469 -- # nvmfpid=3761451 00:11:59.444 11:36:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:11:59.444 11:36:19 -- nvmf/common.sh@470 -- # waitforlisten 3761451 00:11:59.444 11:36:19 -- common/autotest_common.sh@829 -- # '[' -z 3761451 ']' 00:11:59.444 11:36:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:59.444 11:36:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:59.444 11:36:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:59.444 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:59.444 11:36:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:59.444 11:36:19 -- common/autotest_common.sh@10 -- # set +x 00:11:59.444 [2024-11-28 11:36:19.132747] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:59.444 [2024-11-28 11:36:19.132837] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:59.444 EAL: No free 2048 kB hugepages reported on node 1 00:11:59.444 [2024-11-28 11:36:19.195695] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:11:59.444 [2024-11-28 11:36:19.304407] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:59.444 [2024-11-28 11:36:19.304588] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:59.444 [2024-11-28 11:36:19.304610] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:59.444 [2024-11-28 11:36:19.304626] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:59.444 [2024-11-28 11:36:19.304747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:59.444 [2024-11-28 11:36:19.304840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:59.444 [2024-11-28 11:36:19.304843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:00.377 11:36:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:00.377 11:36:20 -- common/autotest_common.sh@862 -- # return 0 00:12:00.377 11:36:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:00.377 11:36:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:00.377 11:36:20 -- common/autotest_common.sh@10 -- # set +x 00:12:00.377 11:36:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:00.377 11:36:20 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:00.377 11:36:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.377 11:36:20 -- common/autotest_common.sh@10 -- # set +x 00:12:00.377 [2024-11-28 11:36:20.163346] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:00.377 11:36:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.377 11:36:20 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:00.377 11:36:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.377 11:36:20 -- common/autotest_common.sh@10 -- # set +x 00:12:00.377 Malloc0 00:12:00.377 11:36:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.377 11:36:20 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:00.377 11:36:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.377 11:36:20 -- common/autotest_common.sh@10 -- # set +x 00:12:00.377 Delay0 00:12:00.377 11:36:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.377 11:36:20 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:00.377 11:36:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.377 11:36:20 -- common/autotest_common.sh@10 -- # set +x 00:12:00.377 11:36:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.377 11:36:20 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:00.377 11:36:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.377 11:36:20 -- common/autotest_common.sh@10 -- # set +x 00:12:00.377 11:36:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.377 11:36:20 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:00.377 11:36:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.377 11:36:20 -- common/autotest_common.sh@10 -- # set +x 00:12:00.377 [2024-11-28 11:36:20.231940] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:00.377 11:36:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.377 11:36:20 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:00.377 11:36:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.377 11:36:20 -- common/autotest_common.sh@10 -- # set +x 00:12:00.377 11:36:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.377 11:36:20 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:00.377 EAL: No free 2048 kB hugepages reported on node 1 00:12:00.377 [2024-11-28 11:36:20.296358] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:02.904 Initializing NVMe Controllers 00:12:02.904 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:02.904 controller IO queue size 128 less than required 00:12:02.904 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:02.904 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:02.904 Initialization complete. Launching workers. 00:12:02.904 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 127, failed: 32718 00:12:02.904 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 32783, failed to submit 62 00:12:02.904 success 32718, unsuccess 65, failed 0 00:12:02.904 11:36:22 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:02.904 11:36:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.904 11:36:22 -- common/autotest_common.sh@10 -- # set +x 00:12:02.904 11:36:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.904 11:36:22 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:02.904 11:36:22 -- target/abort.sh@38 -- # nvmftestfini 00:12:02.904 11:36:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:02.904 11:36:22 -- nvmf/common.sh@116 -- # sync 00:12:02.904 11:36:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:02.904 11:36:22 -- nvmf/common.sh@119 -- # set +e 00:12:02.904 11:36:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:02.904 11:36:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:02.904 rmmod nvme_tcp 00:12:02.904 rmmod nvme_fabrics 00:12:02.904 rmmod nvme_keyring 00:12:02.904 11:36:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:02.904 11:36:22 -- nvmf/common.sh@123 -- # set -e 00:12:02.904 11:36:22 -- nvmf/common.sh@124 -- # return 0 00:12:02.904 11:36:22 -- nvmf/common.sh@477 -- # '[' -n 3761451 ']' 00:12:02.904 11:36:22 -- nvmf/common.sh@478 -- # killprocess 3761451 00:12:02.904 11:36:22 -- common/autotest_common.sh@936 -- # '[' -z 3761451 ']' 00:12:02.904 11:36:22 -- common/autotest_common.sh@940 -- # kill -0 3761451 00:12:02.904 11:36:22 -- common/autotest_common.sh@941 -- # uname 00:12:02.904 11:36:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:02.904 11:36:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3761451 00:12:02.904 11:36:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:02.904 11:36:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:02.904 11:36:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3761451' 00:12:02.904 killing process with pid 3761451 00:12:02.904 11:36:22 -- common/autotest_common.sh@955 -- # kill 3761451 00:12:02.904 11:36:22 -- common/autotest_common.sh@960 -- # wait 3761451 00:12:02.904 11:36:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:02.904 11:36:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:02.904 11:36:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:02.904 11:36:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:02.904 11:36:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:02.904 11:36:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:02.904 11:36:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:02.904 11:36:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:04.808 11:36:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:04.808 00:12:04.808 real 0m8.013s 00:12:04.808 user 0m12.780s 00:12:04.808 sys 0m2.474s 00:12:04.808 11:36:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:04.808 11:36:24 -- common/autotest_common.sh@10 -- # set +x 00:12:04.808 ************************************ 00:12:04.808 END TEST nvmf_abort 00:12:04.808 ************************************ 00:12:04.808 11:36:24 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:04.808 11:36:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:04.808 11:36:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:04.808 11:36:24 -- common/autotest_common.sh@10 -- # set +x 00:12:04.808 ************************************ 00:12:04.808 START TEST nvmf_ns_hotplug_stress 00:12:04.808 ************************************ 00:12:04.808 11:36:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:05.066 * Looking for test storage... 00:12:05.066 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:05.066 11:36:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:05.066 11:36:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:05.066 11:36:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:05.066 11:36:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:05.066 11:36:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:05.066 11:36:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:05.066 11:36:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:05.066 11:36:24 -- scripts/common.sh@335 -- # IFS=.-: 00:12:05.066 11:36:24 -- scripts/common.sh@335 -- # read -ra ver1 00:12:05.066 11:36:24 -- scripts/common.sh@336 -- # IFS=.-: 00:12:05.066 11:36:24 -- scripts/common.sh@336 -- # read -ra ver2 00:12:05.066 11:36:24 -- scripts/common.sh@337 -- # local 'op=<' 00:12:05.066 11:36:24 -- scripts/common.sh@339 -- # ver1_l=2 00:12:05.066 11:36:24 -- scripts/common.sh@340 -- # ver2_l=1 00:12:05.066 11:36:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:05.066 11:36:24 -- scripts/common.sh@343 -- # case "$op" in 00:12:05.066 11:36:24 -- scripts/common.sh@344 -- # : 1 00:12:05.066 11:36:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:05.067 11:36:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:05.067 11:36:24 -- scripts/common.sh@364 -- # decimal 1 00:12:05.067 11:36:24 -- scripts/common.sh@352 -- # local d=1 00:12:05.067 11:36:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:05.067 11:36:24 -- scripts/common.sh@354 -- # echo 1 00:12:05.067 11:36:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:05.067 11:36:24 -- scripts/common.sh@365 -- # decimal 2 00:12:05.067 11:36:24 -- scripts/common.sh@352 -- # local d=2 00:12:05.067 11:36:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:05.067 11:36:24 -- scripts/common.sh@354 -- # echo 2 00:12:05.067 11:36:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:05.067 11:36:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:05.067 11:36:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:05.067 11:36:24 -- scripts/common.sh@367 -- # return 0 00:12:05.067 11:36:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:05.067 11:36:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:05.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:05.067 --rc genhtml_branch_coverage=1 00:12:05.067 --rc genhtml_function_coverage=1 00:12:05.067 --rc genhtml_legend=1 00:12:05.067 --rc geninfo_all_blocks=1 00:12:05.067 --rc geninfo_unexecuted_blocks=1 00:12:05.067 00:12:05.067 ' 00:12:05.067 11:36:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:05.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:05.067 --rc genhtml_branch_coverage=1 00:12:05.067 --rc genhtml_function_coverage=1 00:12:05.067 --rc genhtml_legend=1 00:12:05.067 --rc geninfo_all_blocks=1 00:12:05.067 --rc geninfo_unexecuted_blocks=1 00:12:05.067 00:12:05.067 ' 00:12:05.067 11:36:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:05.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:05.067 --rc genhtml_branch_coverage=1 00:12:05.067 --rc genhtml_function_coverage=1 00:12:05.067 --rc genhtml_legend=1 00:12:05.067 --rc geninfo_all_blocks=1 00:12:05.067 --rc geninfo_unexecuted_blocks=1 00:12:05.067 00:12:05.067 ' 00:12:05.067 11:36:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:05.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:05.067 --rc genhtml_branch_coverage=1 00:12:05.067 --rc genhtml_function_coverage=1 00:12:05.067 --rc genhtml_legend=1 00:12:05.067 --rc geninfo_all_blocks=1 00:12:05.067 --rc geninfo_unexecuted_blocks=1 00:12:05.067 00:12:05.067 ' 00:12:05.067 11:36:24 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:05.067 11:36:24 -- nvmf/common.sh@7 -- # uname -s 00:12:05.067 11:36:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:05.067 11:36:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:05.067 11:36:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:05.067 11:36:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:05.067 11:36:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:05.067 11:36:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:05.067 11:36:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:05.067 11:36:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:05.067 11:36:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:05.067 11:36:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:05.067 11:36:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:05.067 11:36:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:05.067 11:36:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:05.067 11:36:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:05.067 11:36:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:05.067 11:36:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:05.067 11:36:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:05.067 11:36:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:05.067 11:36:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:05.067 11:36:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.067 11:36:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.067 11:36:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.067 11:36:24 -- paths/export.sh@5 -- # export PATH 00:12:05.067 11:36:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.067 11:36:24 -- nvmf/common.sh@46 -- # : 0 00:12:05.067 11:36:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:05.067 11:36:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:05.067 11:36:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:05.067 11:36:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:05.067 11:36:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:05.067 11:36:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:05.067 11:36:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:05.067 11:36:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:05.067 11:36:24 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:05.067 11:36:24 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:05.067 11:36:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:05.067 11:36:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:05.067 11:36:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:05.067 11:36:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:05.067 11:36:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:05.067 11:36:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:05.067 11:36:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:05.067 11:36:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:05.067 11:36:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:05.067 11:36:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:05.067 11:36:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:05.067 11:36:24 -- common/autotest_common.sh@10 -- # set +x 00:12:06.970 11:36:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:06.970 11:36:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:06.970 11:36:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:06.970 11:36:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:06.970 11:36:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:06.970 11:36:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:06.970 11:36:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:06.970 11:36:27 -- nvmf/common.sh@294 -- # net_devs=() 00:12:06.970 11:36:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:06.970 11:36:27 -- nvmf/common.sh@295 -- # e810=() 00:12:06.970 11:36:27 -- nvmf/common.sh@295 -- # local -ga e810 00:12:06.970 11:36:27 -- nvmf/common.sh@296 -- # x722=() 00:12:06.970 11:36:27 -- nvmf/common.sh@296 -- # local -ga x722 00:12:06.970 11:36:27 -- nvmf/common.sh@297 -- # mlx=() 00:12:06.970 11:36:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:06.970 11:36:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:06.970 11:36:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:06.970 11:36:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:06.970 11:36:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:06.970 11:36:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:06.970 11:36:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:06.970 11:36:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:06.970 11:36:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:06.970 11:36:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:06.970 11:36:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:06.970 11:36:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:06.970 11:36:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:06.970 11:36:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:06.970 11:36:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:06.970 11:36:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:06.970 11:36:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:06.970 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:06.970 11:36:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:06.970 11:36:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:06.970 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:06.970 11:36:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:06.970 11:36:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:06.970 11:36:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:06.970 11:36:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:06.970 11:36:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:06.970 11:36:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:06.970 11:36:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:06.970 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:06.970 11:36:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:06.970 11:36:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:06.971 11:36:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:06.971 11:36:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:06.971 11:36:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:06.971 11:36:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:06.971 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:06.971 11:36:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:06.971 11:36:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:06.971 11:36:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:06.971 11:36:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:06.971 11:36:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:06.971 11:36:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:06.971 11:36:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:06.971 11:36:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:06.971 11:36:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:06.971 11:36:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:06.971 11:36:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:06.971 11:36:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:06.971 11:36:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:06.971 11:36:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:06.971 11:36:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:06.971 11:36:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:06.971 11:36:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:07.229 11:36:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:07.229 11:36:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:07.229 11:36:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:07.229 11:36:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:07.229 11:36:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:07.229 11:36:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:07.229 11:36:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:07.229 11:36:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:07.229 11:36:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:07.229 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:07.229 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:12:07.229 00:12:07.229 --- 10.0.0.2 ping statistics --- 00:12:07.229 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:07.229 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:12:07.229 11:36:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:07.229 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:07.229 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:12:07.229 00:12:07.229 --- 10.0.0.1 ping statistics --- 00:12:07.229 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:07.229 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:12:07.229 11:36:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:07.229 11:36:27 -- nvmf/common.sh@410 -- # return 0 00:12:07.229 11:36:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:07.229 11:36:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:07.229 11:36:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:07.229 11:36:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:07.229 11:36:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:07.229 11:36:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:07.229 11:36:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:07.229 11:36:27 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:07.229 11:36:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:07.229 11:36:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:07.229 11:36:27 -- common/autotest_common.sh@10 -- # set +x 00:12:07.229 11:36:27 -- nvmf/common.sh@469 -- # nvmfpid=3763831 00:12:07.229 11:36:27 -- nvmf/common.sh@470 -- # waitforlisten 3763831 00:12:07.229 11:36:27 -- common/autotest_common.sh@829 -- # '[' -z 3763831 ']' 00:12:07.229 11:36:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:07.229 11:36:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:07.229 11:36:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:07.229 11:36:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:07.229 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:07.229 11:36:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:07.229 11:36:27 -- common/autotest_common.sh@10 -- # set +x 00:12:07.229 [2024-11-28 11:36:27.215180] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:07.229 [2024-11-28 11:36:27.215262] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:07.229 EAL: No free 2048 kB hugepages reported on node 1 00:12:07.230 [2024-11-28 11:36:27.282625] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:07.487 [2024-11-28 11:36:27.402321] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:07.487 [2024-11-28 11:36:27.402499] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:07.487 [2024-11-28 11:36:27.402519] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:07.487 [2024-11-28 11:36:27.402556] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:07.487 [2024-11-28 11:36:27.402654] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:07.487 [2024-11-28 11:36:27.402710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:07.487 [2024-11-28 11:36:27.402713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:08.420 11:36:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:08.420 11:36:28 -- common/autotest_common.sh@862 -- # return 0 00:12:08.420 11:36:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:08.420 11:36:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:08.420 11:36:28 -- common/autotest_common.sh@10 -- # set +x 00:12:08.420 11:36:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:08.420 11:36:28 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:08.420 11:36:28 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:08.679 [2024-11-28 11:36:28.538647] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:08.679 11:36:28 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:08.938 11:36:28 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:09.196 [2024-11-28 11:36:29.065782] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:09.196 11:36:29 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:09.453 11:36:29 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:09.711 Malloc0 00:12:09.712 11:36:29 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:09.970 Delay0 00:12:09.970 11:36:29 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:10.227 11:36:30 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:10.485 NULL1 00:12:10.485 11:36:30 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:10.744 11:36:30 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=3764277 00:12:10.744 11:36:30 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:10.744 11:36:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:10.744 11:36:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:10.744 EAL: No free 2048 kB hugepages reported on node 1 00:12:12.126 Read completed with error (sct=0, sc=11) 00:12:12.126 11:36:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:12.126 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:12.126 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:12.126 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:12.126 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:12.126 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:12.126 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:12.126 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:12.126 11:36:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:12.126 11:36:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:12.383 true 00:12:12.383 11:36:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:12.383 11:36:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:13.316 11:36:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:13.574 11:36:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:13.574 11:36:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:13.574 true 00:12:13.832 11:36:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:13.832 11:36:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:13.832 11:36:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:14.097 11:36:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:14.097 11:36:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:14.355 true 00:12:14.355 11:36:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:14.355 11:36:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:14.612 11:36:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:14.870 11:36:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:14.870 11:36:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:15.127 true 00:12:15.127 11:36:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:15.127 11:36:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:16.496 11:36:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:16.497 11:36:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:16.497 11:36:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:16.754 true 00:12:16.754 11:36:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:16.754 11:36:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:17.012 11:36:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:17.270 11:36:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:17.270 11:36:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:17.528 true 00:12:17.528 11:36:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:17.528 11:36:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:17.785 11:36:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:18.042 11:36:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:18.042 11:36:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:18.300 true 00:12:18.300 11:36:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:18.300 11:36:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.232 11:36:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:19.490 11:36:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:19.490 11:36:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:19.747 true 00:12:19.747 11:36:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:19.747 11:36:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:20.005 11:36:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:20.262 11:36:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:20.262 11:36:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:20.519 true 00:12:20.520 11:36:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:20.520 11:36:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:20.777 11:36:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:21.034 11:36:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:21.034 11:36:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:21.292 true 00:12:21.292 11:36:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:21.292 11:36:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.224 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:22.224 11:36:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:22.481 11:36:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:22.481 11:36:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:22.738 true 00:12:22.738 11:36:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:22.738 11:36:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.998 11:36:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:23.287 11:36:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:23.287 11:36:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:23.569 true 00:12:23.569 11:36:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:23.569 11:36:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:24.501 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:24.501 11:36:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:24.501 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:24.759 11:36:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:24.759 11:36:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:25.017 true 00:12:25.017 11:36:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:25.017 11:36:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:25.286 11:36:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:25.545 11:36:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:25.545 11:36:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:25.802 true 00:12:25.802 11:36:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:25.802 11:36:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:26.735 11:36:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:26.735 11:36:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:26.735 11:36:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:26.993 true 00:12:27.251 11:36:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:27.251 11:36:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:27.251 11:36:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:27.509 11:36:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:27.509 11:36:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:27.766 true 00:12:27.766 11:36:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:27.766 11:36:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:28.701 11:36:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:28.959 11:36:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:28.959 11:36:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:29.217 true 00:12:29.217 11:36:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:29.217 11:36:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:29.475 11:36:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:29.733 11:36:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:12:29.733 11:36:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:12:29.991 true 00:12:29.991 11:36:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:29.991 11:36:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:30.249 11:36:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:30.507 11:36:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:12:30.507 11:36:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:12:30.765 true 00:12:30.765 11:36:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:30.765 11:36:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:31.698 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:31.956 11:36:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:31.956 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:31.956 11:36:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:12:31.956 11:36:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:32.214 true 00:12:32.214 11:36:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:32.214 11:36:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:32.472 11:36:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:32.730 11:36:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:12:32.730 11:36:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:12:32.989 true 00:12:32.989 11:36:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:32.989 11:36:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:33.922 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:33.922 11:36:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:33.922 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:34.180 11:36:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:12:34.180 11:36:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:12:34.438 true 00:12:34.438 11:36:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:34.438 11:36:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:34.696 11:36:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:34.954 11:36:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:12:34.954 11:36:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:12:35.213 true 00:12:35.213 11:36:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:35.213 11:36:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.147 11:36:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:36.405 11:36:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:12:36.405 11:36:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:12:36.663 true 00:12:36.663 11:36:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:36.663 11:36:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.921 11:36:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:37.179 11:36:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:12:37.179 11:36:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:12:37.437 true 00:12:37.437 11:36:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:37.437 11:36:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:37.694 11:36:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:37.952 11:36:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:12:37.952 11:36:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:12:38.210 true 00:12:38.210 11:36:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:38.210 11:36:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:39.144 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:39.144 11:36:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:39.144 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:39.402 11:36:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:12:39.402 11:36:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:12:39.660 true 00:12:39.660 11:36:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:39.660 11:36:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:39.918 11:36:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:40.176 11:37:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:12:40.176 11:37:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:12:40.433 true 00:12:40.433 11:37:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:40.433 11:37:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:41.367 Initializing NVMe Controllers 00:12:41.367 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:12:41.367 Controller IO queue size 128, less than required. 00:12:41.367 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:41.367 Controller IO queue size 128, less than required. 00:12:41.367 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:41.367 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:12:41.367 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:12:41.367 Initialization complete. Launching workers. 00:12:41.367 ======================================================== 00:12:41.367 Latency(us) 00:12:41.368 Device Information : IOPS MiB/s Average min max 00:12:41.368 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 594.19 0.29 102689.56 2487.29 1059251.40 00:12:41.368 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 9448.59 4.61 13547.71 3644.14 429730.94 00:12:41.368 ======================================================== 00:12:41.368 Total : 10042.79 4.90 18821.89 2487.29 1059251.40 00:12:41.368 00:12:41.368 11:37:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.625 11:37:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:12:41.625 11:37:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:12:41.883 true 00:12:41.883 11:37:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3764277 00:12:41.883 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (3764277) - No such process 00:12:41.883 11:37:01 -- target/ns_hotplug_stress.sh@53 -- # wait 3764277 00:12:41.883 11:37:01 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:42.142 11:37:01 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:42.400 11:37:02 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:12:42.400 11:37:02 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:12:42.400 11:37:02 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:12:42.400 11:37:02 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:42.400 11:37:02 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:12:42.400 null0 00:12:42.657 11:37:02 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:42.657 11:37:02 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:42.657 11:37:02 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:12:42.916 null1 00:12:42.916 11:37:02 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:42.916 11:37:02 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:42.916 11:37:02 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:12:43.174 null2 00:12:43.174 11:37:02 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:43.174 11:37:02 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:43.174 11:37:02 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:12:43.432 null3 00:12:43.432 11:37:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:43.432 11:37:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:43.432 11:37:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:12:43.432 null4 00:12:43.691 11:37:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:43.691 11:37:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:43.691 11:37:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:12:43.948 null5 00:12:43.948 11:37:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:43.948 11:37:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:43.948 11:37:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:12:44.206 null6 00:12:44.206 11:37:04 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:44.206 11:37:04 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:44.206 11:37:04 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:12:44.206 null7 00:12:44.465 11:37:04 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:44.465 11:37:04 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:44.465 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:12:44.465 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:44.465 11:37:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@66 -- # wait 3768440 3768441 3768443 3768445 3768447 3768449 3768451 3768453 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.466 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:44.724 11:37:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:44.725 11:37:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:44.725 11:37:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:44.725 11:37:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.725 11:37:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:44.725 11:37:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:44.725 11:37:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:44.725 11:37:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.983 11:37:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:45.241 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:45.241 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:45.241 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:45.241 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:45.241 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:45.241 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:45.241 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.241 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.498 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:45.756 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:45.756 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:45.756 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:45.756 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:45.756 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:45.756 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:45.756 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:45.756 11:37:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.014 11:37:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:46.272 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:46.272 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:46.272 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:46.272 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:46.272 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:46.272 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.272 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:46.272 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.530 11:37:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:46.788 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:46.788 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:46.788 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:46.788 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.788 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:46.788 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:46.788 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:46.788 11:37:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:47.049 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.049 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.049 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:47.049 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.049 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.049 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:47.049 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.049 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.049 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:47.349 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.614 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:47.871 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.871 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.871 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:47.871 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.871 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.871 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:47.871 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.871 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.871 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:47.871 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.871 11:37:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.871 11:37:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:48.128 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:48.128 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:48.128 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:48.128 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:48.128 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:48.128 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.128 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:48.128 11:37:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:48.384 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.384 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.384 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:48.384 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.384 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.385 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:48.641 11:37:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:48.641 11:37:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:48.641 11:37:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:48.641 11:37:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.641 11:37:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:48.641 11:37:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:48.641 11:37:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:48.641 11:37:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.897 11:37:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:49.155 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.155 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:49.155 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:49.155 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:49.155 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:49.155 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:49.155 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:49.155 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.412 11:37:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:49.669 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:49.669 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.669 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:49.669 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:49.669 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:49.669 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:49.669 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:49.669 11:37:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:12:49.926 11:37:09 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:12:49.926 11:37:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:49.926 11:37:09 -- nvmf/common.sh@116 -- # sync 00:12:49.926 11:37:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:49.926 11:37:09 -- nvmf/common.sh@119 -- # set +e 00:12:49.926 11:37:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:49.926 11:37:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:49.926 rmmod nvme_tcp 00:12:49.926 rmmod nvme_fabrics 00:12:49.926 rmmod nvme_keyring 00:12:50.183 11:37:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:50.183 11:37:09 -- nvmf/common.sh@123 -- # set -e 00:12:50.183 11:37:09 -- nvmf/common.sh@124 -- # return 0 00:12:50.183 11:37:09 -- nvmf/common.sh@477 -- # '[' -n 3763831 ']' 00:12:50.183 11:37:09 -- nvmf/common.sh@478 -- # killprocess 3763831 00:12:50.183 11:37:09 -- common/autotest_common.sh@936 -- # '[' -z 3763831 ']' 00:12:50.183 11:37:09 -- common/autotest_common.sh@940 -- # kill -0 3763831 00:12:50.183 11:37:09 -- common/autotest_common.sh@941 -- # uname 00:12:50.183 11:37:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:50.183 11:37:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3763831 00:12:50.183 11:37:10 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:50.183 11:37:10 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:50.183 11:37:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3763831' 00:12:50.183 killing process with pid 3763831 00:12:50.183 11:37:10 -- common/autotest_common.sh@955 -- # kill 3763831 00:12:50.183 11:37:10 -- common/autotest_common.sh@960 -- # wait 3763831 00:12:50.441 11:37:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:50.441 11:37:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:50.441 11:37:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:50.441 11:37:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:50.441 11:37:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:50.441 11:37:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:50.441 11:37:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:50.441 11:37:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:52.339 11:37:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:52.339 00:12:52.339 real 0m47.536s 00:12:52.339 user 3m33.595s 00:12:52.339 sys 0m16.746s 00:12:52.339 11:37:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:52.339 11:37:12 -- common/autotest_common.sh@10 -- # set +x 00:12:52.339 ************************************ 00:12:52.339 END TEST nvmf_ns_hotplug_stress 00:12:52.339 ************************************ 00:12:52.339 11:37:12 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:12:52.339 11:37:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:52.339 11:37:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:52.339 11:37:12 -- common/autotest_common.sh@10 -- # set +x 00:12:52.339 ************************************ 00:12:52.339 START TEST nvmf_connect_stress 00:12:52.339 ************************************ 00:12:52.339 11:37:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:12:52.598 * Looking for test storage... 00:12:52.598 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:52.598 11:37:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:52.598 11:37:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:52.598 11:37:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:52.598 11:37:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:52.598 11:37:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:52.598 11:37:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:52.598 11:37:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:52.598 11:37:12 -- scripts/common.sh@335 -- # IFS=.-: 00:12:52.598 11:37:12 -- scripts/common.sh@335 -- # read -ra ver1 00:12:52.598 11:37:12 -- scripts/common.sh@336 -- # IFS=.-: 00:12:52.598 11:37:12 -- scripts/common.sh@336 -- # read -ra ver2 00:12:52.598 11:37:12 -- scripts/common.sh@337 -- # local 'op=<' 00:12:52.598 11:37:12 -- scripts/common.sh@339 -- # ver1_l=2 00:12:52.598 11:37:12 -- scripts/common.sh@340 -- # ver2_l=1 00:12:52.598 11:37:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:52.598 11:37:12 -- scripts/common.sh@343 -- # case "$op" in 00:12:52.598 11:37:12 -- scripts/common.sh@344 -- # : 1 00:12:52.598 11:37:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:52.598 11:37:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:52.598 11:37:12 -- scripts/common.sh@364 -- # decimal 1 00:12:52.598 11:37:12 -- scripts/common.sh@352 -- # local d=1 00:12:52.598 11:37:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:52.598 11:37:12 -- scripts/common.sh@354 -- # echo 1 00:12:52.598 11:37:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:52.598 11:37:12 -- scripts/common.sh@365 -- # decimal 2 00:12:52.598 11:37:12 -- scripts/common.sh@352 -- # local d=2 00:12:52.598 11:37:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:52.598 11:37:12 -- scripts/common.sh@354 -- # echo 2 00:12:52.598 11:37:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:52.598 11:37:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:52.598 11:37:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:52.598 11:37:12 -- scripts/common.sh@367 -- # return 0 00:12:52.598 11:37:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:52.598 11:37:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:52.598 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:52.598 --rc genhtml_branch_coverage=1 00:12:52.598 --rc genhtml_function_coverage=1 00:12:52.598 --rc genhtml_legend=1 00:12:52.598 --rc geninfo_all_blocks=1 00:12:52.598 --rc geninfo_unexecuted_blocks=1 00:12:52.598 00:12:52.598 ' 00:12:52.598 11:37:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:52.598 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:52.598 --rc genhtml_branch_coverage=1 00:12:52.598 --rc genhtml_function_coverage=1 00:12:52.598 --rc genhtml_legend=1 00:12:52.598 --rc geninfo_all_blocks=1 00:12:52.598 --rc geninfo_unexecuted_blocks=1 00:12:52.598 00:12:52.598 ' 00:12:52.598 11:37:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:52.598 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:52.598 --rc genhtml_branch_coverage=1 00:12:52.598 --rc genhtml_function_coverage=1 00:12:52.598 --rc genhtml_legend=1 00:12:52.598 --rc geninfo_all_blocks=1 00:12:52.598 --rc geninfo_unexecuted_blocks=1 00:12:52.598 00:12:52.598 ' 00:12:52.598 11:37:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:52.598 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:52.598 --rc genhtml_branch_coverage=1 00:12:52.598 --rc genhtml_function_coverage=1 00:12:52.598 --rc genhtml_legend=1 00:12:52.598 --rc geninfo_all_blocks=1 00:12:52.598 --rc geninfo_unexecuted_blocks=1 00:12:52.598 00:12:52.598 ' 00:12:52.598 11:37:12 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:52.598 11:37:12 -- nvmf/common.sh@7 -- # uname -s 00:12:52.598 11:37:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:52.598 11:37:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:52.598 11:37:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:52.598 11:37:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:52.598 11:37:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:52.598 11:37:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:52.598 11:37:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:52.598 11:37:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:52.598 11:37:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:52.598 11:37:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:52.598 11:37:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:52.598 11:37:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:52.598 11:37:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:52.598 11:37:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:52.598 11:37:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:52.598 11:37:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:52.598 11:37:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:52.598 11:37:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:52.598 11:37:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:52.598 11:37:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.598 11:37:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.598 11:37:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.598 11:37:12 -- paths/export.sh@5 -- # export PATH 00:12:52.598 11:37:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.598 11:37:12 -- nvmf/common.sh@46 -- # : 0 00:12:52.598 11:37:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:52.598 11:37:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:52.598 11:37:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:52.598 11:37:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:52.598 11:37:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:52.598 11:37:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:52.598 11:37:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:52.598 11:37:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:52.598 11:37:12 -- target/connect_stress.sh@12 -- # nvmftestinit 00:12:52.598 11:37:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:52.598 11:37:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:52.598 11:37:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:52.598 11:37:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:52.598 11:37:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:52.598 11:37:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:52.598 11:37:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:52.598 11:37:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:52.598 11:37:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:52.598 11:37:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:52.598 11:37:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:52.598 11:37:12 -- common/autotest_common.sh@10 -- # set +x 00:12:55.128 11:37:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:55.128 11:37:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:55.128 11:37:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:55.128 11:37:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:55.128 11:37:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:55.128 11:37:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:55.128 11:37:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:55.128 11:37:14 -- nvmf/common.sh@294 -- # net_devs=() 00:12:55.128 11:37:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:55.128 11:37:14 -- nvmf/common.sh@295 -- # e810=() 00:12:55.128 11:37:14 -- nvmf/common.sh@295 -- # local -ga e810 00:12:55.128 11:37:14 -- nvmf/common.sh@296 -- # x722=() 00:12:55.128 11:37:14 -- nvmf/common.sh@296 -- # local -ga x722 00:12:55.128 11:37:14 -- nvmf/common.sh@297 -- # mlx=() 00:12:55.128 11:37:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:55.128 11:37:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:55.128 11:37:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:55.128 11:37:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:55.128 11:37:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:55.128 11:37:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:55.128 11:37:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:55.128 11:37:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:55.128 11:37:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:55.128 11:37:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:55.128 11:37:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:55.128 11:37:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:55.128 11:37:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:55.128 11:37:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:55.128 11:37:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:55.128 11:37:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:55.128 11:37:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:55.128 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:55.128 11:37:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:55.128 11:37:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:55.128 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:55.128 11:37:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:55.128 11:37:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:55.128 11:37:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:55.128 11:37:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:55.128 11:37:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:55.128 11:37:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:55.128 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:55.128 11:37:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:55.128 11:37:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:55.128 11:37:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:55.128 11:37:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:55.128 11:37:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:55.128 11:37:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:55.128 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:55.128 11:37:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:55.128 11:37:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:55.128 11:37:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:55.128 11:37:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:55.128 11:37:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:55.128 11:37:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:55.128 11:37:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:55.128 11:37:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:55.128 11:37:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:55.128 11:37:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:55.128 11:37:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:55.128 11:37:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:55.128 11:37:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:55.128 11:37:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:55.128 11:37:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:55.128 11:37:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:55.128 11:37:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:55.128 11:37:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:55.128 11:37:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:55.128 11:37:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:55.128 11:37:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:55.128 11:37:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:55.128 11:37:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:55.128 11:37:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:55.128 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:55.128 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.310 ms 00:12:55.128 00:12:55.128 --- 10.0.0.2 ping statistics --- 00:12:55.128 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:55.128 rtt min/avg/max/mdev = 0.310/0.310/0.310/0.000 ms 00:12:55.128 11:37:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:55.128 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:55.128 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:12:55.128 00:12:55.128 --- 10.0.0.1 ping statistics --- 00:12:55.128 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:55.128 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:12:55.128 11:37:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:55.128 11:37:14 -- nvmf/common.sh@410 -- # return 0 00:12:55.128 11:37:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:55.128 11:37:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:55.128 11:37:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:55.128 11:37:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:55.128 11:37:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:55.128 11:37:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:55.128 11:37:14 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:12:55.128 11:37:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:55.128 11:37:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:55.128 11:37:14 -- common/autotest_common.sh@10 -- # set +x 00:12:55.129 11:37:14 -- nvmf/common.sh@469 -- # nvmfpid=3771240 00:12:55.129 11:37:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:55.129 11:37:14 -- nvmf/common.sh@470 -- # waitforlisten 3771240 00:12:55.129 11:37:14 -- common/autotest_common.sh@829 -- # '[' -z 3771240 ']' 00:12:55.129 11:37:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:55.129 11:37:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:55.129 11:37:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:55.129 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:55.129 11:37:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:55.129 11:37:14 -- common/autotest_common.sh@10 -- # set +x 00:12:55.129 [2024-11-28 11:37:14.777330] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:55.129 [2024-11-28 11:37:14.777404] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:55.129 EAL: No free 2048 kB hugepages reported on node 1 00:12:55.129 [2024-11-28 11:37:14.843449] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:55.129 [2024-11-28 11:37:14.951564] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:55.129 [2024-11-28 11:37:14.951718] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:55.129 [2024-11-28 11:37:14.951734] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:55.129 [2024-11-28 11:37:14.951746] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:55.129 [2024-11-28 11:37:14.951825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:55.129 [2024-11-28 11:37:14.951895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:55.129 [2024-11-28 11:37:14.951898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:55.692 11:37:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:55.692 11:37:15 -- common/autotest_common.sh@862 -- # return 0 00:12:55.692 11:37:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:55.692 11:37:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:55.692 11:37:15 -- common/autotest_common.sh@10 -- # set +x 00:12:55.950 11:37:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:55.950 11:37:15 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:55.950 11:37:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:55.950 11:37:15 -- common/autotest_common.sh@10 -- # set +x 00:12:55.950 [2024-11-28 11:37:15.774356] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:55.950 11:37:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:55.950 11:37:15 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:55.950 11:37:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:55.950 11:37:15 -- common/autotest_common.sh@10 -- # set +x 00:12:55.950 11:37:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:55.950 11:37:15 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:55.950 11:37:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:55.950 11:37:15 -- common/autotest_common.sh@10 -- # set +x 00:12:55.950 [2024-11-28 11:37:15.803664] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:55.950 11:37:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:55.950 11:37:15 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:55.950 11:37:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:55.950 11:37:15 -- common/autotest_common.sh@10 -- # set +x 00:12:55.950 NULL1 00:12:55.950 11:37:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:55.950 11:37:15 -- target/connect_stress.sh@21 -- # PERF_PID=3771400 00:12:55.950 11:37:15 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:12:55.950 11:37:15 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:55.950 11:37:15 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:55.950 11:37:15 -- target/connect_stress.sh@27 -- # seq 1 20 00:12:55.950 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.950 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.950 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 EAL: No free 2048 kB hugepages reported on node 1 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.951 11:37:15 -- target/connect_stress.sh@28 -- # cat 00:12:55.951 11:37:15 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:12:55.951 11:37:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:55.951 11:37:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:55.951 11:37:15 -- common/autotest_common.sh@10 -- # set +x 00:12:56.208 11:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.208 11:37:16 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:12:56.208 11:37:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:56.208 11:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.208 11:37:16 -- common/autotest_common.sh@10 -- # set +x 00:12:56.466 11:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.466 11:37:16 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:12:56.466 11:37:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:56.466 11:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.466 11:37:16 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 11:37:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.031 11:37:16 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:12:57.031 11:37:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:57.031 11:37:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.031 11:37:16 -- common/autotest_common.sh@10 -- # set +x 00:12:57.288 11:37:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.288 11:37:17 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:12:57.288 11:37:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:57.288 11:37:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.288 11:37:17 -- common/autotest_common.sh@10 -- # set +x 00:12:57.546 11:37:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.546 11:37:17 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:12:57.546 11:37:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:57.546 11:37:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.546 11:37:17 -- common/autotest_common.sh@10 -- # set +x 00:12:57.804 11:37:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.804 11:37:17 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:12:57.804 11:37:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:57.804 11:37:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.804 11:37:17 -- common/autotest_common.sh@10 -- # set +x 00:12:58.062 11:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:58.062 11:37:18 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:12:58.062 11:37:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:58.062 11:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:58.062 11:37:18 -- common/autotest_common.sh@10 -- # set +x 00:12:58.628 11:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:58.628 11:37:18 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:12:58.628 11:37:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:58.628 11:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:58.628 11:37:18 -- common/autotest_common.sh@10 -- # set +x 00:12:58.886 11:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:58.886 11:37:18 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:12:58.886 11:37:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:58.886 11:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:58.886 11:37:18 -- common/autotest_common.sh@10 -- # set +x 00:12:59.143 11:37:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.143 11:37:19 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:12:59.143 11:37:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.143 11:37:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.143 11:37:19 -- common/autotest_common.sh@10 -- # set +x 00:12:59.401 11:37:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.402 11:37:19 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:12:59.402 11:37:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.402 11:37:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.402 11:37:19 -- common/autotest_common.sh@10 -- # set +x 00:12:59.659 11:37:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.659 11:37:19 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:12:59.659 11:37:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.659 11:37:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.659 11:37:19 -- common/autotest_common.sh@10 -- # set +x 00:13:00.224 11:37:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.224 11:37:20 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:00.224 11:37:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.224 11:37:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.224 11:37:20 -- common/autotest_common.sh@10 -- # set +x 00:13:00.482 11:37:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.482 11:37:20 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:00.482 11:37:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.482 11:37:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.482 11:37:20 -- common/autotest_common.sh@10 -- # set +x 00:13:00.739 11:37:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.739 11:37:20 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:00.739 11:37:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.739 11:37:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.739 11:37:20 -- common/autotest_common.sh@10 -- # set +x 00:13:00.997 11:37:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.997 11:37:20 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:00.997 11:37:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.997 11:37:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.997 11:37:20 -- common/autotest_common.sh@10 -- # set +x 00:13:01.562 11:37:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.562 11:37:21 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:01.562 11:37:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:01.562 11:37:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.562 11:37:21 -- common/autotest_common.sh@10 -- # set +x 00:13:01.820 11:37:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.820 11:37:21 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:01.820 11:37:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:01.820 11:37:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.820 11:37:21 -- common/autotest_common.sh@10 -- # set +x 00:13:02.078 11:37:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.078 11:37:21 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:02.078 11:37:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:02.078 11:37:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.078 11:37:21 -- common/autotest_common.sh@10 -- # set +x 00:13:02.336 11:37:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.336 11:37:22 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:02.336 11:37:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:02.336 11:37:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.336 11:37:22 -- common/autotest_common.sh@10 -- # set +x 00:13:02.593 11:37:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.593 11:37:22 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:02.593 11:37:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:02.593 11:37:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.593 11:37:22 -- common/autotest_common.sh@10 -- # set +x 00:13:03.158 11:37:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.159 11:37:22 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:03.159 11:37:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.159 11:37:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.159 11:37:22 -- common/autotest_common.sh@10 -- # set +x 00:13:03.417 11:37:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.417 11:37:23 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:03.417 11:37:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.417 11:37:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.417 11:37:23 -- common/autotest_common.sh@10 -- # set +x 00:13:03.675 11:37:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.675 11:37:23 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:03.675 11:37:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.675 11:37:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.675 11:37:23 -- common/autotest_common.sh@10 -- # set +x 00:13:03.933 11:37:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.933 11:37:23 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:03.933 11:37:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.933 11:37:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.933 11:37:23 -- common/autotest_common.sh@10 -- # set +x 00:13:04.191 11:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.191 11:37:24 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:04.191 11:37:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:04.191 11:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.191 11:37:24 -- common/autotest_common.sh@10 -- # set +x 00:13:04.758 11:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.758 11:37:24 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:04.758 11:37:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:04.758 11:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.758 11:37:24 -- common/autotest_common.sh@10 -- # set +x 00:13:05.016 11:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.016 11:37:24 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:05.016 11:37:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.016 11:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.016 11:37:24 -- common/autotest_common.sh@10 -- # set +x 00:13:05.272 11:37:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.272 11:37:25 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:05.272 11:37:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.272 11:37:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.272 11:37:25 -- common/autotest_common.sh@10 -- # set +x 00:13:05.529 11:37:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.529 11:37:25 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:05.529 11:37:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.529 11:37:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.529 11:37:25 -- common/autotest_common.sh@10 -- # set +x 00:13:05.786 11:37:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.786 11:37:25 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:05.786 11:37:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.786 11:37:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.786 11:37:25 -- common/autotest_common.sh@10 -- # set +x 00:13:06.043 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:06.302 11:37:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.302 11:37:26 -- target/connect_stress.sh@34 -- # kill -0 3771400 00:13:06.302 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3771400) - No such process 00:13:06.302 11:37:26 -- target/connect_stress.sh@38 -- # wait 3771400 00:13:06.302 11:37:26 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:06.302 11:37:26 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:06.302 11:37:26 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:06.302 11:37:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:06.302 11:37:26 -- nvmf/common.sh@116 -- # sync 00:13:06.302 11:37:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:06.302 11:37:26 -- nvmf/common.sh@119 -- # set +e 00:13:06.302 11:37:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:06.302 11:37:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:06.302 rmmod nvme_tcp 00:13:06.302 rmmod nvme_fabrics 00:13:06.302 rmmod nvme_keyring 00:13:06.302 11:37:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:06.302 11:37:26 -- nvmf/common.sh@123 -- # set -e 00:13:06.302 11:37:26 -- nvmf/common.sh@124 -- # return 0 00:13:06.302 11:37:26 -- nvmf/common.sh@477 -- # '[' -n 3771240 ']' 00:13:06.302 11:37:26 -- nvmf/common.sh@478 -- # killprocess 3771240 00:13:06.302 11:37:26 -- common/autotest_common.sh@936 -- # '[' -z 3771240 ']' 00:13:06.302 11:37:26 -- common/autotest_common.sh@940 -- # kill -0 3771240 00:13:06.302 11:37:26 -- common/autotest_common.sh@941 -- # uname 00:13:06.302 11:37:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:06.302 11:37:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3771240 00:13:06.302 11:37:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:06.302 11:37:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:06.302 11:37:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3771240' 00:13:06.302 killing process with pid 3771240 00:13:06.302 11:37:26 -- common/autotest_common.sh@955 -- # kill 3771240 00:13:06.302 11:37:26 -- common/autotest_common.sh@960 -- # wait 3771240 00:13:06.560 11:37:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:06.560 11:37:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:06.560 11:37:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:06.560 11:37:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:06.560 11:37:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:06.560 11:37:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:06.560 11:37:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:06.560 11:37:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:09.094 11:37:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:09.094 00:13:09.094 real 0m16.183s 00:13:09.094 user 0m40.971s 00:13:09.094 sys 0m5.760s 00:13:09.094 11:37:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:09.094 11:37:28 -- common/autotest_common.sh@10 -- # set +x 00:13:09.094 ************************************ 00:13:09.094 END TEST nvmf_connect_stress 00:13:09.094 ************************************ 00:13:09.094 11:37:28 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:09.094 11:37:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:09.094 11:37:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:09.094 11:37:28 -- common/autotest_common.sh@10 -- # set +x 00:13:09.094 ************************************ 00:13:09.094 START TEST nvmf_fused_ordering 00:13:09.094 ************************************ 00:13:09.094 11:37:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:09.094 * Looking for test storage... 00:13:09.094 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:09.094 11:37:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:09.094 11:37:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:09.094 11:37:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:09.094 11:37:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:09.094 11:37:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:09.094 11:37:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:09.094 11:37:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:09.094 11:37:28 -- scripts/common.sh@335 -- # IFS=.-: 00:13:09.094 11:37:28 -- scripts/common.sh@335 -- # read -ra ver1 00:13:09.094 11:37:28 -- scripts/common.sh@336 -- # IFS=.-: 00:13:09.094 11:37:28 -- scripts/common.sh@336 -- # read -ra ver2 00:13:09.094 11:37:28 -- scripts/common.sh@337 -- # local 'op=<' 00:13:09.094 11:37:28 -- scripts/common.sh@339 -- # ver1_l=2 00:13:09.094 11:37:28 -- scripts/common.sh@340 -- # ver2_l=1 00:13:09.094 11:37:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:09.094 11:37:28 -- scripts/common.sh@343 -- # case "$op" in 00:13:09.094 11:37:28 -- scripts/common.sh@344 -- # : 1 00:13:09.094 11:37:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:09.094 11:37:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:09.094 11:37:28 -- scripts/common.sh@364 -- # decimal 1 00:13:09.094 11:37:28 -- scripts/common.sh@352 -- # local d=1 00:13:09.094 11:37:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:09.094 11:37:28 -- scripts/common.sh@354 -- # echo 1 00:13:09.094 11:37:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:09.094 11:37:28 -- scripts/common.sh@365 -- # decimal 2 00:13:09.094 11:37:28 -- scripts/common.sh@352 -- # local d=2 00:13:09.094 11:37:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:09.094 11:37:28 -- scripts/common.sh@354 -- # echo 2 00:13:09.094 11:37:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:09.094 11:37:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:09.094 11:37:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:09.094 11:37:28 -- scripts/common.sh@367 -- # return 0 00:13:09.094 11:37:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:09.094 11:37:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:09.094 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.094 --rc genhtml_branch_coverage=1 00:13:09.094 --rc genhtml_function_coverage=1 00:13:09.094 --rc genhtml_legend=1 00:13:09.094 --rc geninfo_all_blocks=1 00:13:09.094 --rc geninfo_unexecuted_blocks=1 00:13:09.094 00:13:09.094 ' 00:13:09.094 11:37:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:09.094 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.094 --rc genhtml_branch_coverage=1 00:13:09.094 --rc genhtml_function_coverage=1 00:13:09.094 --rc genhtml_legend=1 00:13:09.094 --rc geninfo_all_blocks=1 00:13:09.094 --rc geninfo_unexecuted_blocks=1 00:13:09.094 00:13:09.094 ' 00:13:09.094 11:37:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:09.095 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.095 --rc genhtml_branch_coverage=1 00:13:09.095 --rc genhtml_function_coverage=1 00:13:09.095 --rc genhtml_legend=1 00:13:09.095 --rc geninfo_all_blocks=1 00:13:09.095 --rc geninfo_unexecuted_blocks=1 00:13:09.095 00:13:09.095 ' 00:13:09.095 11:37:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:09.095 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.095 --rc genhtml_branch_coverage=1 00:13:09.095 --rc genhtml_function_coverage=1 00:13:09.095 --rc genhtml_legend=1 00:13:09.095 --rc geninfo_all_blocks=1 00:13:09.095 --rc geninfo_unexecuted_blocks=1 00:13:09.095 00:13:09.095 ' 00:13:09.095 11:37:28 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:09.095 11:37:28 -- nvmf/common.sh@7 -- # uname -s 00:13:09.095 11:37:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:09.095 11:37:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:09.095 11:37:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:09.095 11:37:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:09.095 11:37:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:09.095 11:37:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:09.095 11:37:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:09.095 11:37:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:09.095 11:37:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:09.095 11:37:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:09.095 11:37:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:09.095 11:37:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:09.095 11:37:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:09.095 11:37:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:09.095 11:37:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:09.095 11:37:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:09.095 11:37:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:09.095 11:37:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:09.095 11:37:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:09.095 11:37:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.095 11:37:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.095 11:37:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.095 11:37:28 -- paths/export.sh@5 -- # export PATH 00:13:09.095 11:37:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.095 11:37:28 -- nvmf/common.sh@46 -- # : 0 00:13:09.095 11:37:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:09.095 11:37:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:09.095 11:37:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:09.095 11:37:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:09.095 11:37:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:09.095 11:37:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:09.095 11:37:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:09.095 11:37:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:09.095 11:37:28 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:09.095 11:37:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:09.095 11:37:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:09.095 11:37:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:09.095 11:37:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:09.095 11:37:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:09.095 11:37:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:09.095 11:37:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:09.095 11:37:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:09.095 11:37:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:09.095 11:37:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:09.095 11:37:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:09.095 11:37:28 -- common/autotest_common.sh@10 -- # set +x 00:13:10.997 11:37:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:10.997 11:37:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:10.997 11:37:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:10.997 11:37:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:10.997 11:37:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:10.997 11:37:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:10.997 11:37:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:10.997 11:37:30 -- nvmf/common.sh@294 -- # net_devs=() 00:13:10.997 11:37:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:10.997 11:37:30 -- nvmf/common.sh@295 -- # e810=() 00:13:10.997 11:37:30 -- nvmf/common.sh@295 -- # local -ga e810 00:13:10.997 11:37:30 -- nvmf/common.sh@296 -- # x722=() 00:13:10.997 11:37:30 -- nvmf/common.sh@296 -- # local -ga x722 00:13:10.997 11:37:30 -- nvmf/common.sh@297 -- # mlx=() 00:13:10.997 11:37:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:10.997 11:37:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:10.997 11:37:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:10.997 11:37:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:10.997 11:37:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:10.997 11:37:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:10.997 11:37:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:10.997 11:37:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:10.997 11:37:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:10.997 11:37:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:10.997 11:37:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:10.997 11:37:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:10.997 11:37:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:10.997 11:37:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:10.997 11:37:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:10.997 11:37:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:10.997 11:37:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:10.997 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:10.997 11:37:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:10.997 11:37:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:10.997 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:10.997 11:37:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:10.997 11:37:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:10.997 11:37:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:10.997 11:37:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:10.997 11:37:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:10.997 11:37:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:10.997 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:10.997 11:37:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:10.997 11:37:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:10.997 11:37:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:10.997 11:37:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:10.997 11:37:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:10.997 11:37:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:10.997 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:10.997 11:37:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:10.997 11:37:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:10.997 11:37:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:10.997 11:37:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:10.997 11:37:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:10.997 11:37:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:10.997 11:37:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:10.997 11:37:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:10.997 11:37:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:10.997 11:37:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:10.997 11:37:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:10.997 11:37:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:10.997 11:37:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:10.997 11:37:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:10.997 11:37:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:10.997 11:37:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:10.997 11:37:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:10.997 11:37:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:10.997 11:37:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:10.997 11:37:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:10.997 11:37:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:10.997 11:37:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:10.997 11:37:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:10.997 11:37:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:10.997 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:10.997 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:13:10.997 00:13:10.997 --- 10.0.0.2 ping statistics --- 00:13:10.997 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:10.997 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:13:10.997 11:37:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:10.997 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:10.997 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:13:10.997 00:13:10.997 --- 10.0.0.1 ping statistics --- 00:13:10.997 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:10.997 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:13:10.997 11:37:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:10.997 11:37:30 -- nvmf/common.sh@410 -- # return 0 00:13:10.997 11:37:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:10.997 11:37:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:10.997 11:37:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:10.997 11:37:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:10.997 11:37:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:10.997 11:37:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:10.997 11:37:31 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:10.997 11:37:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:10.997 11:37:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:10.997 11:37:31 -- common/autotest_common.sh@10 -- # set +x 00:13:10.997 11:37:31 -- nvmf/common.sh@469 -- # nvmfpid=3774718 00:13:10.997 11:37:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:10.997 11:37:31 -- nvmf/common.sh@470 -- # waitforlisten 3774718 00:13:10.997 11:37:31 -- common/autotest_common.sh@829 -- # '[' -z 3774718 ']' 00:13:10.997 11:37:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:10.997 11:37:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:10.997 11:37:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:10.997 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:10.997 11:37:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:10.997 11:37:31 -- common/autotest_common.sh@10 -- # set +x 00:13:11.256 [2024-11-28 11:37:31.062895] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:11.256 [2024-11-28 11:37:31.062981] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:11.256 EAL: No free 2048 kB hugepages reported on node 1 00:13:11.256 [2024-11-28 11:37:31.131748] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:11.256 [2024-11-28 11:37:31.247697] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:11.256 [2024-11-28 11:37:31.247856] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:11.256 [2024-11-28 11:37:31.247872] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:11.256 [2024-11-28 11:37:31.247884] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:11.256 [2024-11-28 11:37:31.247911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:12.189 11:37:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:12.189 11:37:32 -- common/autotest_common.sh@862 -- # return 0 00:13:12.189 11:37:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:12.189 11:37:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:12.189 11:37:32 -- common/autotest_common.sh@10 -- # set +x 00:13:12.189 11:37:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:12.189 11:37:32 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:12.189 11:37:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.189 11:37:32 -- common/autotest_common.sh@10 -- # set +x 00:13:12.189 [2024-11-28 11:37:32.055471] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:12.190 11:37:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.190 11:37:32 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:12.190 11:37:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.190 11:37:32 -- common/autotest_common.sh@10 -- # set +x 00:13:12.190 11:37:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.190 11:37:32 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:12.190 11:37:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.190 11:37:32 -- common/autotest_common.sh@10 -- # set +x 00:13:12.190 [2024-11-28 11:37:32.071667] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:12.190 11:37:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.190 11:37:32 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:12.190 11:37:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.190 11:37:32 -- common/autotest_common.sh@10 -- # set +x 00:13:12.190 NULL1 00:13:12.190 11:37:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.190 11:37:32 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:12.190 11:37:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.190 11:37:32 -- common/autotest_common.sh@10 -- # set +x 00:13:12.190 11:37:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.190 11:37:32 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:12.190 11:37:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.190 11:37:32 -- common/autotest_common.sh@10 -- # set +x 00:13:12.190 11:37:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.190 11:37:32 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:12.190 [2024-11-28 11:37:32.116710] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:12.190 [2024-11-28 11:37:32.116745] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3774870 ] 00:13:12.190 EAL: No free 2048 kB hugepages reported on node 1 00:13:12.756 Attached to nqn.2016-06.io.spdk:cnode1 00:13:12.756 Namespace ID: 1 size: 1GB 00:13:12.756 fused_ordering(0) 00:13:12.756 fused_ordering(1) 00:13:12.756 fused_ordering(2) 00:13:12.756 fused_ordering(3) 00:13:12.756 fused_ordering(4) 00:13:12.756 fused_ordering(5) 00:13:12.756 fused_ordering(6) 00:13:12.756 fused_ordering(7) 00:13:12.756 fused_ordering(8) 00:13:12.756 fused_ordering(9) 00:13:12.756 fused_ordering(10) 00:13:12.756 fused_ordering(11) 00:13:12.756 fused_ordering(12) 00:13:12.756 fused_ordering(13) 00:13:12.756 fused_ordering(14) 00:13:12.756 fused_ordering(15) 00:13:12.756 fused_ordering(16) 00:13:12.756 fused_ordering(17) 00:13:12.756 fused_ordering(18) 00:13:12.756 fused_ordering(19) 00:13:12.756 fused_ordering(20) 00:13:12.756 fused_ordering(21) 00:13:12.756 fused_ordering(22) 00:13:12.756 fused_ordering(23) 00:13:12.756 fused_ordering(24) 00:13:12.756 fused_ordering(25) 00:13:12.756 fused_ordering(26) 00:13:12.756 fused_ordering(27) 00:13:12.756 fused_ordering(28) 00:13:12.756 fused_ordering(29) 00:13:12.756 fused_ordering(30) 00:13:12.756 fused_ordering(31) 00:13:12.756 fused_ordering(32) 00:13:12.756 fused_ordering(33) 00:13:12.756 fused_ordering(34) 00:13:12.756 fused_ordering(35) 00:13:12.756 fused_ordering(36) 00:13:12.756 fused_ordering(37) 00:13:12.756 fused_ordering(38) 00:13:12.756 fused_ordering(39) 00:13:12.756 fused_ordering(40) 00:13:12.756 fused_ordering(41) 00:13:12.756 fused_ordering(42) 00:13:12.756 fused_ordering(43) 00:13:12.756 fused_ordering(44) 00:13:12.756 fused_ordering(45) 00:13:12.756 fused_ordering(46) 00:13:12.756 fused_ordering(47) 00:13:12.756 fused_ordering(48) 00:13:12.756 fused_ordering(49) 00:13:12.756 fused_ordering(50) 00:13:12.756 fused_ordering(51) 00:13:12.756 fused_ordering(52) 00:13:12.756 fused_ordering(53) 00:13:12.756 fused_ordering(54) 00:13:12.756 fused_ordering(55) 00:13:12.756 fused_ordering(56) 00:13:12.756 fused_ordering(57) 00:13:12.756 fused_ordering(58) 00:13:12.756 fused_ordering(59) 00:13:12.756 fused_ordering(60) 00:13:12.756 fused_ordering(61) 00:13:12.756 fused_ordering(62) 00:13:12.756 fused_ordering(63) 00:13:12.756 fused_ordering(64) 00:13:12.756 fused_ordering(65) 00:13:12.756 fused_ordering(66) 00:13:12.756 fused_ordering(67) 00:13:12.756 fused_ordering(68) 00:13:12.756 fused_ordering(69) 00:13:12.756 fused_ordering(70) 00:13:12.756 fused_ordering(71) 00:13:12.756 fused_ordering(72) 00:13:12.756 fused_ordering(73) 00:13:12.756 fused_ordering(74) 00:13:12.756 fused_ordering(75) 00:13:12.756 fused_ordering(76) 00:13:12.756 fused_ordering(77) 00:13:12.756 fused_ordering(78) 00:13:12.756 fused_ordering(79) 00:13:12.756 fused_ordering(80) 00:13:12.756 fused_ordering(81) 00:13:12.756 fused_ordering(82) 00:13:12.756 fused_ordering(83) 00:13:12.756 fused_ordering(84) 00:13:12.756 fused_ordering(85) 00:13:12.756 fused_ordering(86) 00:13:12.756 fused_ordering(87) 00:13:12.756 fused_ordering(88) 00:13:12.756 fused_ordering(89) 00:13:12.756 fused_ordering(90) 00:13:12.756 fused_ordering(91) 00:13:12.756 fused_ordering(92) 00:13:12.756 fused_ordering(93) 00:13:12.756 fused_ordering(94) 00:13:12.756 fused_ordering(95) 00:13:12.756 fused_ordering(96) 00:13:12.756 fused_ordering(97) 00:13:12.756 fused_ordering(98) 00:13:12.756 fused_ordering(99) 00:13:12.756 fused_ordering(100) 00:13:12.756 fused_ordering(101) 00:13:12.756 fused_ordering(102) 00:13:12.756 fused_ordering(103) 00:13:12.756 fused_ordering(104) 00:13:12.756 fused_ordering(105) 00:13:12.756 fused_ordering(106) 00:13:12.756 fused_ordering(107) 00:13:12.756 fused_ordering(108) 00:13:12.756 fused_ordering(109) 00:13:12.756 fused_ordering(110) 00:13:12.756 fused_ordering(111) 00:13:12.756 fused_ordering(112) 00:13:12.756 fused_ordering(113) 00:13:12.756 fused_ordering(114) 00:13:12.756 fused_ordering(115) 00:13:12.756 fused_ordering(116) 00:13:12.756 fused_ordering(117) 00:13:12.756 fused_ordering(118) 00:13:12.756 fused_ordering(119) 00:13:12.756 fused_ordering(120) 00:13:12.756 fused_ordering(121) 00:13:12.756 fused_ordering(122) 00:13:12.756 fused_ordering(123) 00:13:12.756 fused_ordering(124) 00:13:12.756 fused_ordering(125) 00:13:12.756 fused_ordering(126) 00:13:12.756 fused_ordering(127) 00:13:12.756 fused_ordering(128) 00:13:12.756 fused_ordering(129) 00:13:12.756 fused_ordering(130) 00:13:12.756 fused_ordering(131) 00:13:12.756 fused_ordering(132) 00:13:12.756 fused_ordering(133) 00:13:12.756 fused_ordering(134) 00:13:12.756 fused_ordering(135) 00:13:12.756 fused_ordering(136) 00:13:12.756 fused_ordering(137) 00:13:12.756 fused_ordering(138) 00:13:12.756 fused_ordering(139) 00:13:12.756 fused_ordering(140) 00:13:12.756 fused_ordering(141) 00:13:12.756 fused_ordering(142) 00:13:12.756 fused_ordering(143) 00:13:12.756 fused_ordering(144) 00:13:12.756 fused_ordering(145) 00:13:12.756 fused_ordering(146) 00:13:12.756 fused_ordering(147) 00:13:12.756 fused_ordering(148) 00:13:12.756 fused_ordering(149) 00:13:12.756 fused_ordering(150) 00:13:12.757 fused_ordering(151) 00:13:12.757 fused_ordering(152) 00:13:12.757 fused_ordering(153) 00:13:12.757 fused_ordering(154) 00:13:12.757 fused_ordering(155) 00:13:12.757 fused_ordering(156) 00:13:12.757 fused_ordering(157) 00:13:12.757 fused_ordering(158) 00:13:12.757 fused_ordering(159) 00:13:12.757 fused_ordering(160) 00:13:12.757 fused_ordering(161) 00:13:12.757 fused_ordering(162) 00:13:12.757 fused_ordering(163) 00:13:12.757 fused_ordering(164) 00:13:12.757 fused_ordering(165) 00:13:12.757 fused_ordering(166) 00:13:12.757 fused_ordering(167) 00:13:12.757 fused_ordering(168) 00:13:12.757 fused_ordering(169) 00:13:12.757 fused_ordering(170) 00:13:12.757 fused_ordering(171) 00:13:12.757 fused_ordering(172) 00:13:12.757 fused_ordering(173) 00:13:12.757 fused_ordering(174) 00:13:12.757 fused_ordering(175) 00:13:12.757 fused_ordering(176) 00:13:12.757 fused_ordering(177) 00:13:12.757 fused_ordering(178) 00:13:12.757 fused_ordering(179) 00:13:12.757 fused_ordering(180) 00:13:12.757 fused_ordering(181) 00:13:12.757 fused_ordering(182) 00:13:12.757 fused_ordering(183) 00:13:12.757 fused_ordering(184) 00:13:12.757 fused_ordering(185) 00:13:12.757 fused_ordering(186) 00:13:12.757 fused_ordering(187) 00:13:12.757 fused_ordering(188) 00:13:12.757 fused_ordering(189) 00:13:12.757 fused_ordering(190) 00:13:12.757 fused_ordering(191) 00:13:12.757 fused_ordering(192) 00:13:12.757 fused_ordering(193) 00:13:12.757 fused_ordering(194) 00:13:12.757 fused_ordering(195) 00:13:12.757 fused_ordering(196) 00:13:12.757 fused_ordering(197) 00:13:12.757 fused_ordering(198) 00:13:12.757 fused_ordering(199) 00:13:12.757 fused_ordering(200) 00:13:12.757 fused_ordering(201) 00:13:12.757 fused_ordering(202) 00:13:12.757 fused_ordering(203) 00:13:12.757 fused_ordering(204) 00:13:12.757 fused_ordering(205) 00:13:13.015 fused_ordering(206) 00:13:13.015 fused_ordering(207) 00:13:13.015 fused_ordering(208) 00:13:13.015 fused_ordering(209) 00:13:13.015 fused_ordering(210) 00:13:13.015 fused_ordering(211) 00:13:13.015 fused_ordering(212) 00:13:13.015 fused_ordering(213) 00:13:13.015 fused_ordering(214) 00:13:13.015 fused_ordering(215) 00:13:13.015 fused_ordering(216) 00:13:13.015 fused_ordering(217) 00:13:13.015 fused_ordering(218) 00:13:13.015 fused_ordering(219) 00:13:13.015 fused_ordering(220) 00:13:13.015 fused_ordering(221) 00:13:13.015 fused_ordering(222) 00:13:13.015 fused_ordering(223) 00:13:13.015 fused_ordering(224) 00:13:13.015 fused_ordering(225) 00:13:13.015 fused_ordering(226) 00:13:13.015 fused_ordering(227) 00:13:13.015 fused_ordering(228) 00:13:13.015 fused_ordering(229) 00:13:13.015 fused_ordering(230) 00:13:13.015 fused_ordering(231) 00:13:13.015 fused_ordering(232) 00:13:13.015 fused_ordering(233) 00:13:13.015 fused_ordering(234) 00:13:13.015 fused_ordering(235) 00:13:13.015 fused_ordering(236) 00:13:13.015 fused_ordering(237) 00:13:13.015 fused_ordering(238) 00:13:13.015 fused_ordering(239) 00:13:13.015 fused_ordering(240) 00:13:13.015 fused_ordering(241) 00:13:13.015 fused_ordering(242) 00:13:13.015 fused_ordering(243) 00:13:13.015 fused_ordering(244) 00:13:13.015 fused_ordering(245) 00:13:13.015 fused_ordering(246) 00:13:13.015 fused_ordering(247) 00:13:13.015 fused_ordering(248) 00:13:13.015 fused_ordering(249) 00:13:13.015 fused_ordering(250) 00:13:13.015 fused_ordering(251) 00:13:13.015 fused_ordering(252) 00:13:13.015 fused_ordering(253) 00:13:13.015 fused_ordering(254) 00:13:13.015 fused_ordering(255) 00:13:13.015 fused_ordering(256) 00:13:13.015 fused_ordering(257) 00:13:13.015 fused_ordering(258) 00:13:13.015 fused_ordering(259) 00:13:13.015 fused_ordering(260) 00:13:13.015 fused_ordering(261) 00:13:13.015 fused_ordering(262) 00:13:13.015 fused_ordering(263) 00:13:13.015 fused_ordering(264) 00:13:13.015 fused_ordering(265) 00:13:13.015 fused_ordering(266) 00:13:13.015 fused_ordering(267) 00:13:13.015 fused_ordering(268) 00:13:13.015 fused_ordering(269) 00:13:13.015 fused_ordering(270) 00:13:13.015 fused_ordering(271) 00:13:13.015 fused_ordering(272) 00:13:13.015 fused_ordering(273) 00:13:13.015 fused_ordering(274) 00:13:13.015 fused_ordering(275) 00:13:13.015 fused_ordering(276) 00:13:13.015 fused_ordering(277) 00:13:13.015 fused_ordering(278) 00:13:13.015 fused_ordering(279) 00:13:13.015 fused_ordering(280) 00:13:13.015 fused_ordering(281) 00:13:13.015 fused_ordering(282) 00:13:13.015 fused_ordering(283) 00:13:13.015 fused_ordering(284) 00:13:13.015 fused_ordering(285) 00:13:13.015 fused_ordering(286) 00:13:13.015 fused_ordering(287) 00:13:13.015 fused_ordering(288) 00:13:13.015 fused_ordering(289) 00:13:13.015 fused_ordering(290) 00:13:13.015 fused_ordering(291) 00:13:13.015 fused_ordering(292) 00:13:13.015 fused_ordering(293) 00:13:13.015 fused_ordering(294) 00:13:13.015 fused_ordering(295) 00:13:13.015 fused_ordering(296) 00:13:13.015 fused_ordering(297) 00:13:13.015 fused_ordering(298) 00:13:13.015 fused_ordering(299) 00:13:13.015 fused_ordering(300) 00:13:13.015 fused_ordering(301) 00:13:13.015 fused_ordering(302) 00:13:13.015 fused_ordering(303) 00:13:13.015 fused_ordering(304) 00:13:13.015 fused_ordering(305) 00:13:13.015 fused_ordering(306) 00:13:13.015 fused_ordering(307) 00:13:13.015 fused_ordering(308) 00:13:13.015 fused_ordering(309) 00:13:13.015 fused_ordering(310) 00:13:13.015 fused_ordering(311) 00:13:13.015 fused_ordering(312) 00:13:13.015 fused_ordering(313) 00:13:13.015 fused_ordering(314) 00:13:13.015 fused_ordering(315) 00:13:13.015 fused_ordering(316) 00:13:13.015 fused_ordering(317) 00:13:13.015 fused_ordering(318) 00:13:13.015 fused_ordering(319) 00:13:13.015 fused_ordering(320) 00:13:13.015 fused_ordering(321) 00:13:13.015 fused_ordering(322) 00:13:13.015 fused_ordering(323) 00:13:13.015 fused_ordering(324) 00:13:13.015 fused_ordering(325) 00:13:13.015 fused_ordering(326) 00:13:13.015 fused_ordering(327) 00:13:13.015 fused_ordering(328) 00:13:13.015 fused_ordering(329) 00:13:13.015 fused_ordering(330) 00:13:13.015 fused_ordering(331) 00:13:13.015 fused_ordering(332) 00:13:13.015 fused_ordering(333) 00:13:13.015 fused_ordering(334) 00:13:13.015 fused_ordering(335) 00:13:13.015 fused_ordering(336) 00:13:13.015 fused_ordering(337) 00:13:13.015 fused_ordering(338) 00:13:13.015 fused_ordering(339) 00:13:13.015 fused_ordering(340) 00:13:13.015 fused_ordering(341) 00:13:13.015 fused_ordering(342) 00:13:13.015 fused_ordering(343) 00:13:13.015 fused_ordering(344) 00:13:13.015 fused_ordering(345) 00:13:13.015 fused_ordering(346) 00:13:13.015 fused_ordering(347) 00:13:13.015 fused_ordering(348) 00:13:13.015 fused_ordering(349) 00:13:13.015 fused_ordering(350) 00:13:13.015 fused_ordering(351) 00:13:13.015 fused_ordering(352) 00:13:13.015 fused_ordering(353) 00:13:13.015 fused_ordering(354) 00:13:13.015 fused_ordering(355) 00:13:13.015 fused_ordering(356) 00:13:13.015 fused_ordering(357) 00:13:13.015 fused_ordering(358) 00:13:13.015 fused_ordering(359) 00:13:13.015 fused_ordering(360) 00:13:13.015 fused_ordering(361) 00:13:13.015 fused_ordering(362) 00:13:13.015 fused_ordering(363) 00:13:13.015 fused_ordering(364) 00:13:13.015 fused_ordering(365) 00:13:13.015 fused_ordering(366) 00:13:13.015 fused_ordering(367) 00:13:13.015 fused_ordering(368) 00:13:13.015 fused_ordering(369) 00:13:13.015 fused_ordering(370) 00:13:13.015 fused_ordering(371) 00:13:13.015 fused_ordering(372) 00:13:13.015 fused_ordering(373) 00:13:13.015 fused_ordering(374) 00:13:13.015 fused_ordering(375) 00:13:13.015 fused_ordering(376) 00:13:13.015 fused_ordering(377) 00:13:13.015 fused_ordering(378) 00:13:13.015 fused_ordering(379) 00:13:13.015 fused_ordering(380) 00:13:13.015 fused_ordering(381) 00:13:13.015 fused_ordering(382) 00:13:13.015 fused_ordering(383) 00:13:13.015 fused_ordering(384) 00:13:13.015 fused_ordering(385) 00:13:13.015 fused_ordering(386) 00:13:13.015 fused_ordering(387) 00:13:13.015 fused_ordering(388) 00:13:13.015 fused_ordering(389) 00:13:13.015 fused_ordering(390) 00:13:13.015 fused_ordering(391) 00:13:13.015 fused_ordering(392) 00:13:13.015 fused_ordering(393) 00:13:13.015 fused_ordering(394) 00:13:13.015 fused_ordering(395) 00:13:13.015 fused_ordering(396) 00:13:13.015 fused_ordering(397) 00:13:13.015 fused_ordering(398) 00:13:13.015 fused_ordering(399) 00:13:13.015 fused_ordering(400) 00:13:13.015 fused_ordering(401) 00:13:13.015 fused_ordering(402) 00:13:13.015 fused_ordering(403) 00:13:13.015 fused_ordering(404) 00:13:13.015 fused_ordering(405) 00:13:13.015 fused_ordering(406) 00:13:13.015 fused_ordering(407) 00:13:13.015 fused_ordering(408) 00:13:13.015 fused_ordering(409) 00:13:13.015 fused_ordering(410) 00:13:13.638 fused_ordering(411) 00:13:13.638 fused_ordering(412) 00:13:13.638 fused_ordering(413) 00:13:13.638 fused_ordering(414) 00:13:13.638 fused_ordering(415) 00:13:13.638 fused_ordering(416) 00:13:13.638 fused_ordering(417) 00:13:13.638 fused_ordering(418) 00:13:13.638 fused_ordering(419) 00:13:13.638 fused_ordering(420) 00:13:13.638 fused_ordering(421) 00:13:13.638 fused_ordering(422) 00:13:13.638 fused_ordering(423) 00:13:13.638 fused_ordering(424) 00:13:13.638 fused_ordering(425) 00:13:13.638 fused_ordering(426) 00:13:13.638 fused_ordering(427) 00:13:13.639 fused_ordering(428) 00:13:13.639 fused_ordering(429) 00:13:13.639 fused_ordering(430) 00:13:13.639 fused_ordering(431) 00:13:13.639 fused_ordering(432) 00:13:13.639 fused_ordering(433) 00:13:13.639 fused_ordering(434) 00:13:13.639 fused_ordering(435) 00:13:13.639 fused_ordering(436) 00:13:13.639 fused_ordering(437) 00:13:13.639 fused_ordering(438) 00:13:13.639 fused_ordering(439) 00:13:13.639 fused_ordering(440) 00:13:13.639 fused_ordering(441) 00:13:13.639 fused_ordering(442) 00:13:13.639 fused_ordering(443) 00:13:13.639 fused_ordering(444) 00:13:13.639 fused_ordering(445) 00:13:13.639 fused_ordering(446) 00:13:13.639 fused_ordering(447) 00:13:13.639 fused_ordering(448) 00:13:13.639 fused_ordering(449) 00:13:13.639 fused_ordering(450) 00:13:13.639 fused_ordering(451) 00:13:13.639 fused_ordering(452) 00:13:13.639 fused_ordering(453) 00:13:13.639 fused_ordering(454) 00:13:13.639 fused_ordering(455) 00:13:13.639 fused_ordering(456) 00:13:13.639 fused_ordering(457) 00:13:13.639 fused_ordering(458) 00:13:13.639 fused_ordering(459) 00:13:13.639 fused_ordering(460) 00:13:13.639 fused_ordering(461) 00:13:13.639 fused_ordering(462) 00:13:13.639 fused_ordering(463) 00:13:13.639 fused_ordering(464) 00:13:13.639 fused_ordering(465) 00:13:13.639 fused_ordering(466) 00:13:13.639 fused_ordering(467) 00:13:13.639 fused_ordering(468) 00:13:13.639 fused_ordering(469) 00:13:13.639 fused_ordering(470) 00:13:13.639 fused_ordering(471) 00:13:13.639 fused_ordering(472) 00:13:13.639 fused_ordering(473) 00:13:13.639 fused_ordering(474) 00:13:13.639 fused_ordering(475) 00:13:13.639 fused_ordering(476) 00:13:13.639 fused_ordering(477) 00:13:13.639 fused_ordering(478) 00:13:13.639 fused_ordering(479) 00:13:13.639 fused_ordering(480) 00:13:13.639 fused_ordering(481) 00:13:13.639 fused_ordering(482) 00:13:13.639 fused_ordering(483) 00:13:13.639 fused_ordering(484) 00:13:13.639 fused_ordering(485) 00:13:13.639 fused_ordering(486) 00:13:13.639 fused_ordering(487) 00:13:13.639 fused_ordering(488) 00:13:13.639 fused_ordering(489) 00:13:13.639 fused_ordering(490) 00:13:13.639 fused_ordering(491) 00:13:13.639 fused_ordering(492) 00:13:13.639 fused_ordering(493) 00:13:13.639 fused_ordering(494) 00:13:13.639 fused_ordering(495) 00:13:13.639 fused_ordering(496) 00:13:13.639 fused_ordering(497) 00:13:13.639 fused_ordering(498) 00:13:13.639 fused_ordering(499) 00:13:13.639 fused_ordering(500) 00:13:13.639 fused_ordering(501) 00:13:13.639 fused_ordering(502) 00:13:13.639 fused_ordering(503) 00:13:13.639 fused_ordering(504) 00:13:13.639 fused_ordering(505) 00:13:13.639 fused_ordering(506) 00:13:13.639 fused_ordering(507) 00:13:13.639 fused_ordering(508) 00:13:13.639 fused_ordering(509) 00:13:13.639 fused_ordering(510) 00:13:13.639 fused_ordering(511) 00:13:13.639 fused_ordering(512) 00:13:13.639 fused_ordering(513) 00:13:13.639 fused_ordering(514) 00:13:13.639 fused_ordering(515) 00:13:13.639 fused_ordering(516) 00:13:13.639 fused_ordering(517) 00:13:13.639 fused_ordering(518) 00:13:13.639 fused_ordering(519) 00:13:13.639 fused_ordering(520) 00:13:13.639 fused_ordering(521) 00:13:13.639 fused_ordering(522) 00:13:13.639 fused_ordering(523) 00:13:13.639 fused_ordering(524) 00:13:13.639 fused_ordering(525) 00:13:13.639 fused_ordering(526) 00:13:13.639 fused_ordering(527) 00:13:13.639 fused_ordering(528) 00:13:13.639 fused_ordering(529) 00:13:13.639 fused_ordering(530) 00:13:13.639 fused_ordering(531) 00:13:13.639 fused_ordering(532) 00:13:13.639 fused_ordering(533) 00:13:13.639 fused_ordering(534) 00:13:13.639 fused_ordering(535) 00:13:13.639 fused_ordering(536) 00:13:13.639 fused_ordering(537) 00:13:13.639 fused_ordering(538) 00:13:13.639 fused_ordering(539) 00:13:13.639 fused_ordering(540) 00:13:13.639 fused_ordering(541) 00:13:13.639 fused_ordering(542) 00:13:13.639 fused_ordering(543) 00:13:13.639 fused_ordering(544) 00:13:13.639 fused_ordering(545) 00:13:13.639 fused_ordering(546) 00:13:13.639 fused_ordering(547) 00:13:13.639 fused_ordering(548) 00:13:13.639 fused_ordering(549) 00:13:13.639 fused_ordering(550) 00:13:13.639 fused_ordering(551) 00:13:13.639 fused_ordering(552) 00:13:13.639 fused_ordering(553) 00:13:13.639 fused_ordering(554) 00:13:13.639 fused_ordering(555) 00:13:13.639 fused_ordering(556) 00:13:13.639 fused_ordering(557) 00:13:13.639 fused_ordering(558) 00:13:13.639 fused_ordering(559) 00:13:13.639 fused_ordering(560) 00:13:13.639 fused_ordering(561) 00:13:13.639 fused_ordering(562) 00:13:13.639 fused_ordering(563) 00:13:13.639 fused_ordering(564) 00:13:13.639 fused_ordering(565) 00:13:13.639 fused_ordering(566) 00:13:13.639 fused_ordering(567) 00:13:13.639 fused_ordering(568) 00:13:13.639 fused_ordering(569) 00:13:13.639 fused_ordering(570) 00:13:13.639 fused_ordering(571) 00:13:13.639 fused_ordering(572) 00:13:13.639 fused_ordering(573) 00:13:13.639 fused_ordering(574) 00:13:13.639 fused_ordering(575) 00:13:13.639 fused_ordering(576) 00:13:13.639 fused_ordering(577) 00:13:13.639 fused_ordering(578) 00:13:13.639 fused_ordering(579) 00:13:13.639 fused_ordering(580) 00:13:13.639 fused_ordering(581) 00:13:13.639 fused_ordering(582) 00:13:13.639 fused_ordering(583) 00:13:13.639 fused_ordering(584) 00:13:13.639 fused_ordering(585) 00:13:13.639 fused_ordering(586) 00:13:13.639 fused_ordering(587) 00:13:13.639 fused_ordering(588) 00:13:13.639 fused_ordering(589) 00:13:13.639 fused_ordering(590) 00:13:13.639 fused_ordering(591) 00:13:13.639 fused_ordering(592) 00:13:13.639 fused_ordering(593) 00:13:13.639 fused_ordering(594) 00:13:13.639 fused_ordering(595) 00:13:13.639 fused_ordering(596) 00:13:13.639 fused_ordering(597) 00:13:13.639 fused_ordering(598) 00:13:13.639 fused_ordering(599) 00:13:13.639 fused_ordering(600) 00:13:13.639 fused_ordering(601) 00:13:13.639 fused_ordering(602) 00:13:13.639 fused_ordering(603) 00:13:13.639 fused_ordering(604) 00:13:13.639 fused_ordering(605) 00:13:13.639 fused_ordering(606) 00:13:13.639 fused_ordering(607) 00:13:13.639 fused_ordering(608) 00:13:13.639 fused_ordering(609) 00:13:13.639 fused_ordering(610) 00:13:13.639 fused_ordering(611) 00:13:13.639 fused_ordering(612) 00:13:13.639 fused_ordering(613) 00:13:13.639 fused_ordering(614) 00:13:13.639 fused_ordering(615) 00:13:14.205 fused_ordering(616) 00:13:14.205 fused_ordering(617) 00:13:14.205 fused_ordering(618) 00:13:14.205 fused_ordering(619) 00:13:14.205 fused_ordering(620) 00:13:14.205 fused_ordering(621) 00:13:14.205 fused_ordering(622) 00:13:14.205 fused_ordering(623) 00:13:14.205 fused_ordering(624) 00:13:14.205 fused_ordering(625) 00:13:14.205 fused_ordering(626) 00:13:14.205 fused_ordering(627) 00:13:14.205 fused_ordering(628) 00:13:14.205 fused_ordering(629) 00:13:14.205 fused_ordering(630) 00:13:14.205 fused_ordering(631) 00:13:14.205 fused_ordering(632) 00:13:14.205 fused_ordering(633) 00:13:14.205 fused_ordering(634) 00:13:14.205 fused_ordering(635) 00:13:14.205 fused_ordering(636) 00:13:14.205 fused_ordering(637) 00:13:14.205 fused_ordering(638) 00:13:14.205 fused_ordering(639) 00:13:14.205 fused_ordering(640) 00:13:14.205 fused_ordering(641) 00:13:14.205 fused_ordering(642) 00:13:14.205 fused_ordering(643) 00:13:14.205 fused_ordering(644) 00:13:14.205 fused_ordering(645) 00:13:14.205 fused_ordering(646) 00:13:14.205 fused_ordering(647) 00:13:14.205 fused_ordering(648) 00:13:14.205 fused_ordering(649) 00:13:14.205 fused_ordering(650) 00:13:14.205 fused_ordering(651) 00:13:14.205 fused_ordering(652) 00:13:14.205 fused_ordering(653) 00:13:14.205 fused_ordering(654) 00:13:14.205 fused_ordering(655) 00:13:14.205 fused_ordering(656) 00:13:14.205 fused_ordering(657) 00:13:14.205 fused_ordering(658) 00:13:14.205 fused_ordering(659) 00:13:14.205 fused_ordering(660) 00:13:14.205 fused_ordering(661) 00:13:14.205 fused_ordering(662) 00:13:14.205 fused_ordering(663) 00:13:14.205 fused_ordering(664) 00:13:14.205 fused_ordering(665) 00:13:14.205 fused_ordering(666) 00:13:14.205 fused_ordering(667) 00:13:14.205 fused_ordering(668) 00:13:14.205 fused_ordering(669) 00:13:14.205 fused_ordering(670) 00:13:14.205 fused_ordering(671) 00:13:14.205 fused_ordering(672) 00:13:14.205 fused_ordering(673) 00:13:14.205 fused_ordering(674) 00:13:14.205 fused_ordering(675) 00:13:14.205 fused_ordering(676) 00:13:14.205 fused_ordering(677) 00:13:14.205 fused_ordering(678) 00:13:14.205 fused_ordering(679) 00:13:14.205 fused_ordering(680) 00:13:14.205 fused_ordering(681) 00:13:14.205 fused_ordering(682) 00:13:14.205 fused_ordering(683) 00:13:14.205 fused_ordering(684) 00:13:14.205 fused_ordering(685) 00:13:14.205 fused_ordering(686) 00:13:14.205 fused_ordering(687) 00:13:14.205 fused_ordering(688) 00:13:14.205 fused_ordering(689) 00:13:14.205 fused_ordering(690) 00:13:14.205 fused_ordering(691) 00:13:14.205 fused_ordering(692) 00:13:14.205 fused_ordering(693) 00:13:14.205 fused_ordering(694) 00:13:14.205 fused_ordering(695) 00:13:14.205 fused_ordering(696) 00:13:14.205 fused_ordering(697) 00:13:14.205 fused_ordering(698) 00:13:14.205 fused_ordering(699) 00:13:14.205 fused_ordering(700) 00:13:14.205 fused_ordering(701) 00:13:14.205 fused_ordering(702) 00:13:14.205 fused_ordering(703) 00:13:14.205 fused_ordering(704) 00:13:14.205 fused_ordering(705) 00:13:14.205 fused_ordering(706) 00:13:14.205 fused_ordering(707) 00:13:14.205 fused_ordering(708) 00:13:14.205 fused_ordering(709) 00:13:14.205 fused_ordering(710) 00:13:14.205 fused_ordering(711) 00:13:14.205 fused_ordering(712) 00:13:14.205 fused_ordering(713) 00:13:14.205 fused_ordering(714) 00:13:14.205 fused_ordering(715) 00:13:14.205 fused_ordering(716) 00:13:14.205 fused_ordering(717) 00:13:14.205 fused_ordering(718) 00:13:14.205 fused_ordering(719) 00:13:14.205 fused_ordering(720) 00:13:14.205 fused_ordering(721) 00:13:14.205 fused_ordering(722) 00:13:14.205 fused_ordering(723) 00:13:14.205 fused_ordering(724) 00:13:14.205 fused_ordering(725) 00:13:14.205 fused_ordering(726) 00:13:14.205 fused_ordering(727) 00:13:14.205 fused_ordering(728) 00:13:14.205 fused_ordering(729) 00:13:14.205 fused_ordering(730) 00:13:14.205 fused_ordering(731) 00:13:14.205 fused_ordering(732) 00:13:14.205 fused_ordering(733) 00:13:14.205 fused_ordering(734) 00:13:14.205 fused_ordering(735) 00:13:14.205 fused_ordering(736) 00:13:14.205 fused_ordering(737) 00:13:14.205 fused_ordering(738) 00:13:14.205 fused_ordering(739) 00:13:14.205 fused_ordering(740) 00:13:14.205 fused_ordering(741) 00:13:14.205 fused_ordering(742) 00:13:14.205 fused_ordering(743) 00:13:14.205 fused_ordering(744) 00:13:14.205 fused_ordering(745) 00:13:14.205 fused_ordering(746) 00:13:14.205 fused_ordering(747) 00:13:14.205 fused_ordering(748) 00:13:14.205 fused_ordering(749) 00:13:14.205 fused_ordering(750) 00:13:14.205 fused_ordering(751) 00:13:14.205 fused_ordering(752) 00:13:14.205 fused_ordering(753) 00:13:14.205 fused_ordering(754) 00:13:14.205 fused_ordering(755) 00:13:14.205 fused_ordering(756) 00:13:14.205 fused_ordering(757) 00:13:14.205 fused_ordering(758) 00:13:14.205 fused_ordering(759) 00:13:14.205 fused_ordering(760) 00:13:14.205 fused_ordering(761) 00:13:14.205 fused_ordering(762) 00:13:14.205 fused_ordering(763) 00:13:14.205 fused_ordering(764) 00:13:14.205 fused_ordering(765) 00:13:14.205 fused_ordering(766) 00:13:14.205 fused_ordering(767) 00:13:14.205 fused_ordering(768) 00:13:14.205 fused_ordering(769) 00:13:14.205 fused_ordering(770) 00:13:14.205 fused_ordering(771) 00:13:14.205 fused_ordering(772) 00:13:14.205 fused_ordering(773) 00:13:14.205 fused_ordering(774) 00:13:14.205 fused_ordering(775) 00:13:14.205 fused_ordering(776) 00:13:14.205 fused_ordering(777) 00:13:14.205 fused_ordering(778) 00:13:14.205 fused_ordering(779) 00:13:14.205 fused_ordering(780) 00:13:14.206 fused_ordering(781) 00:13:14.206 fused_ordering(782) 00:13:14.206 fused_ordering(783) 00:13:14.206 fused_ordering(784) 00:13:14.206 fused_ordering(785) 00:13:14.206 fused_ordering(786) 00:13:14.206 fused_ordering(787) 00:13:14.206 fused_ordering(788) 00:13:14.206 fused_ordering(789) 00:13:14.206 fused_ordering(790) 00:13:14.206 fused_ordering(791) 00:13:14.206 fused_ordering(792) 00:13:14.206 fused_ordering(793) 00:13:14.206 fused_ordering(794) 00:13:14.206 fused_ordering(795) 00:13:14.206 fused_ordering(796) 00:13:14.206 fused_ordering(797) 00:13:14.206 fused_ordering(798) 00:13:14.206 fused_ordering(799) 00:13:14.206 fused_ordering(800) 00:13:14.206 fused_ordering(801) 00:13:14.206 fused_ordering(802) 00:13:14.206 fused_ordering(803) 00:13:14.206 fused_ordering(804) 00:13:14.206 fused_ordering(805) 00:13:14.206 fused_ordering(806) 00:13:14.206 fused_ordering(807) 00:13:14.206 fused_ordering(808) 00:13:14.206 fused_ordering(809) 00:13:14.206 fused_ordering(810) 00:13:14.206 fused_ordering(811) 00:13:14.206 fused_ordering(812) 00:13:14.206 fused_ordering(813) 00:13:14.206 fused_ordering(814) 00:13:14.206 fused_ordering(815) 00:13:14.206 fused_ordering(816) 00:13:14.206 fused_ordering(817) 00:13:14.206 fused_ordering(818) 00:13:14.206 fused_ordering(819) 00:13:14.206 fused_ordering(820) 00:13:14.770 fused_ordering(821) 00:13:14.770 fused_ordering(822) 00:13:14.770 fused_ordering(823) 00:13:14.770 fused_ordering(824) 00:13:14.770 fused_ordering(825) 00:13:14.770 fused_ordering(826) 00:13:14.770 fused_ordering(827) 00:13:14.770 fused_ordering(828) 00:13:14.770 fused_ordering(829) 00:13:14.770 fused_ordering(830) 00:13:14.770 fused_ordering(831) 00:13:14.770 fused_ordering(832) 00:13:14.770 fused_ordering(833) 00:13:14.770 fused_ordering(834) 00:13:14.770 fused_ordering(835) 00:13:14.770 fused_ordering(836) 00:13:14.770 fused_ordering(837) 00:13:14.770 fused_ordering(838) 00:13:14.770 fused_ordering(839) 00:13:14.770 fused_ordering(840) 00:13:14.770 fused_ordering(841) 00:13:14.770 fused_ordering(842) 00:13:14.770 fused_ordering(843) 00:13:14.770 fused_ordering(844) 00:13:14.770 fused_ordering(845) 00:13:14.770 fused_ordering(846) 00:13:14.770 fused_ordering(847) 00:13:14.770 fused_ordering(848) 00:13:14.770 fused_ordering(849) 00:13:14.770 fused_ordering(850) 00:13:14.770 fused_ordering(851) 00:13:14.770 fused_ordering(852) 00:13:14.770 fused_ordering(853) 00:13:14.770 fused_ordering(854) 00:13:14.770 fused_ordering(855) 00:13:14.770 fused_ordering(856) 00:13:14.770 fused_ordering(857) 00:13:14.770 fused_ordering(858) 00:13:14.770 fused_ordering(859) 00:13:14.770 fused_ordering(860) 00:13:14.770 fused_ordering(861) 00:13:14.770 fused_ordering(862) 00:13:14.770 fused_ordering(863) 00:13:14.770 fused_ordering(864) 00:13:14.770 fused_ordering(865) 00:13:14.770 fused_ordering(866) 00:13:14.770 fused_ordering(867) 00:13:14.770 fused_ordering(868) 00:13:14.770 fused_ordering(869) 00:13:14.770 fused_ordering(870) 00:13:14.770 fused_ordering(871) 00:13:14.770 fused_ordering(872) 00:13:14.770 fused_ordering(873) 00:13:14.770 fused_ordering(874) 00:13:14.770 fused_ordering(875) 00:13:14.770 fused_ordering(876) 00:13:14.770 fused_ordering(877) 00:13:14.770 fused_ordering(878) 00:13:14.770 fused_ordering(879) 00:13:14.770 fused_ordering(880) 00:13:14.770 fused_ordering(881) 00:13:14.770 fused_ordering(882) 00:13:14.770 fused_ordering(883) 00:13:14.770 fused_ordering(884) 00:13:14.770 fused_ordering(885) 00:13:14.770 fused_ordering(886) 00:13:14.770 fused_ordering(887) 00:13:14.770 fused_ordering(888) 00:13:14.770 fused_ordering(889) 00:13:14.770 fused_ordering(890) 00:13:14.770 fused_ordering(891) 00:13:14.770 fused_ordering(892) 00:13:14.770 fused_ordering(893) 00:13:14.770 fused_ordering(894) 00:13:14.770 fused_ordering(895) 00:13:14.770 fused_ordering(896) 00:13:14.770 fused_ordering(897) 00:13:14.770 fused_ordering(898) 00:13:14.770 fused_ordering(899) 00:13:14.770 fused_ordering(900) 00:13:14.770 fused_ordering(901) 00:13:14.770 fused_ordering(902) 00:13:14.770 fused_ordering(903) 00:13:14.770 fused_ordering(904) 00:13:14.770 fused_ordering(905) 00:13:14.770 fused_ordering(906) 00:13:14.770 fused_ordering(907) 00:13:14.770 fused_ordering(908) 00:13:14.770 fused_ordering(909) 00:13:14.770 fused_ordering(910) 00:13:14.770 fused_ordering(911) 00:13:14.770 fused_ordering(912) 00:13:14.770 fused_ordering(913) 00:13:14.770 fused_ordering(914) 00:13:14.770 fused_ordering(915) 00:13:14.770 fused_ordering(916) 00:13:14.770 fused_ordering(917) 00:13:14.770 fused_ordering(918) 00:13:14.770 fused_ordering(919) 00:13:14.770 fused_ordering(920) 00:13:14.770 fused_ordering(921) 00:13:14.770 fused_ordering(922) 00:13:14.770 fused_ordering(923) 00:13:14.770 fused_ordering(924) 00:13:14.770 fused_ordering(925) 00:13:14.770 fused_ordering(926) 00:13:14.770 fused_ordering(927) 00:13:14.770 fused_ordering(928) 00:13:14.770 fused_ordering(929) 00:13:14.770 fused_ordering(930) 00:13:14.770 fused_ordering(931) 00:13:14.770 fused_ordering(932) 00:13:14.770 fused_ordering(933) 00:13:14.770 fused_ordering(934) 00:13:14.770 fused_ordering(935) 00:13:14.770 fused_ordering(936) 00:13:14.770 fused_ordering(937) 00:13:14.770 fused_ordering(938) 00:13:14.770 fused_ordering(939) 00:13:14.770 fused_ordering(940) 00:13:14.770 fused_ordering(941) 00:13:14.770 fused_ordering(942) 00:13:14.770 fused_ordering(943) 00:13:14.770 fused_ordering(944) 00:13:14.770 fused_ordering(945) 00:13:14.770 fused_ordering(946) 00:13:14.770 fused_ordering(947) 00:13:14.770 fused_ordering(948) 00:13:14.770 fused_ordering(949) 00:13:14.770 fused_ordering(950) 00:13:14.770 fused_ordering(951) 00:13:14.770 fused_ordering(952) 00:13:14.770 fused_ordering(953) 00:13:14.770 fused_ordering(954) 00:13:14.770 fused_ordering(955) 00:13:14.770 fused_ordering(956) 00:13:14.770 fused_ordering(957) 00:13:14.770 fused_ordering(958) 00:13:14.770 fused_ordering(959) 00:13:14.770 fused_ordering(960) 00:13:14.770 fused_ordering(961) 00:13:14.770 fused_ordering(962) 00:13:14.770 fused_ordering(963) 00:13:14.770 fused_ordering(964) 00:13:14.770 fused_ordering(965) 00:13:14.770 fused_ordering(966) 00:13:14.770 fused_ordering(967) 00:13:14.770 fused_ordering(968) 00:13:14.770 fused_ordering(969) 00:13:14.770 fused_ordering(970) 00:13:14.770 fused_ordering(971) 00:13:14.770 fused_ordering(972) 00:13:14.770 fused_ordering(973) 00:13:14.770 fused_ordering(974) 00:13:14.770 fused_ordering(975) 00:13:14.770 fused_ordering(976) 00:13:14.770 fused_ordering(977) 00:13:14.770 fused_ordering(978) 00:13:14.770 fused_ordering(979) 00:13:14.770 fused_ordering(980) 00:13:14.770 fused_ordering(981) 00:13:14.770 fused_ordering(982) 00:13:14.770 fused_ordering(983) 00:13:14.770 fused_ordering(984) 00:13:14.770 fused_ordering(985) 00:13:14.770 fused_ordering(986) 00:13:14.770 fused_ordering(987) 00:13:14.770 fused_ordering(988) 00:13:14.770 fused_ordering(989) 00:13:14.770 fused_ordering(990) 00:13:14.770 fused_ordering(991) 00:13:14.770 fused_ordering(992) 00:13:14.770 fused_ordering(993) 00:13:14.770 fused_ordering(994) 00:13:14.770 fused_ordering(995) 00:13:14.770 fused_ordering(996) 00:13:14.770 fused_ordering(997) 00:13:14.770 fused_ordering(998) 00:13:14.770 fused_ordering(999) 00:13:14.770 fused_ordering(1000) 00:13:14.770 fused_ordering(1001) 00:13:14.770 fused_ordering(1002) 00:13:14.770 fused_ordering(1003) 00:13:14.770 fused_ordering(1004) 00:13:14.770 fused_ordering(1005) 00:13:14.770 fused_ordering(1006) 00:13:14.770 fused_ordering(1007) 00:13:14.770 fused_ordering(1008) 00:13:14.770 fused_ordering(1009) 00:13:14.770 fused_ordering(1010) 00:13:14.770 fused_ordering(1011) 00:13:14.770 fused_ordering(1012) 00:13:14.770 fused_ordering(1013) 00:13:14.770 fused_ordering(1014) 00:13:14.770 fused_ordering(1015) 00:13:14.770 fused_ordering(1016) 00:13:14.770 fused_ordering(1017) 00:13:14.770 fused_ordering(1018) 00:13:14.770 fused_ordering(1019) 00:13:14.770 fused_ordering(1020) 00:13:14.771 fused_ordering(1021) 00:13:14.771 fused_ordering(1022) 00:13:14.771 fused_ordering(1023) 00:13:14.771 11:37:34 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:14.771 11:37:34 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:14.771 11:37:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:14.771 11:37:34 -- nvmf/common.sh@116 -- # sync 00:13:14.771 11:37:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:14.771 11:37:34 -- nvmf/common.sh@119 -- # set +e 00:13:14.771 11:37:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:14.771 11:37:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:14.771 rmmod nvme_tcp 00:13:14.771 rmmod nvme_fabrics 00:13:14.771 rmmod nvme_keyring 00:13:14.771 11:37:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:14.771 11:37:34 -- nvmf/common.sh@123 -- # set -e 00:13:14.771 11:37:34 -- nvmf/common.sh@124 -- # return 0 00:13:14.771 11:37:34 -- nvmf/common.sh@477 -- # '[' -n 3774718 ']' 00:13:14.771 11:37:34 -- nvmf/common.sh@478 -- # killprocess 3774718 00:13:14.771 11:37:34 -- common/autotest_common.sh@936 -- # '[' -z 3774718 ']' 00:13:14.771 11:37:34 -- common/autotest_common.sh@940 -- # kill -0 3774718 00:13:14.771 11:37:34 -- common/autotest_common.sh@941 -- # uname 00:13:14.771 11:37:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:14.771 11:37:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3774718 00:13:14.771 11:37:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:14.771 11:37:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:14.771 11:37:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3774718' 00:13:14.771 killing process with pid 3774718 00:13:14.771 11:37:34 -- common/autotest_common.sh@955 -- # kill 3774718 00:13:14.771 11:37:34 -- common/autotest_common.sh@960 -- # wait 3774718 00:13:15.029 11:37:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:15.029 11:37:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:15.029 11:37:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:15.029 11:37:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:15.029 11:37:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:15.029 11:37:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:15.029 11:37:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:15.029 11:37:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:17.564 11:37:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:17.564 00:13:17.564 real 0m8.521s 00:13:17.564 user 0m6.132s 00:13:17.564 sys 0m3.535s 00:13:17.564 11:37:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:17.564 11:37:37 -- common/autotest_common.sh@10 -- # set +x 00:13:17.564 ************************************ 00:13:17.564 END TEST nvmf_fused_ordering 00:13:17.564 ************************************ 00:13:17.564 11:37:37 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:17.564 11:37:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:17.564 11:37:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:17.564 11:37:37 -- common/autotest_common.sh@10 -- # set +x 00:13:17.564 ************************************ 00:13:17.564 START TEST nvmf_delete_subsystem 00:13:17.564 ************************************ 00:13:17.564 11:37:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:17.564 * Looking for test storage... 00:13:17.564 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:17.564 11:37:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:17.564 11:37:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:17.564 11:37:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:17.564 11:37:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:17.564 11:37:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:17.564 11:37:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:17.564 11:37:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:17.564 11:37:37 -- scripts/common.sh@335 -- # IFS=.-: 00:13:17.564 11:37:37 -- scripts/common.sh@335 -- # read -ra ver1 00:13:17.564 11:37:37 -- scripts/common.sh@336 -- # IFS=.-: 00:13:17.564 11:37:37 -- scripts/common.sh@336 -- # read -ra ver2 00:13:17.564 11:37:37 -- scripts/common.sh@337 -- # local 'op=<' 00:13:17.564 11:37:37 -- scripts/common.sh@339 -- # ver1_l=2 00:13:17.564 11:37:37 -- scripts/common.sh@340 -- # ver2_l=1 00:13:17.564 11:37:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:17.564 11:37:37 -- scripts/common.sh@343 -- # case "$op" in 00:13:17.564 11:37:37 -- scripts/common.sh@344 -- # : 1 00:13:17.564 11:37:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:17.564 11:37:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:17.564 11:37:37 -- scripts/common.sh@364 -- # decimal 1 00:13:17.564 11:37:37 -- scripts/common.sh@352 -- # local d=1 00:13:17.564 11:37:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:17.564 11:37:37 -- scripts/common.sh@354 -- # echo 1 00:13:17.564 11:37:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:17.564 11:37:37 -- scripts/common.sh@365 -- # decimal 2 00:13:17.564 11:37:37 -- scripts/common.sh@352 -- # local d=2 00:13:17.564 11:37:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:17.564 11:37:37 -- scripts/common.sh@354 -- # echo 2 00:13:17.564 11:37:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:17.564 11:37:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:17.564 11:37:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:17.564 11:37:37 -- scripts/common.sh@367 -- # return 0 00:13:17.564 11:37:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:17.564 11:37:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:17.564 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:17.564 --rc genhtml_branch_coverage=1 00:13:17.564 --rc genhtml_function_coverage=1 00:13:17.564 --rc genhtml_legend=1 00:13:17.564 --rc geninfo_all_blocks=1 00:13:17.564 --rc geninfo_unexecuted_blocks=1 00:13:17.564 00:13:17.564 ' 00:13:17.564 11:37:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:17.564 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:17.564 --rc genhtml_branch_coverage=1 00:13:17.564 --rc genhtml_function_coverage=1 00:13:17.564 --rc genhtml_legend=1 00:13:17.564 --rc geninfo_all_blocks=1 00:13:17.564 --rc geninfo_unexecuted_blocks=1 00:13:17.564 00:13:17.564 ' 00:13:17.564 11:37:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:17.564 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:17.564 --rc genhtml_branch_coverage=1 00:13:17.564 --rc genhtml_function_coverage=1 00:13:17.564 --rc genhtml_legend=1 00:13:17.564 --rc geninfo_all_blocks=1 00:13:17.564 --rc geninfo_unexecuted_blocks=1 00:13:17.564 00:13:17.564 ' 00:13:17.564 11:37:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:17.564 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:17.564 --rc genhtml_branch_coverage=1 00:13:17.564 --rc genhtml_function_coverage=1 00:13:17.564 --rc genhtml_legend=1 00:13:17.564 --rc geninfo_all_blocks=1 00:13:17.565 --rc geninfo_unexecuted_blocks=1 00:13:17.565 00:13:17.565 ' 00:13:17.565 11:37:37 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:17.565 11:37:37 -- nvmf/common.sh@7 -- # uname -s 00:13:17.565 11:37:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:17.565 11:37:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:17.565 11:37:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:17.565 11:37:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:17.565 11:37:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:17.565 11:37:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:17.565 11:37:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:17.565 11:37:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:17.565 11:37:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:17.565 11:37:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:17.565 11:37:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:17.565 11:37:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:17.565 11:37:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:17.565 11:37:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:17.565 11:37:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:17.565 11:37:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:17.565 11:37:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:17.565 11:37:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:17.565 11:37:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:17.565 11:37:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:17.565 11:37:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:17.565 11:37:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:17.565 11:37:37 -- paths/export.sh@5 -- # export PATH 00:13:17.565 11:37:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:17.565 11:37:37 -- nvmf/common.sh@46 -- # : 0 00:13:17.565 11:37:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:17.565 11:37:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:17.565 11:37:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:17.565 11:37:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:17.565 11:37:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:17.565 11:37:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:17.565 11:37:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:17.565 11:37:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:17.565 11:37:37 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:17.565 11:37:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:17.565 11:37:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:17.565 11:37:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:17.565 11:37:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:17.565 11:37:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:17.565 11:37:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:17.565 11:37:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:17.565 11:37:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:17.565 11:37:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:17.565 11:37:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:17.565 11:37:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:17.565 11:37:37 -- common/autotest_common.sh@10 -- # set +x 00:13:19.470 11:37:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:19.470 11:37:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:19.470 11:37:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:19.470 11:37:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:19.470 11:37:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:19.470 11:37:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:19.470 11:37:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:19.470 11:37:39 -- nvmf/common.sh@294 -- # net_devs=() 00:13:19.470 11:37:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:19.470 11:37:39 -- nvmf/common.sh@295 -- # e810=() 00:13:19.470 11:37:39 -- nvmf/common.sh@295 -- # local -ga e810 00:13:19.470 11:37:39 -- nvmf/common.sh@296 -- # x722=() 00:13:19.470 11:37:39 -- nvmf/common.sh@296 -- # local -ga x722 00:13:19.470 11:37:39 -- nvmf/common.sh@297 -- # mlx=() 00:13:19.470 11:37:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:19.470 11:37:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:19.470 11:37:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:19.470 11:37:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:19.470 11:37:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:19.470 11:37:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:19.470 11:37:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:19.470 11:37:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:19.470 11:37:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:19.470 11:37:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:19.470 11:37:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:19.470 11:37:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:19.470 11:37:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:19.470 11:37:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:19.470 11:37:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:19.470 11:37:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:19.470 11:37:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:19.470 11:37:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:19.470 11:37:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:19.471 11:37:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:19.471 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:19.471 11:37:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:19.471 11:37:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:19.471 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:19.471 11:37:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:19.471 11:37:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:19.471 11:37:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:19.471 11:37:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:19.471 11:37:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:19.471 11:37:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:19.471 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:19.471 11:37:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:19.471 11:37:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:19.471 11:37:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:19.471 11:37:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:19.471 11:37:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:19.471 11:37:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:19.471 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:19.471 11:37:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:19.471 11:37:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:19.471 11:37:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:19.471 11:37:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:19.471 11:37:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:19.471 11:37:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:19.471 11:37:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:19.471 11:37:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:19.471 11:37:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:19.471 11:37:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:19.471 11:37:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:19.471 11:37:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:19.471 11:37:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:19.471 11:37:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:19.471 11:37:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:19.471 11:37:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:19.471 11:37:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:19.471 11:37:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:19.471 11:37:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:19.471 11:37:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:19.471 11:37:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:19.471 11:37:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:19.471 11:37:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:19.471 11:37:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:19.471 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:19.471 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.252 ms 00:13:19.471 00:13:19.471 --- 10.0.0.2 ping statistics --- 00:13:19.471 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:19.471 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:13:19.471 11:37:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:19.471 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:19.471 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.155 ms 00:13:19.471 00:13:19.471 --- 10.0.0.1 ping statistics --- 00:13:19.471 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:19.471 rtt min/avg/max/mdev = 0.155/0.155/0.155/0.000 ms 00:13:19.471 11:37:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:19.471 11:37:39 -- nvmf/common.sh@410 -- # return 0 00:13:19.471 11:37:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:19.471 11:37:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:19.471 11:37:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:19.471 11:37:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:19.471 11:37:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:19.471 11:37:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:19.471 11:37:39 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:19.471 11:37:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:19.471 11:37:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:19.471 11:37:39 -- common/autotest_common.sh@10 -- # set +x 00:13:19.471 11:37:39 -- nvmf/common.sh@469 -- # nvmfpid=3777113 00:13:19.471 11:37:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:19.471 11:37:39 -- nvmf/common.sh@470 -- # waitforlisten 3777113 00:13:19.471 11:37:39 -- common/autotest_common.sh@829 -- # '[' -z 3777113 ']' 00:13:19.471 11:37:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:19.471 11:37:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:19.471 11:37:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:19.471 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:19.471 11:37:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:19.471 11:37:39 -- common/autotest_common.sh@10 -- # set +x 00:13:19.728 [2024-11-28 11:37:39.536651] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:19.728 [2024-11-28 11:37:39.536737] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:19.728 EAL: No free 2048 kB hugepages reported on node 1 00:13:19.728 [2024-11-28 11:37:39.599208] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:19.728 [2024-11-28 11:37:39.704020] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:19.728 [2024-11-28 11:37:39.704156] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:19.728 [2024-11-28 11:37:39.704173] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:19.728 [2024-11-28 11:37:39.704186] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:19.728 [2024-11-28 11:37:39.704251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:19.728 [2024-11-28 11:37:39.704257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:20.661 11:37:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:20.661 11:37:40 -- common/autotest_common.sh@862 -- # return 0 00:13:20.661 11:37:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:20.661 11:37:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:20.661 11:37:40 -- common/autotest_common.sh@10 -- # set +x 00:13:20.661 11:37:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:20.661 11:37:40 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:20.661 11:37:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.661 11:37:40 -- common/autotest_common.sh@10 -- # set +x 00:13:20.661 [2024-11-28 11:37:40.566592] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:20.661 11:37:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.661 11:37:40 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:20.661 11:37:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.661 11:37:40 -- common/autotest_common.sh@10 -- # set +x 00:13:20.661 11:37:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.661 11:37:40 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:20.661 11:37:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.661 11:37:40 -- common/autotest_common.sh@10 -- # set +x 00:13:20.661 [2024-11-28 11:37:40.582851] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:20.661 11:37:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.661 11:37:40 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:20.661 11:37:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.661 11:37:40 -- common/autotest_common.sh@10 -- # set +x 00:13:20.661 NULL1 00:13:20.661 11:37:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.661 11:37:40 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:20.661 11:37:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.661 11:37:40 -- common/autotest_common.sh@10 -- # set +x 00:13:20.661 Delay0 00:13:20.661 11:37:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.661 11:37:40 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:20.661 11:37:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.661 11:37:40 -- common/autotest_common.sh@10 -- # set +x 00:13:20.661 11:37:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.661 11:37:40 -- target/delete_subsystem.sh@28 -- # perf_pid=3777267 00:13:20.661 11:37:40 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:20.661 11:37:40 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:20.661 EAL: No free 2048 kB hugepages reported on node 1 00:13:20.661 [2024-11-28 11:37:40.657441] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:22.560 11:37:42 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:22.560 11:37:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.560 11:37:42 -- common/autotest_common.sh@10 -- # set +x 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 starting I/O failed: -6 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Write completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 Read completed with error (sct=0, sc=8) 00:13:22.819 starting I/O failed: -6 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.820 starting I/O failed: -6 00:13:22.820 Write completed with error (sct=0, sc=8) 00:13:22.820 Read completed with error (sct=0, sc=8) 00:13:22.820 starting I/O failed: -6 00:13:22.821 starting I/O failed: -6 00:13:22.821 Write completed with error (sct=0, sc=8) 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 starting I/O failed: -6 00:13:22.821 starting I/O failed: -6 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 starting I/O failed: -6 00:13:22.821 starting I/O failed: -6 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 Write completed with error (sct=0, sc=8) 00:13:22.821 starting I/O failed: -6 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 Write completed with error (sct=0, sc=8) 00:13:22.821 starting I/O failed: -6 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 Write completed with error (sct=0, sc=8) 00:13:22.821 starting I/O failed: -6 00:13:22.821 Write completed with error (sct=0, sc=8) 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 starting I/O failed: -6 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 starting I/O failed: -6 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 starting I/O failed: -6 00:13:22.821 Write completed with error (sct=0, sc=8) 00:13:22.821 Write completed with error (sct=0, sc=8) 00:13:22.821 starting I/O failed: -6 00:13:22.821 Write completed with error (sct=0, sc=8) 00:13:22.821 Write completed with error (sct=0, sc=8) 00:13:22.821 starting I/O failed: -6 00:13:22.821 Write completed with error (sct=0, sc=8) 00:13:22.821 Write completed with error (sct=0, sc=8) 00:13:22.821 starting I/O failed: -6 00:13:22.821 Write completed with error (sct=0, sc=8) 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 starting I/O failed: -6 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 starting I/O failed: -6 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 Read completed with error (sct=0, sc=8) 00:13:22.821 starting I/O failed: -6 00:13:22.821 [2024-11-28 11:37:42.741206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f8b6c000c00 is same with the state(5) to be set 00:13:23.755 [2024-11-28 11:37:43.712989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x189d960 is same with the state(5) to be set 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 [2024-11-28 11:37:43.736685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1884770 is same with the state(5) to be set 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.755 Write completed with error (sct=0, sc=8) 00:13:23.755 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 [2024-11-28 11:37:43.741851] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a43d0 is same with the state(5) to be set 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 [2024-11-28 11:37:43.742316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f8b6c00bf20 is same with the state(5) to be set 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Write completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 Read completed with error (sct=0, sc=8) 00:13:23.756 [2024-11-28 11:37:43.742581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f8b6c00c600 is same with the state(5) to be set 00:13:23.756 [2024-11-28 11:37:43.743316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x189d960 (9): Bad file descriptor 00:13:23.756 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:23.756 11:37:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.756 11:37:43 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:23.756 11:37:43 -- target/delete_subsystem.sh@35 -- # kill -0 3777267 00:13:23.756 11:37:43 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:23.756 Initializing NVMe Controllers 00:13:23.756 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:23.756 Controller IO queue size 128, less than required. 00:13:23.756 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:23.756 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:23.756 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:23.756 Initialization complete. Launching workers. 00:13:23.756 ======================================================== 00:13:23.756 Latency(us) 00:13:23.756 Device Information : IOPS MiB/s Average min max 00:13:23.756 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 174.68 0.09 945308.52 579.53 1011904.53 00:13:23.756 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 187.58 0.09 902136.85 762.14 1013370.10 00:13:23.756 ======================================================== 00:13:23.756 Total : 362.26 0.18 922953.87 579.53 1013370.10 00:13:23.756 00:13:24.322 11:37:44 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:24.322 11:37:44 -- target/delete_subsystem.sh@35 -- # kill -0 3777267 00:13:24.322 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3777267) - No such process 00:13:24.322 11:37:44 -- target/delete_subsystem.sh@45 -- # NOT wait 3777267 00:13:24.322 11:37:44 -- common/autotest_common.sh@650 -- # local es=0 00:13:24.322 11:37:44 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 3777267 00:13:24.322 11:37:44 -- common/autotest_common.sh@638 -- # local arg=wait 00:13:24.322 11:37:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:24.322 11:37:44 -- common/autotest_common.sh@642 -- # type -t wait 00:13:24.322 11:37:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:24.322 11:37:44 -- common/autotest_common.sh@653 -- # wait 3777267 00:13:24.322 11:37:44 -- common/autotest_common.sh@653 -- # es=1 00:13:24.322 11:37:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:24.322 11:37:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:24.322 11:37:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:24.322 11:37:44 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:24.322 11:37:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.322 11:37:44 -- common/autotest_common.sh@10 -- # set +x 00:13:24.322 11:37:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.322 11:37:44 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:24.322 11:37:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.322 11:37:44 -- common/autotest_common.sh@10 -- # set +x 00:13:24.322 [2024-11-28 11:37:44.262701] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:24.322 11:37:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.322 11:37:44 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:24.322 11:37:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.322 11:37:44 -- common/autotest_common.sh@10 -- # set +x 00:13:24.322 11:37:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.322 11:37:44 -- target/delete_subsystem.sh@54 -- # perf_pid=3777697 00:13:24.322 11:37:44 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:24.322 11:37:44 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:24.322 11:37:44 -- target/delete_subsystem.sh@57 -- # kill -0 3777697 00:13:24.322 11:37:44 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:24.322 EAL: No free 2048 kB hugepages reported on node 1 00:13:24.322 [2024-11-28 11:37:44.319888] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:24.888 11:37:44 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:24.888 11:37:44 -- target/delete_subsystem.sh@57 -- # kill -0 3777697 00:13:24.888 11:37:44 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:25.453 11:37:45 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:25.453 11:37:45 -- target/delete_subsystem.sh@57 -- # kill -0 3777697 00:13:25.453 11:37:45 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:26.019 11:37:45 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:26.019 11:37:45 -- target/delete_subsystem.sh@57 -- # kill -0 3777697 00:13:26.019 11:37:45 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:26.277 11:37:46 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:26.277 11:37:46 -- target/delete_subsystem.sh@57 -- # kill -0 3777697 00:13:26.277 11:37:46 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:26.843 11:37:46 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:26.843 11:37:46 -- target/delete_subsystem.sh@57 -- # kill -0 3777697 00:13:26.843 11:37:46 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:27.407 11:37:47 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:27.407 11:37:47 -- target/delete_subsystem.sh@57 -- # kill -0 3777697 00:13:27.407 11:37:47 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:27.665 Initializing NVMe Controllers 00:13:27.665 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:27.665 Controller IO queue size 128, less than required. 00:13:27.665 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:27.665 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:27.665 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:27.665 Initialization complete. Launching workers. 00:13:27.665 ======================================================== 00:13:27.665 Latency(us) 00:13:27.665 Device Information : IOPS MiB/s Average min max 00:13:27.665 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004607.00 1000170.82 1043153.80 00:13:27.665 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004249.45 1000183.71 1012340.69 00:13:27.665 ======================================================== 00:13:27.665 Total : 256.00 0.12 1004428.22 1000170.82 1043153.80 00:13:27.665 00:13:27.924 11:37:47 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:27.924 11:37:47 -- target/delete_subsystem.sh@57 -- # kill -0 3777697 00:13:27.924 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3777697) - No such process 00:13:27.924 11:37:47 -- target/delete_subsystem.sh@67 -- # wait 3777697 00:13:27.924 11:37:47 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:27.924 11:37:47 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:27.924 11:37:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:27.924 11:37:47 -- nvmf/common.sh@116 -- # sync 00:13:27.924 11:37:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:27.924 11:37:47 -- nvmf/common.sh@119 -- # set +e 00:13:27.924 11:37:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:27.924 11:37:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:27.924 rmmod nvme_tcp 00:13:27.924 rmmod nvme_fabrics 00:13:27.924 rmmod nvme_keyring 00:13:27.924 11:37:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:27.924 11:37:47 -- nvmf/common.sh@123 -- # set -e 00:13:27.924 11:37:47 -- nvmf/common.sh@124 -- # return 0 00:13:27.924 11:37:47 -- nvmf/common.sh@477 -- # '[' -n 3777113 ']' 00:13:27.924 11:37:47 -- nvmf/common.sh@478 -- # killprocess 3777113 00:13:27.924 11:37:47 -- common/autotest_common.sh@936 -- # '[' -z 3777113 ']' 00:13:27.924 11:37:47 -- common/autotest_common.sh@940 -- # kill -0 3777113 00:13:27.924 11:37:47 -- common/autotest_common.sh@941 -- # uname 00:13:27.924 11:37:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:27.924 11:37:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3777113 00:13:27.924 11:37:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:27.924 11:37:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:27.924 11:37:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3777113' 00:13:27.924 killing process with pid 3777113 00:13:27.924 11:37:47 -- common/autotest_common.sh@955 -- # kill 3777113 00:13:27.924 11:37:47 -- common/autotest_common.sh@960 -- # wait 3777113 00:13:28.183 11:37:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:28.183 11:37:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:28.183 11:37:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:28.183 11:37:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:28.183 11:37:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:28.183 11:37:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:28.183 11:37:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:28.183 11:37:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:30.714 11:37:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:30.714 00:13:30.714 real 0m13.101s 00:13:30.714 user 0m29.444s 00:13:30.714 sys 0m2.969s 00:13:30.714 11:37:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:30.714 11:37:50 -- common/autotest_common.sh@10 -- # set +x 00:13:30.714 ************************************ 00:13:30.714 END TEST nvmf_delete_subsystem 00:13:30.714 ************************************ 00:13:30.714 11:37:50 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:13:30.714 11:37:50 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:30.714 11:37:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:30.714 11:37:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:30.714 11:37:50 -- common/autotest_common.sh@10 -- # set +x 00:13:30.714 ************************************ 00:13:30.714 START TEST nvmf_nvme_cli 00:13:30.714 ************************************ 00:13:30.714 11:37:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:30.714 * Looking for test storage... 00:13:30.714 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:30.714 11:37:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:30.714 11:37:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:30.714 11:37:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:30.714 11:37:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:30.714 11:37:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:30.714 11:37:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:30.715 11:37:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:30.715 11:37:50 -- scripts/common.sh@335 -- # IFS=.-: 00:13:30.715 11:37:50 -- scripts/common.sh@335 -- # read -ra ver1 00:13:30.715 11:37:50 -- scripts/common.sh@336 -- # IFS=.-: 00:13:30.715 11:37:50 -- scripts/common.sh@336 -- # read -ra ver2 00:13:30.715 11:37:50 -- scripts/common.sh@337 -- # local 'op=<' 00:13:30.715 11:37:50 -- scripts/common.sh@339 -- # ver1_l=2 00:13:30.715 11:37:50 -- scripts/common.sh@340 -- # ver2_l=1 00:13:30.715 11:37:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:30.715 11:37:50 -- scripts/common.sh@343 -- # case "$op" in 00:13:30.715 11:37:50 -- scripts/common.sh@344 -- # : 1 00:13:30.715 11:37:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:30.715 11:37:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:30.715 11:37:50 -- scripts/common.sh@364 -- # decimal 1 00:13:30.715 11:37:50 -- scripts/common.sh@352 -- # local d=1 00:13:30.715 11:37:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:30.715 11:37:50 -- scripts/common.sh@354 -- # echo 1 00:13:30.715 11:37:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:30.715 11:37:50 -- scripts/common.sh@365 -- # decimal 2 00:13:30.715 11:37:50 -- scripts/common.sh@352 -- # local d=2 00:13:30.715 11:37:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:30.715 11:37:50 -- scripts/common.sh@354 -- # echo 2 00:13:30.715 11:37:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:30.715 11:37:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:30.715 11:37:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:30.715 11:37:50 -- scripts/common.sh@367 -- # return 0 00:13:30.715 11:37:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:30.715 11:37:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:30.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.715 --rc genhtml_branch_coverage=1 00:13:30.715 --rc genhtml_function_coverage=1 00:13:30.715 --rc genhtml_legend=1 00:13:30.715 --rc geninfo_all_blocks=1 00:13:30.715 --rc geninfo_unexecuted_blocks=1 00:13:30.715 00:13:30.715 ' 00:13:30.715 11:37:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:30.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.715 --rc genhtml_branch_coverage=1 00:13:30.715 --rc genhtml_function_coverage=1 00:13:30.715 --rc genhtml_legend=1 00:13:30.715 --rc geninfo_all_blocks=1 00:13:30.715 --rc geninfo_unexecuted_blocks=1 00:13:30.715 00:13:30.715 ' 00:13:30.715 11:37:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:30.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.715 --rc genhtml_branch_coverage=1 00:13:30.715 --rc genhtml_function_coverage=1 00:13:30.715 --rc genhtml_legend=1 00:13:30.715 --rc geninfo_all_blocks=1 00:13:30.715 --rc geninfo_unexecuted_blocks=1 00:13:30.715 00:13:30.715 ' 00:13:30.715 11:37:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:30.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.715 --rc genhtml_branch_coverage=1 00:13:30.715 --rc genhtml_function_coverage=1 00:13:30.715 --rc genhtml_legend=1 00:13:30.715 --rc geninfo_all_blocks=1 00:13:30.715 --rc geninfo_unexecuted_blocks=1 00:13:30.715 00:13:30.715 ' 00:13:30.715 11:37:50 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:30.715 11:37:50 -- nvmf/common.sh@7 -- # uname -s 00:13:30.715 11:37:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:30.715 11:37:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:30.715 11:37:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:30.715 11:37:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:30.715 11:37:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:30.715 11:37:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:30.715 11:37:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:30.715 11:37:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:30.715 11:37:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:30.715 11:37:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:30.715 11:37:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:30.715 11:37:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:30.715 11:37:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:30.715 11:37:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:30.715 11:37:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:30.715 11:37:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:30.715 11:37:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:30.715 11:37:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:30.715 11:37:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:30.715 11:37:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.715 11:37:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.715 11:37:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.715 11:37:50 -- paths/export.sh@5 -- # export PATH 00:13:30.715 11:37:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.715 11:37:50 -- nvmf/common.sh@46 -- # : 0 00:13:30.715 11:37:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:30.715 11:37:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:30.715 11:37:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:30.715 11:37:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:30.715 11:37:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:30.715 11:37:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:30.715 11:37:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:30.715 11:37:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:30.715 11:37:50 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:30.715 11:37:50 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:30.715 11:37:50 -- target/nvme_cli.sh@14 -- # devs=() 00:13:30.715 11:37:50 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:13:30.715 11:37:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:30.715 11:37:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:30.715 11:37:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:30.715 11:37:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:30.715 11:37:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:30.715 11:37:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:30.715 11:37:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:30.715 11:37:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:30.715 11:37:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:30.715 11:37:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:30.715 11:37:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:30.715 11:37:50 -- common/autotest_common.sh@10 -- # set +x 00:13:32.619 11:37:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:32.619 11:37:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:32.619 11:37:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:32.619 11:37:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:32.619 11:37:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:32.619 11:37:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:32.619 11:37:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:32.619 11:37:52 -- nvmf/common.sh@294 -- # net_devs=() 00:13:32.619 11:37:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:32.619 11:37:52 -- nvmf/common.sh@295 -- # e810=() 00:13:32.619 11:37:52 -- nvmf/common.sh@295 -- # local -ga e810 00:13:32.619 11:37:52 -- nvmf/common.sh@296 -- # x722=() 00:13:32.619 11:37:52 -- nvmf/common.sh@296 -- # local -ga x722 00:13:32.619 11:37:52 -- nvmf/common.sh@297 -- # mlx=() 00:13:32.619 11:37:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:32.619 11:37:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:32.619 11:37:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:32.619 11:37:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:32.619 11:37:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:32.619 11:37:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:32.619 11:37:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:32.619 11:37:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:32.619 11:37:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:32.619 11:37:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:32.619 11:37:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:32.619 11:37:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:32.619 11:37:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:32.619 11:37:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:32.619 11:37:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:32.619 11:37:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:32.619 11:37:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:32.619 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:32.619 11:37:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:32.619 11:37:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:32.619 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:32.619 11:37:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:32.619 11:37:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:32.619 11:37:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:32.619 11:37:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:32.619 11:37:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:32.619 11:37:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:32.619 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:32.619 11:37:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:32.619 11:37:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:32.619 11:37:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:32.619 11:37:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:32.619 11:37:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:32.619 11:37:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:32.619 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:32.619 11:37:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:32.619 11:37:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:32.619 11:37:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:32.619 11:37:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:32.619 11:37:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:32.619 11:37:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:32.619 11:37:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:32.619 11:37:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:32.619 11:37:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:32.619 11:37:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:32.619 11:37:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:32.619 11:37:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:32.619 11:37:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:32.619 11:37:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:32.619 11:37:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:32.619 11:37:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:32.619 11:37:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:32.619 11:37:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:32.619 11:37:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:32.619 11:37:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:32.619 11:37:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:32.619 11:37:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:32.877 11:37:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:32.877 11:37:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:32.877 11:37:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:32.877 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:32.877 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:13:32.877 00:13:32.877 --- 10.0.0.2 ping statistics --- 00:13:32.877 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:32.877 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:13:32.877 11:37:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:32.877 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:32.877 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:13:32.877 00:13:32.877 --- 10.0.0.1 ping statistics --- 00:13:32.877 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:32.877 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:13:32.877 11:37:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:32.877 11:37:52 -- nvmf/common.sh@410 -- # return 0 00:13:32.877 11:37:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:32.877 11:37:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:32.877 11:37:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:32.877 11:37:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:32.877 11:37:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:32.877 11:37:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:32.878 11:37:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:32.878 11:37:52 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:13:32.878 11:37:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:32.878 11:37:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:32.878 11:37:52 -- common/autotest_common.sh@10 -- # set +x 00:13:32.878 11:37:52 -- nvmf/common.sh@469 -- # nvmfpid=3780173 00:13:32.878 11:37:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:32.878 11:37:52 -- nvmf/common.sh@470 -- # waitforlisten 3780173 00:13:32.878 11:37:52 -- common/autotest_common.sh@829 -- # '[' -z 3780173 ']' 00:13:32.878 11:37:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:32.878 11:37:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:32.878 11:37:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:32.878 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:32.878 11:37:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:32.878 11:37:52 -- common/autotest_common.sh@10 -- # set +x 00:13:32.878 [2024-11-28 11:37:52.775668] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:32.878 [2024-11-28 11:37:52.775737] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:32.878 EAL: No free 2048 kB hugepages reported on node 1 00:13:32.878 [2024-11-28 11:37:52.838011] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:33.135 [2024-11-28 11:37:52.945069] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:33.135 [2024-11-28 11:37:52.945224] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:33.135 [2024-11-28 11:37:52.945240] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:33.135 [2024-11-28 11:37:52.945253] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:33.136 [2024-11-28 11:37:52.945305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:33.136 [2024-11-28 11:37:52.945378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:33.136 [2024-11-28 11:37:52.945428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:33.136 [2024-11-28 11:37:52.945431] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:34.069 11:37:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:34.069 11:37:53 -- common/autotest_common.sh@862 -- # return 0 00:13:34.069 11:37:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:34.069 11:37:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:34.069 11:37:53 -- common/autotest_common.sh@10 -- # set +x 00:13:34.069 11:37:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:34.069 11:37:53 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:34.069 11:37:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.069 11:37:53 -- common/autotest_common.sh@10 -- # set +x 00:13:34.069 [2024-11-28 11:37:53.807242] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:34.069 11:37:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.069 11:37:53 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:34.069 11:37:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.069 11:37:53 -- common/autotest_common.sh@10 -- # set +x 00:13:34.069 Malloc0 00:13:34.069 11:37:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.069 11:37:53 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:34.069 11:37:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.069 11:37:53 -- common/autotest_common.sh@10 -- # set +x 00:13:34.069 Malloc1 00:13:34.069 11:37:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.069 11:37:53 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:13:34.069 11:37:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.069 11:37:53 -- common/autotest_common.sh@10 -- # set +x 00:13:34.069 11:37:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.069 11:37:53 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:34.069 11:37:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.069 11:37:53 -- common/autotest_common.sh@10 -- # set +x 00:13:34.069 11:37:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.069 11:37:53 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:34.069 11:37:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.069 11:37:53 -- common/autotest_common.sh@10 -- # set +x 00:13:34.069 11:37:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.069 11:37:53 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:34.069 11:37:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.069 11:37:53 -- common/autotest_common.sh@10 -- # set +x 00:13:34.069 [2024-11-28 11:37:53.893349] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.069 11:37:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.069 11:37:53 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:34.069 11:37:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.069 11:37:53 -- common/autotest_common.sh@10 -- # set +x 00:13:34.069 11:37:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.069 11:37:53 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:13:34.069 00:13:34.069 Discovery Log Number of Records 2, Generation counter 2 00:13:34.069 =====Discovery Log Entry 0====== 00:13:34.069 trtype: tcp 00:13:34.069 adrfam: ipv4 00:13:34.069 subtype: current discovery subsystem 00:13:34.069 treq: not required 00:13:34.069 portid: 0 00:13:34.069 trsvcid: 4420 00:13:34.069 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:13:34.069 traddr: 10.0.0.2 00:13:34.069 eflags: explicit discovery connections, duplicate discovery information 00:13:34.069 sectype: none 00:13:34.069 =====Discovery Log Entry 1====== 00:13:34.069 trtype: tcp 00:13:34.069 adrfam: ipv4 00:13:34.069 subtype: nvme subsystem 00:13:34.069 treq: not required 00:13:34.069 portid: 0 00:13:34.069 trsvcid: 4420 00:13:34.069 subnqn: nqn.2016-06.io.spdk:cnode1 00:13:34.069 traddr: 10.0.0.2 00:13:34.069 eflags: none 00:13:34.069 sectype: none 00:13:34.069 11:37:54 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:13:34.069 11:37:54 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:13:34.069 11:37:54 -- nvmf/common.sh@510 -- # local dev _ 00:13:34.069 11:37:54 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:34.069 11:37:54 -- nvmf/common.sh@509 -- # nvme list 00:13:34.069 11:37:54 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:34.069 11:37:54 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:34.069 11:37:54 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:34.069 11:37:54 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:34.069 11:37:54 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:13:34.069 11:37:54 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:35.002 11:37:54 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:13:35.002 11:37:54 -- common/autotest_common.sh@1187 -- # local i=0 00:13:35.002 11:37:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:35.002 11:37:54 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:13:35.002 11:37:54 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:13:35.002 11:37:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:36.898 11:37:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:36.898 11:37:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:36.898 11:37:56 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:36.898 11:37:56 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:13:36.898 11:37:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:36.898 11:37:56 -- common/autotest_common.sh@1197 -- # return 0 00:13:36.898 11:37:56 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:13:36.898 11:37:56 -- nvmf/common.sh@510 -- # local dev _ 00:13:36.898 11:37:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.898 11:37:56 -- nvmf/common.sh@509 -- # nvme list 00:13:36.898 11:37:56 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:36.898 11:37:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.898 11:37:56 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:36.898 11:37:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.898 11:37:56 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:36.898 11:37:56 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:36.898 11:37:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.898 11:37:56 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:36.898 11:37:56 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:36.898 11:37:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.898 11:37:56 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:13:36.898 /dev/nvme0n2 ]] 00:13:36.898 11:37:56 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:13:36.898 11:37:56 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:13:36.898 11:37:56 -- nvmf/common.sh@510 -- # local dev _ 00:13:36.898 11:37:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.898 11:37:56 -- nvmf/common.sh@509 -- # nvme list 00:13:37.155 11:37:57 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:37.155 11:37:57 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:37.155 11:37:57 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:37.155 11:37:57 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:37.155 11:37:57 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:37.155 11:37:57 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:37.155 11:37:57 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:37.155 11:37:57 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:37.155 11:37:57 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:37.155 11:37:57 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:37.155 11:37:57 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:13:37.155 11:37:57 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:37.414 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:37.414 11:37:57 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:37.414 11:37:57 -- common/autotest_common.sh@1208 -- # local i=0 00:13:37.414 11:37:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:37.414 11:37:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:37.414 11:37:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:37.414 11:37:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:37.414 11:37:57 -- common/autotest_common.sh@1220 -- # return 0 00:13:37.414 11:37:57 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:13:37.414 11:37:57 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:37.414 11:37:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.414 11:37:57 -- common/autotest_common.sh@10 -- # set +x 00:13:37.414 11:37:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.414 11:37:57 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:37.414 11:37:57 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:13:37.414 11:37:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:37.414 11:37:57 -- nvmf/common.sh@116 -- # sync 00:13:37.414 11:37:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:37.414 11:37:57 -- nvmf/common.sh@119 -- # set +e 00:13:37.414 11:37:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:37.414 11:37:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:37.414 rmmod nvme_tcp 00:13:37.414 rmmod nvme_fabrics 00:13:37.414 rmmod nvme_keyring 00:13:37.414 11:37:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:37.414 11:37:57 -- nvmf/common.sh@123 -- # set -e 00:13:37.414 11:37:57 -- nvmf/common.sh@124 -- # return 0 00:13:37.414 11:37:57 -- nvmf/common.sh@477 -- # '[' -n 3780173 ']' 00:13:37.414 11:37:57 -- nvmf/common.sh@478 -- # killprocess 3780173 00:13:37.414 11:37:57 -- common/autotest_common.sh@936 -- # '[' -z 3780173 ']' 00:13:37.414 11:37:57 -- common/autotest_common.sh@940 -- # kill -0 3780173 00:13:37.414 11:37:57 -- common/autotest_common.sh@941 -- # uname 00:13:37.414 11:37:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:37.414 11:37:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3780173 00:13:37.414 11:37:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:37.414 11:37:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:37.414 11:37:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3780173' 00:13:37.414 killing process with pid 3780173 00:13:37.414 11:37:57 -- common/autotest_common.sh@955 -- # kill 3780173 00:13:37.414 11:37:57 -- common/autotest_common.sh@960 -- # wait 3780173 00:13:37.673 11:37:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:37.673 11:37:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:37.673 11:37:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:37.673 11:37:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:37.673 11:37:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:37.673 11:37:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:37.673 11:37:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:37.673 11:37:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:40.206 11:37:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:40.206 00:13:40.206 real 0m9.466s 00:13:40.206 user 0m19.591s 00:13:40.206 sys 0m2.373s 00:13:40.206 11:37:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:40.206 11:37:59 -- common/autotest_common.sh@10 -- # set +x 00:13:40.206 ************************************ 00:13:40.206 END TEST nvmf_nvme_cli 00:13:40.206 ************************************ 00:13:40.206 11:37:59 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:13:40.206 11:37:59 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:40.206 11:37:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:40.206 11:37:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:40.206 11:37:59 -- common/autotest_common.sh@10 -- # set +x 00:13:40.206 ************************************ 00:13:40.206 START TEST nvmf_host_management 00:13:40.206 ************************************ 00:13:40.206 11:37:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:40.206 * Looking for test storage... 00:13:40.206 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:40.206 11:37:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:40.206 11:37:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:40.206 11:37:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:40.206 11:37:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:40.206 11:37:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:40.206 11:37:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:40.206 11:37:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:40.206 11:37:59 -- scripts/common.sh@335 -- # IFS=.-: 00:13:40.206 11:37:59 -- scripts/common.sh@335 -- # read -ra ver1 00:13:40.206 11:37:59 -- scripts/common.sh@336 -- # IFS=.-: 00:13:40.206 11:37:59 -- scripts/common.sh@336 -- # read -ra ver2 00:13:40.206 11:37:59 -- scripts/common.sh@337 -- # local 'op=<' 00:13:40.206 11:37:59 -- scripts/common.sh@339 -- # ver1_l=2 00:13:40.206 11:37:59 -- scripts/common.sh@340 -- # ver2_l=1 00:13:40.206 11:37:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:40.207 11:37:59 -- scripts/common.sh@343 -- # case "$op" in 00:13:40.207 11:37:59 -- scripts/common.sh@344 -- # : 1 00:13:40.207 11:37:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:40.207 11:37:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:40.207 11:37:59 -- scripts/common.sh@364 -- # decimal 1 00:13:40.207 11:37:59 -- scripts/common.sh@352 -- # local d=1 00:13:40.207 11:37:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:40.207 11:37:59 -- scripts/common.sh@354 -- # echo 1 00:13:40.207 11:37:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:40.207 11:37:59 -- scripts/common.sh@365 -- # decimal 2 00:13:40.207 11:37:59 -- scripts/common.sh@352 -- # local d=2 00:13:40.207 11:37:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:40.207 11:37:59 -- scripts/common.sh@354 -- # echo 2 00:13:40.207 11:37:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:40.207 11:37:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:40.207 11:37:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:40.207 11:37:59 -- scripts/common.sh@367 -- # return 0 00:13:40.207 11:37:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:40.207 11:37:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:40.207 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.207 --rc genhtml_branch_coverage=1 00:13:40.207 --rc genhtml_function_coverage=1 00:13:40.207 --rc genhtml_legend=1 00:13:40.207 --rc geninfo_all_blocks=1 00:13:40.207 --rc geninfo_unexecuted_blocks=1 00:13:40.207 00:13:40.207 ' 00:13:40.207 11:37:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:40.207 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.207 --rc genhtml_branch_coverage=1 00:13:40.207 --rc genhtml_function_coverage=1 00:13:40.207 --rc genhtml_legend=1 00:13:40.207 --rc geninfo_all_blocks=1 00:13:40.207 --rc geninfo_unexecuted_blocks=1 00:13:40.207 00:13:40.207 ' 00:13:40.207 11:37:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:40.207 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.207 --rc genhtml_branch_coverage=1 00:13:40.207 --rc genhtml_function_coverage=1 00:13:40.207 --rc genhtml_legend=1 00:13:40.207 --rc geninfo_all_blocks=1 00:13:40.207 --rc geninfo_unexecuted_blocks=1 00:13:40.207 00:13:40.207 ' 00:13:40.207 11:37:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:40.207 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.207 --rc genhtml_branch_coverage=1 00:13:40.207 --rc genhtml_function_coverage=1 00:13:40.207 --rc genhtml_legend=1 00:13:40.207 --rc geninfo_all_blocks=1 00:13:40.207 --rc geninfo_unexecuted_blocks=1 00:13:40.207 00:13:40.207 ' 00:13:40.207 11:37:59 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:40.207 11:37:59 -- nvmf/common.sh@7 -- # uname -s 00:13:40.207 11:37:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:40.207 11:37:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:40.207 11:37:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:40.207 11:37:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:40.207 11:37:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:40.207 11:37:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:40.207 11:37:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:40.207 11:37:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:40.207 11:37:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:40.207 11:37:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:40.207 11:37:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:40.207 11:37:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:40.207 11:37:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:40.207 11:37:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:40.207 11:37:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:40.207 11:37:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:40.207 11:37:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:40.207 11:37:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:40.207 11:37:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:40.207 11:37:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.207 11:37:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.207 11:37:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.207 11:37:59 -- paths/export.sh@5 -- # export PATH 00:13:40.207 11:37:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.207 11:37:59 -- nvmf/common.sh@46 -- # : 0 00:13:40.207 11:37:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:40.207 11:37:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:40.207 11:37:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:40.207 11:37:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:40.207 11:37:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:40.207 11:37:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:40.207 11:37:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:40.207 11:37:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:40.207 11:37:59 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:40.207 11:37:59 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:40.207 11:37:59 -- target/host_management.sh@104 -- # nvmftestinit 00:13:40.207 11:37:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:40.207 11:37:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:40.207 11:37:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:40.207 11:37:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:40.207 11:37:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:40.207 11:37:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:40.207 11:37:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:40.207 11:37:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:40.207 11:37:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:40.207 11:37:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:40.207 11:37:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:40.207 11:37:59 -- common/autotest_common.sh@10 -- # set +x 00:13:42.112 11:38:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:42.112 11:38:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:42.112 11:38:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:42.112 11:38:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:42.112 11:38:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:42.112 11:38:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:42.112 11:38:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:42.112 11:38:01 -- nvmf/common.sh@294 -- # net_devs=() 00:13:42.112 11:38:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:42.112 11:38:01 -- nvmf/common.sh@295 -- # e810=() 00:13:42.112 11:38:01 -- nvmf/common.sh@295 -- # local -ga e810 00:13:42.112 11:38:01 -- nvmf/common.sh@296 -- # x722=() 00:13:42.112 11:38:01 -- nvmf/common.sh@296 -- # local -ga x722 00:13:42.112 11:38:01 -- nvmf/common.sh@297 -- # mlx=() 00:13:42.112 11:38:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:42.112 11:38:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:42.112 11:38:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:42.112 11:38:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:42.112 11:38:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:42.112 11:38:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:42.112 11:38:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:42.112 11:38:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:42.112 11:38:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:42.112 11:38:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:42.112 11:38:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:42.112 11:38:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:42.112 11:38:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:42.112 11:38:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:42.112 11:38:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:42.112 11:38:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:42.112 11:38:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:42.112 11:38:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:42.112 11:38:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:42.112 11:38:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:42.112 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:42.112 11:38:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:42.112 11:38:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:42.112 11:38:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:42.112 11:38:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:42.112 11:38:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:42.112 11:38:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:42.113 11:38:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:42.113 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:42.113 11:38:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:42.113 11:38:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:42.113 11:38:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:42.113 11:38:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:42.113 11:38:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:42.113 11:38:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:42.113 11:38:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:42.113 11:38:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:42.113 11:38:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:42.113 11:38:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:42.113 11:38:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:42.113 11:38:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:42.113 11:38:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:42.113 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:42.113 11:38:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:42.113 11:38:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:42.113 11:38:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:42.113 11:38:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:42.113 11:38:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:42.113 11:38:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:42.113 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:42.113 11:38:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:42.113 11:38:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:42.113 11:38:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:42.113 11:38:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:42.113 11:38:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:42.113 11:38:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:42.113 11:38:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:42.113 11:38:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:42.113 11:38:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:42.113 11:38:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:42.113 11:38:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:42.113 11:38:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:42.113 11:38:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:42.113 11:38:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:42.113 11:38:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:42.113 11:38:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:42.113 11:38:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:42.113 11:38:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:42.113 11:38:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:42.113 11:38:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:42.113 11:38:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:42.113 11:38:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:42.113 11:38:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:42.113 11:38:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:42.113 11:38:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:42.113 11:38:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:42.113 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:42.113 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.294 ms 00:13:42.113 00:13:42.113 --- 10.0.0.2 ping statistics --- 00:13:42.113 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:42.113 rtt min/avg/max/mdev = 0.294/0.294/0.294/0.000 ms 00:13:42.113 11:38:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:42.113 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:42.113 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.151 ms 00:13:42.113 00:13:42.113 --- 10.0.0.1 ping statistics --- 00:13:42.113 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:42.113 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:13:42.113 11:38:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:42.113 11:38:02 -- nvmf/common.sh@410 -- # return 0 00:13:42.113 11:38:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:42.113 11:38:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:42.113 11:38:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:42.113 11:38:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:42.113 11:38:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:42.113 11:38:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:42.113 11:38:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:42.113 11:38:02 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:13:42.113 11:38:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:13:42.113 11:38:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:42.113 11:38:02 -- common/autotest_common.sh@10 -- # set +x 00:13:42.113 ************************************ 00:13:42.113 START TEST nvmf_host_management 00:13:42.113 ************************************ 00:13:42.113 11:38:02 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:13:42.113 11:38:02 -- target/host_management.sh@69 -- # starttarget 00:13:42.113 11:38:02 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:13:42.113 11:38:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:42.113 11:38:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:42.113 11:38:02 -- common/autotest_common.sh@10 -- # set +x 00:13:42.113 11:38:02 -- nvmf/common.sh@469 -- # nvmfpid=3782720 00:13:42.113 11:38:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:13:42.113 11:38:02 -- nvmf/common.sh@470 -- # waitforlisten 3782720 00:13:42.113 11:38:02 -- common/autotest_common.sh@829 -- # '[' -z 3782720 ']' 00:13:42.113 11:38:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:42.113 11:38:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:42.113 11:38:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:42.113 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:42.113 11:38:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:42.113 11:38:02 -- common/autotest_common.sh@10 -- # set +x 00:13:42.372 [2024-11-28 11:38:02.199629] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:42.372 [2024-11-28 11:38:02.199718] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:42.372 EAL: No free 2048 kB hugepages reported on node 1 00:13:42.372 [2024-11-28 11:38:02.264790] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:42.372 [2024-11-28 11:38:02.375521] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:42.372 [2024-11-28 11:38:02.375689] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:42.372 [2024-11-28 11:38:02.375706] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:42.372 [2024-11-28 11:38:02.375725] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:42.372 [2024-11-28 11:38:02.375832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:42.372 [2024-11-28 11:38:02.375948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:42.372 [2024-11-28 11:38:02.376014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:13:42.372 [2024-11-28 11:38:02.376016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:43.313 11:38:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:43.313 11:38:03 -- common/autotest_common.sh@862 -- # return 0 00:13:43.313 11:38:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:43.313 11:38:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:43.313 11:38:03 -- common/autotest_common.sh@10 -- # set +x 00:13:43.313 11:38:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:43.313 11:38:03 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:43.313 11:38:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.313 11:38:03 -- common/autotest_common.sh@10 -- # set +x 00:13:43.313 [2024-11-28 11:38:03.193121] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:43.313 11:38:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.313 11:38:03 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:13:43.313 11:38:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:43.313 11:38:03 -- common/autotest_common.sh@10 -- # set +x 00:13:43.313 11:38:03 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:43.313 11:38:03 -- target/host_management.sh@23 -- # cat 00:13:43.313 11:38:03 -- target/host_management.sh@30 -- # rpc_cmd 00:13:43.313 11:38:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.313 11:38:03 -- common/autotest_common.sh@10 -- # set +x 00:13:43.313 Malloc0 00:13:43.313 [2024-11-28 11:38:03.254209] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:43.313 11:38:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.313 11:38:03 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:13:43.313 11:38:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:43.313 11:38:03 -- common/autotest_common.sh@10 -- # set +x 00:13:43.313 11:38:03 -- target/host_management.sh@73 -- # perfpid=3782901 00:13:43.313 11:38:03 -- target/host_management.sh@74 -- # waitforlisten 3782901 /var/tmp/bdevperf.sock 00:13:43.313 11:38:03 -- common/autotest_common.sh@829 -- # '[' -z 3782901 ']' 00:13:43.313 11:38:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:43.313 11:38:03 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:13:43.313 11:38:03 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:13:43.313 11:38:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:43.313 11:38:03 -- nvmf/common.sh@520 -- # config=() 00:13:43.313 11:38:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:43.313 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:43.313 11:38:03 -- nvmf/common.sh@520 -- # local subsystem config 00:13:43.313 11:38:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:43.313 11:38:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:43.313 11:38:03 -- common/autotest_common.sh@10 -- # set +x 00:13:43.313 11:38:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:43.313 { 00:13:43.313 "params": { 00:13:43.313 "name": "Nvme$subsystem", 00:13:43.313 "trtype": "$TEST_TRANSPORT", 00:13:43.313 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:43.313 "adrfam": "ipv4", 00:13:43.313 "trsvcid": "$NVMF_PORT", 00:13:43.313 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:43.313 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:43.313 "hdgst": ${hdgst:-false}, 00:13:43.313 "ddgst": ${ddgst:-false} 00:13:43.313 }, 00:13:43.313 "method": "bdev_nvme_attach_controller" 00:13:43.313 } 00:13:43.314 EOF 00:13:43.314 )") 00:13:43.314 11:38:03 -- nvmf/common.sh@542 -- # cat 00:13:43.314 11:38:03 -- nvmf/common.sh@544 -- # jq . 00:13:43.314 11:38:03 -- nvmf/common.sh@545 -- # IFS=, 00:13:43.314 11:38:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:43.314 "params": { 00:13:43.314 "name": "Nvme0", 00:13:43.314 "trtype": "tcp", 00:13:43.314 "traddr": "10.0.0.2", 00:13:43.314 "adrfam": "ipv4", 00:13:43.314 "trsvcid": "4420", 00:13:43.314 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:43.314 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:43.314 "hdgst": false, 00:13:43.314 "ddgst": false 00:13:43.314 }, 00:13:43.314 "method": "bdev_nvme_attach_controller" 00:13:43.314 }' 00:13:43.314 [2024-11-28 11:38:03.331276] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:43.314 [2024-11-28 11:38:03.331349] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3782901 ] 00:13:43.314 EAL: No free 2048 kB hugepages reported on node 1 00:13:43.624 [2024-11-28 11:38:03.391262] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:43.624 [2024-11-28 11:38:03.499231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:43.882 Running I/O for 10 seconds... 00:13:44.449 11:38:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:44.449 11:38:04 -- common/autotest_common.sh@862 -- # return 0 00:13:44.449 11:38:04 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:13:44.449 11:38:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.449 11:38:04 -- common/autotest_common.sh@10 -- # set +x 00:13:44.449 11:38:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.449 11:38:04 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:44.449 11:38:04 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:13:44.449 11:38:04 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:13:44.449 11:38:04 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:13:44.449 11:38:04 -- target/host_management.sh@52 -- # local ret=1 00:13:44.449 11:38:04 -- target/host_management.sh@53 -- # local i 00:13:44.449 11:38:04 -- target/host_management.sh@54 -- # (( i = 10 )) 00:13:44.449 11:38:04 -- target/host_management.sh@54 -- # (( i != 0 )) 00:13:44.449 11:38:04 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:13:44.449 11:38:04 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:13:44.449 11:38:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.449 11:38:04 -- common/autotest_common.sh@10 -- # set +x 00:13:44.449 11:38:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.449 11:38:04 -- target/host_management.sh@55 -- # read_io_count=2091 00:13:44.449 11:38:04 -- target/host_management.sh@58 -- # '[' 2091 -ge 100 ']' 00:13:44.449 11:38:04 -- target/host_management.sh@59 -- # ret=0 00:13:44.449 11:38:04 -- target/host_management.sh@60 -- # break 00:13:44.449 11:38:04 -- target/host_management.sh@64 -- # return 0 00:13:44.449 11:38:04 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:44.449 11:38:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.449 11:38:04 -- common/autotest_common.sh@10 -- # set +x 00:13:44.449 [2024-11-28 11:38:04.362165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.449 [2024-11-28 11:38:04.362712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.362991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.363003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.363015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.363027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.363039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.363051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.363062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.363074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.363086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.363097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.363109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24eae60 is same with the state(5) to be set 00:13:44.450 [2024-11-28 11:38:04.363978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.450 [2024-11-28 11:38:04.364704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.450 [2024-11-28 11:38:04.364718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.364733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.364746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.364761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.364775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.364789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.364802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.364825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.364843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.364859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.364872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.364887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.364900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.364915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.364928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.364942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.364956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.364970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.364985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.451 [2024-11-28 11:38:04.365862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.451 [2024-11-28 11:38:04.365885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:44.452 [2024-11-28 11:38:04.365898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:44.452 [2024-11-28 11:38:04.365992] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x78f030 was disconnected and freed. reset controller. 00:13:44.452 11:38:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.452 11:38:04 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:44.452 11:38:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.452 11:38:04 -- common/autotest_common.sh@10 -- # set +x 00:13:44.452 [2024-11-28 11:38:04.367124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:13:44.452 task offset: 26368 on job bdev=Nvme0n1 fails 00:13:44.452 00:13:44.452 Latency(us) 00:13:44.452 [2024-11-28T10:38:04.508Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:44.452 [2024-11-28T10:38:04.508Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:44.452 [2024-11-28T10:38:04.508Z] Job: Nvme0n1 ended in about 0.65 seconds with error 00:13:44.452 Verification LBA range: start 0x0 length 0x400 00:13:44.452 Nvme0n1 : 0.65 3457.97 216.12 98.89 0.00 17741.41 2390.85 24855.13 00:13:44.452 [2024-11-28T10:38:04.508Z] =================================================================================================================== 00:13:44.452 [2024-11-28T10:38:04.508Z] Total : 3457.97 216.12 98.89 0.00 17741.41 2390.85 24855.13 00:13:44.452 [2024-11-28 11:38:04.369044] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:13:44.452 [2024-11-28 11:38:04.369089] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x791160 (9): Bad file descriptor 00:13:44.452 11:38:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.452 11:38:04 -- target/host_management.sh@87 -- # sleep 1 00:13:44.452 [2024-11-28 11:38:04.380632] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:13:45.384 11:38:05 -- target/host_management.sh@91 -- # kill -9 3782901 00:13:45.384 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (3782901) - No such process 00:13:45.384 11:38:05 -- target/host_management.sh@91 -- # true 00:13:45.384 11:38:05 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:13:45.384 11:38:05 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:13:45.384 11:38:05 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:13:45.384 11:38:05 -- nvmf/common.sh@520 -- # config=() 00:13:45.384 11:38:05 -- nvmf/common.sh@520 -- # local subsystem config 00:13:45.384 11:38:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:45.384 11:38:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:45.384 { 00:13:45.384 "params": { 00:13:45.384 "name": "Nvme$subsystem", 00:13:45.384 "trtype": "$TEST_TRANSPORT", 00:13:45.384 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:45.384 "adrfam": "ipv4", 00:13:45.384 "trsvcid": "$NVMF_PORT", 00:13:45.384 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:45.384 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:45.384 "hdgst": ${hdgst:-false}, 00:13:45.384 "ddgst": ${ddgst:-false} 00:13:45.384 }, 00:13:45.384 "method": "bdev_nvme_attach_controller" 00:13:45.384 } 00:13:45.384 EOF 00:13:45.384 )") 00:13:45.384 11:38:05 -- nvmf/common.sh@542 -- # cat 00:13:45.384 11:38:05 -- nvmf/common.sh@544 -- # jq . 00:13:45.384 11:38:05 -- nvmf/common.sh@545 -- # IFS=, 00:13:45.384 11:38:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:45.384 "params": { 00:13:45.384 "name": "Nvme0", 00:13:45.384 "trtype": "tcp", 00:13:45.384 "traddr": "10.0.0.2", 00:13:45.384 "adrfam": "ipv4", 00:13:45.384 "trsvcid": "4420", 00:13:45.384 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:45.384 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:45.384 "hdgst": false, 00:13:45.384 "ddgst": false 00:13:45.384 }, 00:13:45.384 "method": "bdev_nvme_attach_controller" 00:13:45.384 }' 00:13:45.384 [2024-11-28 11:38:05.418829] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:45.384 [2024-11-28 11:38:05.418905] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3783184 ] 00:13:45.642 EAL: No free 2048 kB hugepages reported on node 1 00:13:45.642 [2024-11-28 11:38:05.477865] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:45.642 [2024-11-28 11:38:05.588265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:45.900 Running I/O for 1 seconds... 00:13:46.835 00:13:46.835 Latency(us) 00:13:46.835 [2024-11-28T10:38:06.891Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:46.835 [2024-11-28T10:38:06.891Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:46.835 Verification LBA range: start 0x0 length 0x400 00:13:46.835 Nvme0n1 : 1.01 3989.53 249.35 0.00 0.00 15806.84 1274.31 21942.42 00:13:46.835 [2024-11-28T10:38:06.891Z] =================================================================================================================== 00:13:46.835 [2024-11-28T10:38:06.891Z] Total : 3989.53 249.35 0.00 0.00 15806.84 1274.31 21942.42 00:13:47.093 11:38:07 -- target/host_management.sh@101 -- # stoptarget 00:13:47.093 11:38:07 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:13:47.093 11:38:07 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:13:47.093 11:38:07 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:47.093 11:38:07 -- target/host_management.sh@40 -- # nvmftestfini 00:13:47.093 11:38:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:47.093 11:38:07 -- nvmf/common.sh@116 -- # sync 00:13:47.093 11:38:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:47.093 11:38:07 -- nvmf/common.sh@119 -- # set +e 00:13:47.093 11:38:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:47.093 11:38:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:47.093 rmmod nvme_tcp 00:13:47.093 rmmod nvme_fabrics 00:13:47.093 rmmod nvme_keyring 00:13:47.093 11:38:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:47.093 11:38:07 -- nvmf/common.sh@123 -- # set -e 00:13:47.093 11:38:07 -- nvmf/common.sh@124 -- # return 0 00:13:47.093 11:38:07 -- nvmf/common.sh@477 -- # '[' -n 3782720 ']' 00:13:47.093 11:38:07 -- nvmf/common.sh@478 -- # killprocess 3782720 00:13:47.093 11:38:07 -- common/autotest_common.sh@936 -- # '[' -z 3782720 ']' 00:13:47.094 11:38:07 -- common/autotest_common.sh@940 -- # kill -0 3782720 00:13:47.094 11:38:07 -- common/autotest_common.sh@941 -- # uname 00:13:47.094 11:38:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:47.094 11:38:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3782720 00:13:47.352 11:38:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:47.352 11:38:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:47.352 11:38:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3782720' 00:13:47.352 killing process with pid 3782720 00:13:47.352 11:38:07 -- common/autotest_common.sh@955 -- # kill 3782720 00:13:47.352 11:38:07 -- common/autotest_common.sh@960 -- # wait 3782720 00:13:47.612 [2024-11-28 11:38:07.425549] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:13:47.612 11:38:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:47.612 11:38:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:47.612 11:38:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:47.612 11:38:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:47.612 11:38:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:47.612 11:38:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:47.612 11:38:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:47.612 11:38:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:49.521 11:38:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:49.521 00:13:49.521 real 0m7.345s 00:13:49.521 user 0m22.603s 00:13:49.521 sys 0m1.482s 00:13:49.521 11:38:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:49.521 11:38:09 -- common/autotest_common.sh@10 -- # set +x 00:13:49.521 ************************************ 00:13:49.521 END TEST nvmf_host_management 00:13:49.521 ************************************ 00:13:49.521 11:38:09 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:13:49.521 00:13:49.521 real 0m9.751s 00:13:49.521 user 0m23.481s 00:13:49.521 sys 0m3.040s 00:13:49.521 11:38:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:49.521 11:38:09 -- common/autotest_common.sh@10 -- # set +x 00:13:49.521 ************************************ 00:13:49.521 END TEST nvmf_host_management 00:13:49.521 ************************************ 00:13:49.521 11:38:09 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:49.521 11:38:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:49.521 11:38:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:49.521 11:38:09 -- common/autotest_common.sh@10 -- # set +x 00:13:49.521 ************************************ 00:13:49.521 START TEST nvmf_lvol 00:13:49.521 ************************************ 00:13:49.521 11:38:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:49.780 * Looking for test storage... 00:13:49.780 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:49.780 11:38:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:49.780 11:38:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:49.780 11:38:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:49.780 11:38:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:49.780 11:38:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:49.780 11:38:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:49.780 11:38:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:49.780 11:38:09 -- scripts/common.sh@335 -- # IFS=.-: 00:13:49.780 11:38:09 -- scripts/common.sh@335 -- # read -ra ver1 00:13:49.780 11:38:09 -- scripts/common.sh@336 -- # IFS=.-: 00:13:49.780 11:38:09 -- scripts/common.sh@336 -- # read -ra ver2 00:13:49.780 11:38:09 -- scripts/common.sh@337 -- # local 'op=<' 00:13:49.780 11:38:09 -- scripts/common.sh@339 -- # ver1_l=2 00:13:49.780 11:38:09 -- scripts/common.sh@340 -- # ver2_l=1 00:13:49.780 11:38:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:49.780 11:38:09 -- scripts/common.sh@343 -- # case "$op" in 00:13:49.780 11:38:09 -- scripts/common.sh@344 -- # : 1 00:13:49.780 11:38:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:49.780 11:38:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:49.780 11:38:09 -- scripts/common.sh@364 -- # decimal 1 00:13:49.780 11:38:09 -- scripts/common.sh@352 -- # local d=1 00:13:49.780 11:38:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:49.780 11:38:09 -- scripts/common.sh@354 -- # echo 1 00:13:49.781 11:38:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:49.781 11:38:09 -- scripts/common.sh@365 -- # decimal 2 00:13:49.781 11:38:09 -- scripts/common.sh@352 -- # local d=2 00:13:49.781 11:38:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:49.781 11:38:09 -- scripts/common.sh@354 -- # echo 2 00:13:49.781 11:38:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:49.781 11:38:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:49.781 11:38:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:49.781 11:38:09 -- scripts/common.sh@367 -- # return 0 00:13:49.781 11:38:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:49.781 11:38:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:49.781 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:49.781 --rc genhtml_branch_coverage=1 00:13:49.781 --rc genhtml_function_coverage=1 00:13:49.781 --rc genhtml_legend=1 00:13:49.781 --rc geninfo_all_blocks=1 00:13:49.781 --rc geninfo_unexecuted_blocks=1 00:13:49.781 00:13:49.781 ' 00:13:49.781 11:38:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:49.781 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:49.781 --rc genhtml_branch_coverage=1 00:13:49.781 --rc genhtml_function_coverage=1 00:13:49.781 --rc genhtml_legend=1 00:13:49.781 --rc geninfo_all_blocks=1 00:13:49.781 --rc geninfo_unexecuted_blocks=1 00:13:49.781 00:13:49.781 ' 00:13:49.781 11:38:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:49.781 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:49.781 --rc genhtml_branch_coverage=1 00:13:49.781 --rc genhtml_function_coverage=1 00:13:49.781 --rc genhtml_legend=1 00:13:49.781 --rc geninfo_all_blocks=1 00:13:49.781 --rc geninfo_unexecuted_blocks=1 00:13:49.781 00:13:49.781 ' 00:13:49.781 11:38:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:49.781 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:49.781 --rc genhtml_branch_coverage=1 00:13:49.781 --rc genhtml_function_coverage=1 00:13:49.781 --rc genhtml_legend=1 00:13:49.781 --rc geninfo_all_blocks=1 00:13:49.781 --rc geninfo_unexecuted_blocks=1 00:13:49.781 00:13:49.781 ' 00:13:49.781 11:38:09 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:49.781 11:38:09 -- nvmf/common.sh@7 -- # uname -s 00:13:49.781 11:38:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:49.781 11:38:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:49.781 11:38:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:49.781 11:38:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:49.781 11:38:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:49.781 11:38:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:49.781 11:38:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:49.781 11:38:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:49.781 11:38:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:49.781 11:38:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:49.781 11:38:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:49.781 11:38:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:49.781 11:38:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:49.781 11:38:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:49.781 11:38:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:49.781 11:38:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:49.781 11:38:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:49.781 11:38:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:49.781 11:38:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:49.781 11:38:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:49.781 11:38:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:49.781 11:38:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:49.781 11:38:09 -- paths/export.sh@5 -- # export PATH 00:13:49.781 11:38:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:49.781 11:38:09 -- nvmf/common.sh@46 -- # : 0 00:13:49.781 11:38:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:49.781 11:38:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:49.781 11:38:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:49.781 11:38:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:49.781 11:38:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:49.781 11:38:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:49.781 11:38:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:49.781 11:38:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:49.781 11:38:09 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:49.781 11:38:09 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:49.781 11:38:09 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:13:49.781 11:38:09 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:13:49.781 11:38:09 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:49.781 11:38:09 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:13:49.781 11:38:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:49.781 11:38:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:49.781 11:38:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:49.781 11:38:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:49.781 11:38:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:49.781 11:38:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:49.781 11:38:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:49.781 11:38:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:49.781 11:38:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:49.781 11:38:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:49.781 11:38:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:49.781 11:38:09 -- common/autotest_common.sh@10 -- # set +x 00:13:51.683 11:38:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:51.683 11:38:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:51.683 11:38:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:51.683 11:38:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:51.683 11:38:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:51.683 11:38:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:51.683 11:38:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:51.683 11:38:11 -- nvmf/common.sh@294 -- # net_devs=() 00:13:51.683 11:38:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:51.683 11:38:11 -- nvmf/common.sh@295 -- # e810=() 00:13:51.683 11:38:11 -- nvmf/common.sh@295 -- # local -ga e810 00:13:51.683 11:38:11 -- nvmf/common.sh@296 -- # x722=() 00:13:51.683 11:38:11 -- nvmf/common.sh@296 -- # local -ga x722 00:13:51.683 11:38:11 -- nvmf/common.sh@297 -- # mlx=() 00:13:51.683 11:38:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:51.683 11:38:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:51.683 11:38:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:51.683 11:38:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:51.683 11:38:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:51.683 11:38:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:51.683 11:38:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:51.683 11:38:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:51.683 11:38:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:51.683 11:38:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:51.683 11:38:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:51.683 11:38:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:51.683 11:38:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:51.683 11:38:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:51.683 11:38:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:51.683 11:38:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:51.683 11:38:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:51.683 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:51.683 11:38:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:51.683 11:38:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:51.683 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:51.683 11:38:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:51.683 11:38:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:51.683 11:38:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:51.683 11:38:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:51.683 11:38:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:51.683 11:38:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:51.683 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:51.683 11:38:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:51.683 11:38:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:51.683 11:38:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:51.683 11:38:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:51.683 11:38:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:51.683 11:38:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:51.683 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:51.683 11:38:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:51.683 11:38:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:51.683 11:38:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:51.683 11:38:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:51.683 11:38:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:51.683 11:38:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:51.683 11:38:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:51.683 11:38:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:51.683 11:38:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:51.683 11:38:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:51.683 11:38:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:51.683 11:38:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:51.683 11:38:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:51.683 11:38:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:51.683 11:38:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:51.683 11:38:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:51.683 11:38:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:51.683 11:38:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:51.943 11:38:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:51.943 11:38:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:51.943 11:38:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:51.943 11:38:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:51.943 11:38:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:51.943 11:38:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:51.943 11:38:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:51.943 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:51.943 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:13:51.943 00:13:51.943 --- 10.0.0.2 ping statistics --- 00:13:51.943 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:51.943 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:13:51.943 11:38:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:51.943 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:51.943 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.153 ms 00:13:51.943 00:13:51.943 --- 10.0.0.1 ping statistics --- 00:13:51.943 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:51.943 rtt min/avg/max/mdev = 0.153/0.153/0.153/0.000 ms 00:13:51.943 11:38:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:51.943 11:38:11 -- nvmf/common.sh@410 -- # return 0 00:13:51.943 11:38:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:51.943 11:38:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:51.943 11:38:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:51.943 11:38:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:51.943 11:38:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:51.943 11:38:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:51.943 11:38:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:51.943 11:38:11 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:13:51.943 11:38:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:51.943 11:38:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:51.943 11:38:11 -- common/autotest_common.sh@10 -- # set +x 00:13:51.943 11:38:11 -- nvmf/common.sh@469 -- # nvmfpid=3785427 00:13:51.943 11:38:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:13:51.943 11:38:11 -- nvmf/common.sh@470 -- # waitforlisten 3785427 00:13:51.943 11:38:11 -- common/autotest_common.sh@829 -- # '[' -z 3785427 ']' 00:13:51.943 11:38:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:51.943 11:38:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:51.943 11:38:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:51.943 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:51.943 11:38:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:51.943 11:38:11 -- common/autotest_common.sh@10 -- # set +x 00:13:51.943 [2024-11-28 11:38:11.962278] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:51.943 [2024-11-28 11:38:11.962368] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:51.943 EAL: No free 2048 kB hugepages reported on node 1 00:13:52.202 [2024-11-28 11:38:12.029241] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:52.202 [2024-11-28 11:38:12.139801] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:52.202 [2024-11-28 11:38:12.139965] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:52.202 [2024-11-28 11:38:12.139982] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:52.202 [2024-11-28 11:38:12.139995] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:52.202 [2024-11-28 11:38:12.140047] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:52.202 [2024-11-28 11:38:12.140109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:52.202 [2024-11-28 11:38:12.140112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:53.137 11:38:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:53.137 11:38:12 -- common/autotest_common.sh@862 -- # return 0 00:13:53.137 11:38:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:53.137 11:38:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:53.137 11:38:12 -- common/autotest_common.sh@10 -- # set +x 00:13:53.137 11:38:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:53.137 11:38:12 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:53.395 [2024-11-28 11:38:13.203011] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:53.395 11:38:13 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:53.653 11:38:13 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:13:53.653 11:38:13 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:53.911 11:38:13 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:13:53.911 11:38:13 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:13:54.169 11:38:14 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:13:54.427 11:38:14 -- target/nvmf_lvol.sh@29 -- # lvs=b93e5dfb-2b7e-4b83-89b4-828f2e776fc4 00:13:54.427 11:38:14 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u b93e5dfb-2b7e-4b83-89b4-828f2e776fc4 lvol 20 00:13:54.686 11:38:14 -- target/nvmf_lvol.sh@32 -- # lvol=c6c6fd12-a1cf-4015-ad08-98e4950cfc2e 00:13:54.686 11:38:14 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:54.987 11:38:14 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 c6c6fd12-a1cf-4015-ad08-98e4950cfc2e 00:13:55.261 11:38:15 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:55.261 [2024-11-28 11:38:15.303724] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:55.524 11:38:15 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:55.524 11:38:15 -- target/nvmf_lvol.sh@42 -- # perf_pid=3785870 00:13:55.524 11:38:15 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:13:55.524 11:38:15 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:13:55.782 EAL: No free 2048 kB hugepages reported on node 1 00:13:56.716 11:38:16 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot c6c6fd12-a1cf-4015-ad08-98e4950cfc2e MY_SNAPSHOT 00:13:56.974 11:38:16 -- target/nvmf_lvol.sh@47 -- # snapshot=7401ce8a-adb9-44aa-aeff-576317df6540 00:13:56.974 11:38:16 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize c6c6fd12-a1cf-4015-ad08-98e4950cfc2e 30 00:13:57.232 11:38:17 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 7401ce8a-adb9-44aa-aeff-576317df6540 MY_CLONE 00:13:57.491 11:38:17 -- target/nvmf_lvol.sh@49 -- # clone=0bb88ff7-d79b-444e-ac1e-ed9c12c48843 00:13:57.491 11:38:17 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 0bb88ff7-d79b-444e-ac1e-ed9c12c48843 00:13:58.057 11:38:18 -- target/nvmf_lvol.sh@53 -- # wait 3785870 00:14:06.158 Initializing NVMe Controllers 00:14:06.158 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:06.158 Controller IO queue size 128, less than required. 00:14:06.158 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:06.158 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:06.158 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:06.158 Initialization complete. Launching workers. 00:14:06.158 ======================================================== 00:14:06.158 Latency(us) 00:14:06.158 Device Information : IOPS MiB/s Average min max 00:14:06.158 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10761.90 42.04 11893.80 2052.52 66149.30 00:14:06.158 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10726.80 41.90 11937.92 2125.04 64171.36 00:14:06.158 ======================================================== 00:14:06.158 Total : 21488.70 83.94 11915.82 2052.52 66149.30 00:14:06.158 00:14:06.158 11:38:25 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:06.415 11:38:26 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete c6c6fd12-a1cf-4015-ad08-98e4950cfc2e 00:14:06.673 11:38:26 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u b93e5dfb-2b7e-4b83-89b4-828f2e776fc4 00:14:06.930 11:38:26 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:06.930 11:38:26 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:06.930 11:38:26 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:06.930 11:38:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:06.930 11:38:26 -- nvmf/common.sh@116 -- # sync 00:14:06.930 11:38:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:06.930 11:38:26 -- nvmf/common.sh@119 -- # set +e 00:14:06.930 11:38:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:06.930 11:38:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:06.930 rmmod nvme_tcp 00:14:06.930 rmmod nvme_fabrics 00:14:06.930 rmmod nvme_keyring 00:14:06.930 11:38:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:06.930 11:38:26 -- nvmf/common.sh@123 -- # set -e 00:14:06.931 11:38:26 -- nvmf/common.sh@124 -- # return 0 00:14:06.931 11:38:26 -- nvmf/common.sh@477 -- # '[' -n 3785427 ']' 00:14:06.931 11:38:26 -- nvmf/common.sh@478 -- # killprocess 3785427 00:14:06.931 11:38:26 -- common/autotest_common.sh@936 -- # '[' -z 3785427 ']' 00:14:06.931 11:38:26 -- common/autotest_common.sh@940 -- # kill -0 3785427 00:14:06.931 11:38:26 -- common/autotest_common.sh@941 -- # uname 00:14:06.931 11:38:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:06.931 11:38:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3785427 00:14:06.931 11:38:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:06.931 11:38:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:06.931 11:38:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3785427' 00:14:06.931 killing process with pid 3785427 00:14:06.931 11:38:26 -- common/autotest_common.sh@955 -- # kill 3785427 00:14:06.931 11:38:26 -- common/autotest_common.sh@960 -- # wait 3785427 00:14:07.189 11:38:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:07.189 11:38:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:07.189 11:38:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:07.189 11:38:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:07.189 11:38:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:07.189 11:38:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:07.189 11:38:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:07.189 11:38:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:09.726 11:38:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:09.726 00:14:09.726 real 0m19.720s 00:14:09.726 user 1m7.317s 00:14:09.726 sys 0m5.228s 00:14:09.726 11:38:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:09.726 11:38:29 -- common/autotest_common.sh@10 -- # set +x 00:14:09.726 ************************************ 00:14:09.726 END TEST nvmf_lvol 00:14:09.726 ************************************ 00:14:09.726 11:38:29 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:09.726 11:38:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:09.726 11:38:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:09.726 11:38:29 -- common/autotest_common.sh@10 -- # set +x 00:14:09.726 ************************************ 00:14:09.726 START TEST nvmf_lvs_grow 00:14:09.726 ************************************ 00:14:09.726 11:38:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:09.726 * Looking for test storage... 00:14:09.726 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:09.726 11:38:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:09.726 11:38:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:09.726 11:38:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:09.726 11:38:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:09.726 11:38:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:09.726 11:38:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:09.726 11:38:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:09.726 11:38:29 -- scripts/common.sh@335 -- # IFS=.-: 00:14:09.726 11:38:29 -- scripts/common.sh@335 -- # read -ra ver1 00:14:09.726 11:38:29 -- scripts/common.sh@336 -- # IFS=.-: 00:14:09.726 11:38:29 -- scripts/common.sh@336 -- # read -ra ver2 00:14:09.726 11:38:29 -- scripts/common.sh@337 -- # local 'op=<' 00:14:09.726 11:38:29 -- scripts/common.sh@339 -- # ver1_l=2 00:14:09.726 11:38:29 -- scripts/common.sh@340 -- # ver2_l=1 00:14:09.726 11:38:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:09.726 11:38:29 -- scripts/common.sh@343 -- # case "$op" in 00:14:09.726 11:38:29 -- scripts/common.sh@344 -- # : 1 00:14:09.726 11:38:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:09.726 11:38:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:09.726 11:38:29 -- scripts/common.sh@364 -- # decimal 1 00:14:09.726 11:38:29 -- scripts/common.sh@352 -- # local d=1 00:14:09.726 11:38:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:09.726 11:38:29 -- scripts/common.sh@354 -- # echo 1 00:14:09.726 11:38:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:09.726 11:38:29 -- scripts/common.sh@365 -- # decimal 2 00:14:09.726 11:38:29 -- scripts/common.sh@352 -- # local d=2 00:14:09.726 11:38:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:09.726 11:38:29 -- scripts/common.sh@354 -- # echo 2 00:14:09.726 11:38:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:09.726 11:38:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:09.726 11:38:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:09.726 11:38:29 -- scripts/common.sh@367 -- # return 0 00:14:09.726 11:38:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:09.726 11:38:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:09.726 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:09.726 --rc genhtml_branch_coverage=1 00:14:09.726 --rc genhtml_function_coverage=1 00:14:09.726 --rc genhtml_legend=1 00:14:09.726 --rc geninfo_all_blocks=1 00:14:09.726 --rc geninfo_unexecuted_blocks=1 00:14:09.726 00:14:09.726 ' 00:14:09.726 11:38:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:09.726 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:09.726 --rc genhtml_branch_coverage=1 00:14:09.726 --rc genhtml_function_coverage=1 00:14:09.726 --rc genhtml_legend=1 00:14:09.726 --rc geninfo_all_blocks=1 00:14:09.726 --rc geninfo_unexecuted_blocks=1 00:14:09.726 00:14:09.726 ' 00:14:09.726 11:38:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:09.726 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:09.726 --rc genhtml_branch_coverage=1 00:14:09.726 --rc genhtml_function_coverage=1 00:14:09.726 --rc genhtml_legend=1 00:14:09.726 --rc geninfo_all_blocks=1 00:14:09.726 --rc geninfo_unexecuted_blocks=1 00:14:09.726 00:14:09.726 ' 00:14:09.726 11:38:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:09.726 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:09.726 --rc genhtml_branch_coverage=1 00:14:09.726 --rc genhtml_function_coverage=1 00:14:09.726 --rc genhtml_legend=1 00:14:09.726 --rc geninfo_all_blocks=1 00:14:09.726 --rc geninfo_unexecuted_blocks=1 00:14:09.726 00:14:09.726 ' 00:14:09.726 11:38:29 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:09.726 11:38:29 -- nvmf/common.sh@7 -- # uname -s 00:14:09.726 11:38:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:09.726 11:38:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:09.726 11:38:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:09.726 11:38:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:09.726 11:38:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:09.726 11:38:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:09.726 11:38:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:09.726 11:38:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:09.726 11:38:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:09.726 11:38:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:09.726 11:38:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:09.726 11:38:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:09.726 11:38:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:09.726 11:38:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:09.726 11:38:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:09.726 11:38:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:09.726 11:38:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:09.726 11:38:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:09.726 11:38:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:09.726 11:38:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:09.726 11:38:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:09.726 11:38:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:09.726 11:38:29 -- paths/export.sh@5 -- # export PATH 00:14:09.726 11:38:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:09.726 11:38:29 -- nvmf/common.sh@46 -- # : 0 00:14:09.726 11:38:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:09.726 11:38:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:09.726 11:38:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:09.726 11:38:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:09.726 11:38:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:09.726 11:38:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:09.726 11:38:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:09.726 11:38:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:09.726 11:38:29 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:09.726 11:38:29 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:09.726 11:38:29 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:09.726 11:38:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:09.726 11:38:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:09.726 11:38:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:09.726 11:38:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:09.726 11:38:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:09.726 11:38:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:09.726 11:38:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:09.726 11:38:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:09.727 11:38:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:09.727 11:38:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:09.727 11:38:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:09.727 11:38:29 -- common/autotest_common.sh@10 -- # set +x 00:14:11.628 11:38:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:11.628 11:38:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:11.628 11:38:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:11.628 11:38:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:11.628 11:38:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:11.628 11:38:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:11.628 11:38:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:11.628 11:38:31 -- nvmf/common.sh@294 -- # net_devs=() 00:14:11.628 11:38:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:11.628 11:38:31 -- nvmf/common.sh@295 -- # e810=() 00:14:11.628 11:38:31 -- nvmf/common.sh@295 -- # local -ga e810 00:14:11.628 11:38:31 -- nvmf/common.sh@296 -- # x722=() 00:14:11.628 11:38:31 -- nvmf/common.sh@296 -- # local -ga x722 00:14:11.628 11:38:31 -- nvmf/common.sh@297 -- # mlx=() 00:14:11.628 11:38:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:11.628 11:38:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:11.628 11:38:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:11.628 11:38:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:11.628 11:38:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:11.628 11:38:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:11.628 11:38:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:11.628 11:38:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:11.628 11:38:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:11.628 11:38:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:11.628 11:38:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:11.628 11:38:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:11.628 11:38:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:11.628 11:38:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:11.628 11:38:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:11.628 11:38:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:11.628 11:38:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:11.628 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:11.628 11:38:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:11.628 11:38:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:11.628 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:11.628 11:38:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:11.628 11:38:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:11.628 11:38:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:11.628 11:38:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:11.628 11:38:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:11.628 11:38:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:11.628 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:11.628 11:38:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:11.628 11:38:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:11.628 11:38:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:11.628 11:38:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:11.628 11:38:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:11.628 11:38:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:11.628 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:11.628 11:38:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:11.628 11:38:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:11.628 11:38:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:11.628 11:38:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:11.628 11:38:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:11.628 11:38:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:11.629 11:38:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:11.629 11:38:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:11.629 11:38:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:11.629 11:38:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:11.629 11:38:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:11.629 11:38:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:11.629 11:38:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:11.629 11:38:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:11.629 11:38:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:11.629 11:38:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:11.629 11:38:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:11.629 11:38:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:11.629 11:38:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:11.629 11:38:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:11.629 11:38:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:11.629 11:38:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:11.629 11:38:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:11.629 11:38:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:11.629 11:38:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:11.629 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:11.629 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.180 ms 00:14:11.629 00:14:11.629 --- 10.0.0.2 ping statistics --- 00:14:11.629 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:11.629 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:14:11.629 11:38:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:11.629 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:11.629 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:14:11.629 00:14:11.629 --- 10.0.0.1 ping statistics --- 00:14:11.629 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:11.629 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:14:11.629 11:38:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:11.629 11:38:31 -- nvmf/common.sh@410 -- # return 0 00:14:11.629 11:38:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:11.629 11:38:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:11.629 11:38:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:11.629 11:38:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:11.629 11:38:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:11.629 11:38:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:11.629 11:38:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:11.629 11:38:31 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:11.629 11:38:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:11.629 11:38:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:11.629 11:38:31 -- common/autotest_common.sh@10 -- # set +x 00:14:11.629 11:38:31 -- nvmf/common.sh@469 -- # nvmfpid=3789206 00:14:11.629 11:38:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:11.629 11:38:31 -- nvmf/common.sh@470 -- # waitforlisten 3789206 00:14:11.629 11:38:31 -- common/autotest_common.sh@829 -- # '[' -z 3789206 ']' 00:14:11.629 11:38:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:11.629 11:38:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:11.629 11:38:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:11.629 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:11.629 11:38:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:11.629 11:38:31 -- common/autotest_common.sh@10 -- # set +x 00:14:11.629 [2024-11-28 11:38:31.666627] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:11.629 [2024-11-28 11:38:31.666696] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:11.887 EAL: No free 2048 kB hugepages reported on node 1 00:14:11.887 [2024-11-28 11:38:31.728046] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:11.887 [2024-11-28 11:38:31.832152] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:11.887 [2024-11-28 11:38:31.832322] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:11.887 [2024-11-28 11:38:31.832338] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:11.887 [2024-11-28 11:38:31.832349] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:11.887 [2024-11-28 11:38:31.832383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:12.820 11:38:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:12.820 11:38:32 -- common/autotest_common.sh@862 -- # return 0 00:14:12.820 11:38:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:12.820 11:38:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:12.820 11:38:32 -- common/autotest_common.sh@10 -- # set +x 00:14:12.820 11:38:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:12.820 11:38:32 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:13.079 [2024-11-28 11:38:32.994942] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:13.079 11:38:33 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:13.079 11:38:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:13.079 11:38:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:13.079 11:38:33 -- common/autotest_common.sh@10 -- # set +x 00:14:13.079 ************************************ 00:14:13.079 START TEST lvs_grow_clean 00:14:13.079 ************************************ 00:14:13.079 11:38:33 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:13.079 11:38:33 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:13.079 11:38:33 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:13.079 11:38:33 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:13.079 11:38:33 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:13.079 11:38:33 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:13.079 11:38:33 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:13.079 11:38:33 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:13.079 11:38:33 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:13.079 11:38:33 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:13.337 11:38:33 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:13.337 11:38:33 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:13.595 11:38:33 -- target/nvmf_lvs_grow.sh@28 -- # lvs=d5056f21-c239-4a6e-9df3-cc8975c21048 00:14:13.595 11:38:33 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5056f21-c239-4a6e-9df3-cc8975c21048 00:14:13.595 11:38:33 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:13.852 11:38:33 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:13.852 11:38:33 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:13.852 11:38:33 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u d5056f21-c239-4a6e-9df3-cc8975c21048 lvol 150 00:14:14.111 11:38:34 -- target/nvmf_lvs_grow.sh@33 -- # lvol=61725f47-e717-47a5-8b38-4548c9644834 00:14:14.111 11:38:34 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:14.111 11:38:34 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:14.369 [2024-11-28 11:38:34.315806] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:14.370 [2024-11-28 11:38:34.315929] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:14.370 true 00:14:14.370 11:38:34 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5056f21-c239-4a6e-9df3-cc8975c21048 00:14:14.370 11:38:34 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:14.628 11:38:34 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:14.628 11:38:34 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:14.886 11:38:34 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 61725f47-e717-47a5-8b38-4548c9644834 00:14:15.148 11:38:35 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:15.408 [2024-11-28 11:38:35.323049] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:15.408 11:38:35 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:15.666 11:38:35 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3789780 00:14:15.666 11:38:35 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:15.666 11:38:35 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:15.666 11:38:35 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3789780 /var/tmp/bdevperf.sock 00:14:15.666 11:38:35 -- common/autotest_common.sh@829 -- # '[' -z 3789780 ']' 00:14:15.666 11:38:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:15.666 11:38:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:15.666 11:38:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:15.666 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:15.666 11:38:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:15.666 11:38:35 -- common/autotest_common.sh@10 -- # set +x 00:14:15.666 [2024-11-28 11:38:35.627598] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:15.666 [2024-11-28 11:38:35.627674] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3789780 ] 00:14:15.666 EAL: No free 2048 kB hugepages reported on node 1 00:14:15.666 [2024-11-28 11:38:35.688976] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:15.925 [2024-11-28 11:38:35.804226] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:16.860 11:38:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:16.860 11:38:36 -- common/autotest_common.sh@862 -- # return 0 00:14:16.860 11:38:36 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:17.119 Nvme0n1 00:14:17.119 11:38:36 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:17.119 [ 00:14:17.119 { 00:14:17.119 "name": "Nvme0n1", 00:14:17.119 "aliases": [ 00:14:17.119 "61725f47-e717-47a5-8b38-4548c9644834" 00:14:17.119 ], 00:14:17.119 "product_name": "NVMe disk", 00:14:17.119 "block_size": 4096, 00:14:17.119 "num_blocks": 38912, 00:14:17.119 "uuid": "61725f47-e717-47a5-8b38-4548c9644834", 00:14:17.119 "assigned_rate_limits": { 00:14:17.119 "rw_ios_per_sec": 0, 00:14:17.119 "rw_mbytes_per_sec": 0, 00:14:17.119 "r_mbytes_per_sec": 0, 00:14:17.119 "w_mbytes_per_sec": 0 00:14:17.119 }, 00:14:17.119 "claimed": false, 00:14:17.119 "zoned": false, 00:14:17.119 "supported_io_types": { 00:14:17.119 "read": true, 00:14:17.119 "write": true, 00:14:17.119 "unmap": true, 00:14:17.119 "write_zeroes": true, 00:14:17.119 "flush": true, 00:14:17.119 "reset": true, 00:14:17.119 "compare": true, 00:14:17.119 "compare_and_write": true, 00:14:17.119 "abort": true, 00:14:17.119 "nvme_admin": true, 00:14:17.119 "nvme_io": true 00:14:17.119 }, 00:14:17.119 "driver_specific": { 00:14:17.119 "nvme": [ 00:14:17.119 { 00:14:17.119 "trid": { 00:14:17.119 "trtype": "TCP", 00:14:17.119 "adrfam": "IPv4", 00:14:17.119 "traddr": "10.0.0.2", 00:14:17.119 "trsvcid": "4420", 00:14:17.119 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:17.119 }, 00:14:17.119 "ctrlr_data": { 00:14:17.119 "cntlid": 1, 00:14:17.119 "vendor_id": "0x8086", 00:14:17.119 "model_number": "SPDK bdev Controller", 00:14:17.119 "serial_number": "SPDK0", 00:14:17.119 "firmware_revision": "24.01.1", 00:14:17.119 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:17.119 "oacs": { 00:14:17.119 "security": 0, 00:14:17.119 "format": 0, 00:14:17.119 "firmware": 0, 00:14:17.119 "ns_manage": 0 00:14:17.119 }, 00:14:17.119 "multi_ctrlr": true, 00:14:17.119 "ana_reporting": false 00:14:17.119 }, 00:14:17.119 "vs": { 00:14:17.119 "nvme_version": "1.3" 00:14:17.119 }, 00:14:17.119 "ns_data": { 00:14:17.119 "id": 1, 00:14:17.119 "can_share": true 00:14:17.119 } 00:14:17.119 } 00:14:17.119 ], 00:14:17.119 "mp_policy": "active_passive" 00:14:17.119 } 00:14:17.119 } 00:14:17.119 ] 00:14:17.377 11:38:37 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3789935 00:14:17.377 11:38:37 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:17.377 11:38:37 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:17.377 Running I/O for 10 seconds... 00:14:18.312 Latency(us) 00:14:18.312 [2024-11-28T10:38:38.368Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:18.312 [2024-11-28T10:38:38.368Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:18.312 Nvme0n1 : 1.00 14761.00 57.66 0.00 0.00 0.00 0.00 0.00 00:14:18.312 [2024-11-28T10:38:38.368Z] =================================================================================================================== 00:14:18.312 [2024-11-28T10:38:38.368Z] Total : 14761.00 57.66 0.00 0.00 0.00 0.00 0.00 00:14:18.312 00:14:19.245 11:38:39 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u d5056f21-c239-4a6e-9df3-cc8975c21048 00:14:19.245 [2024-11-28T10:38:39.301Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:19.245 Nvme0n1 : 2.00 14828.50 57.92 0.00 0.00 0.00 0.00 0.00 00:14:19.245 [2024-11-28T10:38:39.301Z] =================================================================================================================== 00:14:19.245 [2024-11-28T10:38:39.301Z] Total : 14828.50 57.92 0.00 0.00 0.00 0.00 0.00 00:14:19.245 00:14:19.503 true 00:14:19.503 11:38:39 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5056f21-c239-4a6e-9df3-cc8975c21048 00:14:19.503 11:38:39 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:19.761 11:38:39 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:19.761 11:38:39 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:19.761 11:38:39 -- target/nvmf_lvs_grow.sh@65 -- # wait 3789935 00:14:20.325 [2024-11-28T10:38:40.381Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:20.325 Nvme0n1 : 3.00 14892.67 58.17 0.00 0.00 0.00 0.00 0.00 00:14:20.325 [2024-11-28T10:38:40.381Z] =================================================================================================================== 00:14:20.325 [2024-11-28T10:38:40.381Z] Total : 14892.67 58.17 0.00 0.00 0.00 0.00 0.00 00:14:20.325 00:14:21.259 [2024-11-28T10:38:41.315Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:21.259 Nvme0n1 : 4.00 14963.00 58.45 0.00 0.00 0.00 0.00 0.00 00:14:21.259 [2024-11-28T10:38:41.315Z] =================================================================================================================== 00:14:21.259 [2024-11-28T10:38:41.315Z] Total : 14963.00 58.45 0.00 0.00 0.00 0.00 0.00 00:14:21.259 00:14:22.633 [2024-11-28T10:38:42.689Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:22.633 Nvme0n1 : 5.00 15031.80 58.72 0.00 0.00 0.00 0.00 0.00 00:14:22.633 [2024-11-28T10:38:42.689Z] =================================================================================================================== 00:14:22.633 [2024-11-28T10:38:42.689Z] Total : 15031.80 58.72 0.00 0.00 0.00 0.00 0.00 00:14:22.633 00:14:23.567 [2024-11-28T10:38:43.623Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:23.567 Nvme0n1 : 6.00 15075.33 58.89 0.00 0.00 0.00 0.00 0.00 00:14:23.567 [2024-11-28T10:38:43.623Z] =================================================================================================================== 00:14:23.567 [2024-11-28T10:38:43.623Z] Total : 15075.33 58.89 0.00 0.00 0.00 0.00 0.00 00:14:23.567 00:14:24.501 [2024-11-28T10:38:44.557Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:24.501 Nvme0n1 : 7.00 14975.14 58.50 0.00 0.00 0.00 0.00 0.00 00:14:24.501 [2024-11-28T10:38:44.557Z] =================================================================================================================== 00:14:24.501 [2024-11-28T10:38:44.557Z] Total : 14975.14 58.50 0.00 0.00 0.00 0.00 0.00 00:14:24.501 00:14:25.435 [2024-11-28T10:38:45.491Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:25.435 Nvme0n1 : 8.00 14886.25 58.15 0.00 0.00 0.00 0.00 0.00 00:14:25.435 [2024-11-28T10:38:45.491Z] =================================================================================================================== 00:14:25.435 [2024-11-28T10:38:45.491Z] Total : 14886.25 58.15 0.00 0.00 0.00 0.00 0.00 00:14:25.435 00:14:26.369 [2024-11-28T10:38:46.425Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:26.369 Nvme0n1 : 9.00 14820.67 57.89 0.00 0.00 0.00 0.00 0.00 00:14:26.369 [2024-11-28T10:38:46.425Z] =================================================================================================================== 00:14:26.369 [2024-11-28T10:38:46.425Z] Total : 14820.67 57.89 0.00 0.00 0.00 0.00 0.00 00:14:26.369 00:14:27.303 [2024-11-28T10:38:47.359Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:27.303 Nvme0n1 : 10.00 14774.60 57.71 0.00 0.00 0.00 0.00 0.00 00:14:27.303 [2024-11-28T10:38:47.359Z] =================================================================================================================== 00:14:27.303 [2024-11-28T10:38:47.359Z] Total : 14774.60 57.71 0.00 0.00 0.00 0.00 0.00 00:14:27.303 00:14:27.303 00:14:27.303 Latency(us) 00:14:27.303 [2024-11-28T10:38:47.359Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:27.303 [2024-11-28T10:38:47.359Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:27.303 Nvme0n1 : 10.01 14772.74 57.71 0.00 0.00 8656.88 2172.40 16408.27 00:14:27.303 [2024-11-28T10:38:47.359Z] =================================================================================================================== 00:14:27.303 [2024-11-28T10:38:47.359Z] Total : 14772.74 57.71 0.00 0.00 8656.88 2172.40 16408.27 00:14:27.303 0 00:14:27.303 11:38:47 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3789780 00:14:27.303 11:38:47 -- common/autotest_common.sh@936 -- # '[' -z 3789780 ']' 00:14:27.303 11:38:47 -- common/autotest_common.sh@940 -- # kill -0 3789780 00:14:27.303 11:38:47 -- common/autotest_common.sh@941 -- # uname 00:14:27.303 11:38:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:27.303 11:38:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3789780 00:14:27.562 11:38:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:27.563 11:38:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:27.563 11:38:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3789780' 00:14:27.563 killing process with pid 3789780 00:14:27.563 11:38:47 -- common/autotest_common.sh@955 -- # kill 3789780 00:14:27.563 Received shutdown signal, test time was about 10.000000 seconds 00:14:27.563 00:14:27.563 Latency(us) 00:14:27.563 [2024-11-28T10:38:47.619Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:27.563 [2024-11-28T10:38:47.619Z] =================================================================================================================== 00:14:27.563 [2024-11-28T10:38:47.619Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:27.563 11:38:47 -- common/autotest_common.sh@960 -- # wait 3789780 00:14:27.821 11:38:47 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:28.079 11:38:47 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5056f21-c239-4a6e-9df3-cc8975c21048 00:14:28.079 11:38:47 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:28.336 11:38:48 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:28.336 11:38:48 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:28.336 11:38:48 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:28.595 [2024-11-28 11:38:48.468403] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:28.595 11:38:48 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5056f21-c239-4a6e-9df3-cc8975c21048 00:14:28.595 11:38:48 -- common/autotest_common.sh@650 -- # local es=0 00:14:28.595 11:38:48 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5056f21-c239-4a6e-9df3-cc8975c21048 00:14:28.595 11:38:48 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:28.595 11:38:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:28.595 11:38:48 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:28.595 11:38:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:28.595 11:38:48 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:28.595 11:38:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:28.595 11:38:48 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:28.595 11:38:48 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:28.595 11:38:48 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5056f21-c239-4a6e-9df3-cc8975c21048 00:14:28.853 request: 00:14:28.853 { 00:14:28.853 "uuid": "d5056f21-c239-4a6e-9df3-cc8975c21048", 00:14:28.853 "method": "bdev_lvol_get_lvstores", 00:14:28.853 "req_id": 1 00:14:28.853 } 00:14:28.853 Got JSON-RPC error response 00:14:28.853 response: 00:14:28.853 { 00:14:28.853 "code": -19, 00:14:28.853 "message": "No such device" 00:14:28.853 } 00:14:28.853 11:38:48 -- common/autotest_common.sh@653 -- # es=1 00:14:28.853 11:38:48 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:28.853 11:38:48 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:28.853 11:38:48 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:28.853 11:38:48 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:29.111 aio_bdev 00:14:29.111 11:38:49 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 61725f47-e717-47a5-8b38-4548c9644834 00:14:29.111 11:38:49 -- common/autotest_common.sh@897 -- # local bdev_name=61725f47-e717-47a5-8b38-4548c9644834 00:14:29.111 11:38:49 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:29.111 11:38:49 -- common/autotest_common.sh@899 -- # local i 00:14:29.111 11:38:49 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:29.111 11:38:49 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:29.111 11:38:49 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:29.369 11:38:49 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 61725f47-e717-47a5-8b38-4548c9644834 -t 2000 00:14:29.627 [ 00:14:29.627 { 00:14:29.627 "name": "61725f47-e717-47a5-8b38-4548c9644834", 00:14:29.627 "aliases": [ 00:14:29.627 "lvs/lvol" 00:14:29.627 ], 00:14:29.627 "product_name": "Logical Volume", 00:14:29.627 "block_size": 4096, 00:14:29.627 "num_blocks": 38912, 00:14:29.627 "uuid": "61725f47-e717-47a5-8b38-4548c9644834", 00:14:29.627 "assigned_rate_limits": { 00:14:29.627 "rw_ios_per_sec": 0, 00:14:29.627 "rw_mbytes_per_sec": 0, 00:14:29.627 "r_mbytes_per_sec": 0, 00:14:29.627 "w_mbytes_per_sec": 0 00:14:29.627 }, 00:14:29.627 "claimed": false, 00:14:29.627 "zoned": false, 00:14:29.627 "supported_io_types": { 00:14:29.627 "read": true, 00:14:29.627 "write": true, 00:14:29.627 "unmap": true, 00:14:29.627 "write_zeroes": true, 00:14:29.627 "flush": false, 00:14:29.627 "reset": true, 00:14:29.627 "compare": false, 00:14:29.627 "compare_and_write": false, 00:14:29.627 "abort": false, 00:14:29.627 "nvme_admin": false, 00:14:29.627 "nvme_io": false 00:14:29.627 }, 00:14:29.627 "driver_specific": { 00:14:29.627 "lvol": { 00:14:29.627 "lvol_store_uuid": "d5056f21-c239-4a6e-9df3-cc8975c21048", 00:14:29.627 "base_bdev": "aio_bdev", 00:14:29.627 "thin_provision": false, 00:14:29.627 "snapshot": false, 00:14:29.627 "clone": false, 00:14:29.627 "esnap_clone": false 00:14:29.627 } 00:14:29.627 } 00:14:29.627 } 00:14:29.627 ] 00:14:29.627 11:38:49 -- common/autotest_common.sh@905 -- # return 0 00:14:29.627 11:38:49 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:29.627 11:38:49 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5056f21-c239-4a6e-9df3-cc8975c21048 00:14:29.885 11:38:49 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:29.885 11:38:49 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d5056f21-c239-4a6e-9df3-cc8975c21048 00:14:29.885 11:38:49 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:30.143 11:38:50 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:30.143 11:38:50 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 61725f47-e717-47a5-8b38-4548c9644834 00:14:30.401 11:38:50 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u d5056f21-c239-4a6e-9df3-cc8975c21048 00:14:30.660 11:38:50 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:30.919 11:38:50 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:30.919 00:14:30.919 real 0m17.779s 00:14:30.919 user 0m17.609s 00:14:30.919 sys 0m1.695s 00:14:30.919 11:38:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:30.919 11:38:50 -- common/autotest_common.sh@10 -- # set +x 00:14:30.919 ************************************ 00:14:30.919 END TEST lvs_grow_clean 00:14:30.919 ************************************ 00:14:30.919 11:38:50 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:30.919 11:38:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:30.919 11:38:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:30.919 11:38:50 -- common/autotest_common.sh@10 -- # set +x 00:14:30.919 ************************************ 00:14:30.919 START TEST lvs_grow_dirty 00:14:30.919 ************************************ 00:14:30.919 11:38:50 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:14:30.919 11:38:50 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:30.919 11:38:50 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:30.919 11:38:50 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:30.919 11:38:50 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:30.919 11:38:50 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:30.919 11:38:50 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:30.919 11:38:50 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:30.919 11:38:50 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:30.919 11:38:50 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:31.177 11:38:51 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:31.177 11:38:51 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:31.436 11:38:51 -- target/nvmf_lvs_grow.sh@28 -- # lvs=9424ee82-c4c7-46b4-a550-18d7370466d2 00:14:31.436 11:38:51 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:31.436 11:38:51 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9424ee82-c4c7-46b4-a550-18d7370466d2 00:14:31.695 11:38:51 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:31.695 11:38:51 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:31.695 11:38:51 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 9424ee82-c4c7-46b4-a550-18d7370466d2 lvol 150 00:14:31.955 11:38:51 -- target/nvmf_lvs_grow.sh@33 -- # lvol=c8c2350b-7720-45fa-9d98-e42a94dac11c 00:14:31.955 11:38:51 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:31.955 11:38:51 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:32.213 [2024-11-28 11:38:52.225170] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:32.213 [2024-11-28 11:38:52.225282] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:32.213 true 00:14:32.213 11:38:52 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9424ee82-c4c7-46b4-a550-18d7370466d2 00:14:32.213 11:38:52 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:32.471 11:38:52 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:32.472 11:38:52 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:32.730 11:38:52 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 c8c2350b-7720-45fa-9d98-e42a94dac11c 00:14:32.988 11:38:53 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:33.245 11:38:53 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:33.812 11:38:53 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3792020 00:14:33.812 11:38:53 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:33.812 11:38:53 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:33.812 11:38:53 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3792020 /var/tmp/bdevperf.sock 00:14:33.812 11:38:53 -- common/autotest_common.sh@829 -- # '[' -z 3792020 ']' 00:14:33.812 11:38:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:33.812 11:38:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:33.812 11:38:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:33.812 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:33.812 11:38:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:33.812 11:38:53 -- common/autotest_common.sh@10 -- # set +x 00:14:33.812 [2024-11-28 11:38:53.621835] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:33.812 [2024-11-28 11:38:53.621903] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3792020 ] 00:14:33.812 EAL: No free 2048 kB hugepages reported on node 1 00:14:33.812 [2024-11-28 11:38:53.683842] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:33.812 [2024-11-28 11:38:53.797850] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:34.745 11:38:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:34.745 11:38:54 -- common/autotest_common.sh@862 -- # return 0 00:14:34.745 11:38:54 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:35.310 Nvme0n1 00:14:35.310 11:38:55 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:35.567 [ 00:14:35.567 { 00:14:35.567 "name": "Nvme0n1", 00:14:35.567 "aliases": [ 00:14:35.567 "c8c2350b-7720-45fa-9d98-e42a94dac11c" 00:14:35.567 ], 00:14:35.567 "product_name": "NVMe disk", 00:14:35.567 "block_size": 4096, 00:14:35.567 "num_blocks": 38912, 00:14:35.567 "uuid": "c8c2350b-7720-45fa-9d98-e42a94dac11c", 00:14:35.567 "assigned_rate_limits": { 00:14:35.567 "rw_ios_per_sec": 0, 00:14:35.567 "rw_mbytes_per_sec": 0, 00:14:35.567 "r_mbytes_per_sec": 0, 00:14:35.567 "w_mbytes_per_sec": 0 00:14:35.567 }, 00:14:35.567 "claimed": false, 00:14:35.567 "zoned": false, 00:14:35.567 "supported_io_types": { 00:14:35.567 "read": true, 00:14:35.567 "write": true, 00:14:35.567 "unmap": true, 00:14:35.567 "write_zeroes": true, 00:14:35.567 "flush": true, 00:14:35.567 "reset": true, 00:14:35.567 "compare": true, 00:14:35.567 "compare_and_write": true, 00:14:35.567 "abort": true, 00:14:35.567 "nvme_admin": true, 00:14:35.567 "nvme_io": true 00:14:35.567 }, 00:14:35.567 "driver_specific": { 00:14:35.567 "nvme": [ 00:14:35.567 { 00:14:35.567 "trid": { 00:14:35.567 "trtype": "TCP", 00:14:35.567 "adrfam": "IPv4", 00:14:35.567 "traddr": "10.0.0.2", 00:14:35.567 "trsvcid": "4420", 00:14:35.567 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:35.567 }, 00:14:35.567 "ctrlr_data": { 00:14:35.567 "cntlid": 1, 00:14:35.567 "vendor_id": "0x8086", 00:14:35.567 "model_number": "SPDK bdev Controller", 00:14:35.567 "serial_number": "SPDK0", 00:14:35.567 "firmware_revision": "24.01.1", 00:14:35.567 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:35.567 "oacs": { 00:14:35.567 "security": 0, 00:14:35.567 "format": 0, 00:14:35.567 "firmware": 0, 00:14:35.567 "ns_manage": 0 00:14:35.567 }, 00:14:35.567 "multi_ctrlr": true, 00:14:35.567 "ana_reporting": false 00:14:35.567 }, 00:14:35.567 "vs": { 00:14:35.567 "nvme_version": "1.3" 00:14:35.567 }, 00:14:35.567 "ns_data": { 00:14:35.567 "id": 1, 00:14:35.567 "can_share": true 00:14:35.567 } 00:14:35.567 } 00:14:35.567 ], 00:14:35.567 "mp_policy": "active_passive" 00:14:35.567 } 00:14:35.567 } 00:14:35.567 ] 00:14:35.567 11:38:55 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3792169 00:14:35.567 11:38:55 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:35.567 11:38:55 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:35.567 Running I/O for 10 seconds... 00:14:36.500 Latency(us) 00:14:36.500 [2024-11-28T10:38:56.556Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:36.500 [2024-11-28T10:38:56.556Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:36.500 Nvme0n1 : 1.00 14750.00 57.62 0.00 0.00 0.00 0.00 0.00 00:14:36.500 [2024-11-28T10:38:56.556Z] =================================================================================================================== 00:14:36.500 [2024-11-28T10:38:56.556Z] Total : 14750.00 57.62 0.00 0.00 0.00 0.00 0.00 00:14:36.500 00:14:37.435 11:38:57 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 9424ee82-c4c7-46b4-a550-18d7370466d2 00:14:37.693 [2024-11-28T10:38:57.749Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:37.693 Nvme0n1 : 2.00 14824.00 57.91 0.00 0.00 0.00 0.00 0.00 00:14:37.693 [2024-11-28T10:38:57.749Z] =================================================================================================================== 00:14:37.693 [2024-11-28T10:38:57.749Z] Total : 14824.00 57.91 0.00 0.00 0.00 0.00 0.00 00:14:37.693 00:14:37.693 true 00:14:37.693 11:38:57 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9424ee82-c4c7-46b4-a550-18d7370466d2 00:14:37.693 11:38:57 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:37.951 11:38:57 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:37.951 11:38:57 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:37.951 11:38:57 -- target/nvmf_lvs_grow.sh@65 -- # wait 3792169 00:14:38.518 [2024-11-28T10:38:58.574Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:38.518 Nvme0n1 : 3.00 14928.67 58.32 0.00 0.00 0.00 0.00 0.00 00:14:38.518 [2024-11-28T10:38:58.574Z] =================================================================================================================== 00:14:38.518 [2024-11-28T10:38:58.574Z] Total : 14928.67 58.32 0.00 0.00 0.00 0.00 0.00 00:14:38.518 00:14:39.452 [2024-11-28T10:38:59.508Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:39.452 Nvme0n1 : 4.00 14992.25 58.56 0.00 0.00 0.00 0.00 0.00 00:14:39.452 [2024-11-28T10:38:59.508Z] =================================================================================================================== 00:14:39.452 [2024-11-28T10:38:59.508Z] Total : 14992.25 58.56 0.00 0.00 0.00 0.00 0.00 00:14:39.452 00:14:40.828 [2024-11-28T10:39:00.884Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:40.828 Nvme0n1 : 5.00 15027.40 58.70 0.00 0.00 0.00 0.00 0.00 00:14:40.828 [2024-11-28T10:39:00.884Z] =================================================================================================================== 00:14:40.828 [2024-11-28T10:39:00.884Z] Total : 15027.40 58.70 0.00 0.00 0.00 0.00 0.00 00:14:40.828 00:14:41.764 [2024-11-28T10:39:01.820Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:41.764 Nvme0n1 : 6.00 15063.00 58.84 0.00 0.00 0.00 0.00 0.00 00:14:41.764 [2024-11-28T10:39:01.820Z] =================================================================================================================== 00:14:41.764 [2024-11-28T10:39:01.820Z] Total : 15063.00 58.84 0.00 0.00 0.00 0.00 0.00 00:14:41.764 00:14:42.700 [2024-11-28T10:39:02.756Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:42.700 Nvme0n1 : 7.00 15116.29 59.05 0.00 0.00 0.00 0.00 0.00 00:14:42.700 [2024-11-28T10:39:02.756Z] =================================================================================================================== 00:14:42.700 [2024-11-28T10:39:02.756Z] Total : 15116.29 59.05 0.00 0.00 0.00 0.00 0.00 00:14:42.700 00:14:43.635 [2024-11-28T10:39:03.691Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:43.635 Nvme0n1 : 8.00 15199.75 59.37 0.00 0.00 0.00 0.00 0.00 00:14:43.635 [2024-11-28T10:39:03.691Z] =================================================================================================================== 00:14:43.635 [2024-11-28T10:39:03.691Z] Total : 15199.75 59.37 0.00 0.00 0.00 0.00 0.00 00:14:43.635 00:14:44.570 [2024-11-28T10:39:04.626Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:44.570 Nvme0n1 : 9.00 15250.89 59.57 0.00 0.00 0.00 0.00 0.00 00:14:44.570 [2024-11-28T10:39:04.626Z] =================================================================================================================== 00:14:44.570 [2024-11-28T10:39:04.626Z] Total : 15250.89 59.57 0.00 0.00 0.00 0.00 0.00 00:14:44.570 00:14:45.506 [2024-11-28T10:39:05.562Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:45.506 Nvme0n1 : 10.00 15329.20 59.88 0.00 0.00 0.00 0.00 0.00 00:14:45.506 [2024-11-28T10:39:05.562Z] =================================================================================================================== 00:14:45.506 [2024-11-28T10:39:05.562Z] Total : 15329.20 59.88 0.00 0.00 0.00 0.00 0.00 00:14:45.506 00:14:45.506 00:14:45.506 Latency(us) 00:14:45.506 [2024-11-28T10:39:05.562Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:45.506 [2024-11-28T10:39:05.562Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:45.506 Nvme0n1 : 10.01 15334.29 59.90 0.00 0.00 8342.76 2402.99 16019.91 00:14:45.506 [2024-11-28T10:39:05.562Z] =================================================================================================================== 00:14:45.506 [2024-11-28T10:39:05.562Z] Total : 15334.29 59.90 0.00 0.00 8342.76 2402.99 16019.91 00:14:45.506 0 00:14:45.506 11:39:05 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3792020 00:14:45.506 11:39:05 -- common/autotest_common.sh@936 -- # '[' -z 3792020 ']' 00:14:45.506 11:39:05 -- common/autotest_common.sh@940 -- # kill -0 3792020 00:14:45.506 11:39:05 -- common/autotest_common.sh@941 -- # uname 00:14:45.506 11:39:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:45.506 11:39:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3792020 00:14:45.764 11:39:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:45.764 11:39:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:45.764 11:39:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3792020' 00:14:45.765 killing process with pid 3792020 00:14:45.765 11:39:05 -- common/autotest_common.sh@955 -- # kill 3792020 00:14:45.765 Received shutdown signal, test time was about 10.000000 seconds 00:14:45.765 00:14:45.765 Latency(us) 00:14:45.765 [2024-11-28T10:39:05.821Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:45.765 [2024-11-28T10:39:05.821Z] =================================================================================================================== 00:14:45.765 [2024-11-28T10:39:05.821Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:45.765 11:39:05 -- common/autotest_common.sh@960 -- # wait 3792020 00:14:46.023 11:39:05 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:46.282 11:39:06 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9424ee82-c4c7-46b4-a550-18d7370466d2 00:14:46.282 11:39:06 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:46.541 11:39:06 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:46.541 11:39:06 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:14:46.541 11:39:06 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3789206 00:14:46.541 11:39:06 -- target/nvmf_lvs_grow.sh@74 -- # wait 3789206 00:14:46.541 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3789206 Killed "${NVMF_APP[@]}" "$@" 00:14:46.541 11:39:06 -- target/nvmf_lvs_grow.sh@74 -- # true 00:14:46.541 11:39:06 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:14:46.541 11:39:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:46.541 11:39:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:46.541 11:39:06 -- common/autotest_common.sh@10 -- # set +x 00:14:46.541 11:39:06 -- nvmf/common.sh@469 -- # nvmfpid=3793647 00:14:46.541 11:39:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:46.541 11:39:06 -- nvmf/common.sh@470 -- # waitforlisten 3793647 00:14:46.541 11:39:06 -- common/autotest_common.sh@829 -- # '[' -z 3793647 ']' 00:14:46.541 11:39:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:46.541 11:39:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:46.541 11:39:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:46.541 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:46.541 11:39:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:46.541 11:39:06 -- common/autotest_common.sh@10 -- # set +x 00:14:46.541 [2024-11-28 11:39:06.462180] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:46.542 [2024-11-28 11:39:06.462251] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:46.542 EAL: No free 2048 kB hugepages reported on node 1 00:14:46.542 [2024-11-28 11:39:06.525689] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:46.802 [2024-11-28 11:39:06.632604] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:46.802 [2024-11-28 11:39:06.632755] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:46.802 [2024-11-28 11:39:06.632773] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:46.802 [2024-11-28 11:39:06.632786] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:46.802 [2024-11-28 11:39:06.632813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:47.799 11:39:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:47.799 11:39:07 -- common/autotest_common.sh@862 -- # return 0 00:14:47.799 11:39:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:47.799 11:39:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:47.799 11:39:07 -- common/autotest_common.sh@10 -- # set +x 00:14:47.799 11:39:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:47.799 11:39:07 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:47.799 [2024-11-28 11:39:07.734015] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:14:47.799 [2024-11-28 11:39:07.734174] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:14:47.800 [2024-11-28 11:39:07.734222] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:14:47.800 11:39:07 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:14:47.800 11:39:07 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev c8c2350b-7720-45fa-9d98-e42a94dac11c 00:14:47.800 11:39:07 -- common/autotest_common.sh@897 -- # local bdev_name=c8c2350b-7720-45fa-9d98-e42a94dac11c 00:14:47.800 11:39:07 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:47.800 11:39:07 -- common/autotest_common.sh@899 -- # local i 00:14:47.800 11:39:07 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:47.800 11:39:07 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:47.800 11:39:07 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:48.058 11:39:08 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c8c2350b-7720-45fa-9d98-e42a94dac11c -t 2000 00:14:48.317 [ 00:14:48.317 { 00:14:48.317 "name": "c8c2350b-7720-45fa-9d98-e42a94dac11c", 00:14:48.317 "aliases": [ 00:14:48.317 "lvs/lvol" 00:14:48.317 ], 00:14:48.317 "product_name": "Logical Volume", 00:14:48.317 "block_size": 4096, 00:14:48.317 "num_blocks": 38912, 00:14:48.317 "uuid": "c8c2350b-7720-45fa-9d98-e42a94dac11c", 00:14:48.317 "assigned_rate_limits": { 00:14:48.317 "rw_ios_per_sec": 0, 00:14:48.317 "rw_mbytes_per_sec": 0, 00:14:48.317 "r_mbytes_per_sec": 0, 00:14:48.317 "w_mbytes_per_sec": 0 00:14:48.317 }, 00:14:48.317 "claimed": false, 00:14:48.317 "zoned": false, 00:14:48.317 "supported_io_types": { 00:14:48.317 "read": true, 00:14:48.317 "write": true, 00:14:48.317 "unmap": true, 00:14:48.317 "write_zeroes": true, 00:14:48.317 "flush": false, 00:14:48.317 "reset": true, 00:14:48.317 "compare": false, 00:14:48.317 "compare_and_write": false, 00:14:48.317 "abort": false, 00:14:48.317 "nvme_admin": false, 00:14:48.317 "nvme_io": false 00:14:48.317 }, 00:14:48.317 "driver_specific": { 00:14:48.317 "lvol": { 00:14:48.317 "lvol_store_uuid": "9424ee82-c4c7-46b4-a550-18d7370466d2", 00:14:48.317 "base_bdev": "aio_bdev", 00:14:48.317 "thin_provision": false, 00:14:48.317 "snapshot": false, 00:14:48.317 "clone": false, 00:14:48.317 "esnap_clone": false 00:14:48.317 } 00:14:48.317 } 00:14:48.317 } 00:14:48.317 ] 00:14:48.317 11:39:08 -- common/autotest_common.sh@905 -- # return 0 00:14:48.317 11:39:08 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9424ee82-c4c7-46b4-a550-18d7370466d2 00:14:48.317 11:39:08 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:14:48.575 11:39:08 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:14:48.575 11:39:08 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9424ee82-c4c7-46b4-a550-18d7370466d2 00:14:48.575 11:39:08 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:14:48.833 11:39:08 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:14:48.833 11:39:08 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:49.091 [2024-11-28 11:39:09.019258] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:49.091 11:39:09 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9424ee82-c4c7-46b4-a550-18d7370466d2 00:14:49.091 11:39:09 -- common/autotest_common.sh@650 -- # local es=0 00:14:49.091 11:39:09 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9424ee82-c4c7-46b4-a550-18d7370466d2 00:14:49.091 11:39:09 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:49.091 11:39:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:49.091 11:39:09 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:49.091 11:39:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:49.091 11:39:09 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:49.091 11:39:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:49.091 11:39:09 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:49.091 11:39:09 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:49.091 11:39:09 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9424ee82-c4c7-46b4-a550-18d7370466d2 00:14:49.349 request: 00:14:49.349 { 00:14:49.349 "uuid": "9424ee82-c4c7-46b4-a550-18d7370466d2", 00:14:49.349 "method": "bdev_lvol_get_lvstores", 00:14:49.349 "req_id": 1 00:14:49.349 } 00:14:49.349 Got JSON-RPC error response 00:14:49.349 response: 00:14:49.349 { 00:14:49.349 "code": -19, 00:14:49.349 "message": "No such device" 00:14:49.349 } 00:14:49.349 11:39:09 -- common/autotest_common.sh@653 -- # es=1 00:14:49.349 11:39:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:49.349 11:39:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:49.349 11:39:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:49.349 11:39:09 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:49.608 aio_bdev 00:14:49.608 11:39:09 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev c8c2350b-7720-45fa-9d98-e42a94dac11c 00:14:49.608 11:39:09 -- common/autotest_common.sh@897 -- # local bdev_name=c8c2350b-7720-45fa-9d98-e42a94dac11c 00:14:49.608 11:39:09 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:49.608 11:39:09 -- common/autotest_common.sh@899 -- # local i 00:14:49.608 11:39:09 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:49.608 11:39:09 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:49.608 11:39:09 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:49.866 11:39:09 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c8c2350b-7720-45fa-9d98-e42a94dac11c -t 2000 00:14:50.125 [ 00:14:50.125 { 00:14:50.125 "name": "c8c2350b-7720-45fa-9d98-e42a94dac11c", 00:14:50.125 "aliases": [ 00:14:50.125 "lvs/lvol" 00:14:50.125 ], 00:14:50.125 "product_name": "Logical Volume", 00:14:50.125 "block_size": 4096, 00:14:50.125 "num_blocks": 38912, 00:14:50.125 "uuid": "c8c2350b-7720-45fa-9d98-e42a94dac11c", 00:14:50.125 "assigned_rate_limits": { 00:14:50.125 "rw_ios_per_sec": 0, 00:14:50.125 "rw_mbytes_per_sec": 0, 00:14:50.125 "r_mbytes_per_sec": 0, 00:14:50.125 "w_mbytes_per_sec": 0 00:14:50.125 }, 00:14:50.125 "claimed": false, 00:14:50.125 "zoned": false, 00:14:50.125 "supported_io_types": { 00:14:50.125 "read": true, 00:14:50.125 "write": true, 00:14:50.125 "unmap": true, 00:14:50.125 "write_zeroes": true, 00:14:50.125 "flush": false, 00:14:50.125 "reset": true, 00:14:50.125 "compare": false, 00:14:50.125 "compare_and_write": false, 00:14:50.125 "abort": false, 00:14:50.125 "nvme_admin": false, 00:14:50.125 "nvme_io": false 00:14:50.125 }, 00:14:50.125 "driver_specific": { 00:14:50.125 "lvol": { 00:14:50.125 "lvol_store_uuid": "9424ee82-c4c7-46b4-a550-18d7370466d2", 00:14:50.125 "base_bdev": "aio_bdev", 00:14:50.125 "thin_provision": false, 00:14:50.125 "snapshot": false, 00:14:50.125 "clone": false, 00:14:50.125 "esnap_clone": false 00:14:50.125 } 00:14:50.125 } 00:14:50.125 } 00:14:50.125 ] 00:14:50.125 11:39:10 -- common/autotest_common.sh@905 -- # return 0 00:14:50.125 11:39:10 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9424ee82-c4c7-46b4-a550-18d7370466d2 00:14:50.125 11:39:10 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:50.383 11:39:10 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:50.383 11:39:10 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9424ee82-c4c7-46b4-a550-18d7370466d2 00:14:50.383 11:39:10 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:50.641 11:39:10 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:50.641 11:39:10 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete c8c2350b-7720-45fa-9d98-e42a94dac11c 00:14:50.899 11:39:10 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 9424ee82-c4c7-46b4-a550-18d7370466d2 00:14:51.157 11:39:11 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:51.415 11:39:11 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:51.415 00:14:51.415 real 0m20.561s 00:14:51.415 user 0m51.486s 00:14:51.415 sys 0m4.651s 00:14:51.415 11:39:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:51.415 11:39:11 -- common/autotest_common.sh@10 -- # set +x 00:14:51.415 ************************************ 00:14:51.415 END TEST lvs_grow_dirty 00:14:51.415 ************************************ 00:14:51.415 11:39:11 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:14:51.415 11:39:11 -- common/autotest_common.sh@806 -- # type=--id 00:14:51.415 11:39:11 -- common/autotest_common.sh@807 -- # id=0 00:14:51.415 11:39:11 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:14:51.415 11:39:11 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:14:51.415 11:39:11 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:14:51.415 11:39:11 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:14:51.415 11:39:11 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:14:51.415 11:39:11 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:14:51.415 nvmf_trace.0 00:14:51.415 11:39:11 -- common/autotest_common.sh@821 -- # return 0 00:14:51.415 11:39:11 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:14:51.415 11:39:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:51.415 11:39:11 -- nvmf/common.sh@116 -- # sync 00:14:51.415 11:39:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:51.415 11:39:11 -- nvmf/common.sh@119 -- # set +e 00:14:51.415 11:39:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:51.415 11:39:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:51.415 rmmod nvme_tcp 00:14:51.415 rmmod nvme_fabrics 00:14:51.673 rmmod nvme_keyring 00:14:51.673 11:39:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:51.673 11:39:11 -- nvmf/common.sh@123 -- # set -e 00:14:51.673 11:39:11 -- nvmf/common.sh@124 -- # return 0 00:14:51.673 11:39:11 -- nvmf/common.sh@477 -- # '[' -n 3793647 ']' 00:14:51.673 11:39:11 -- nvmf/common.sh@478 -- # killprocess 3793647 00:14:51.673 11:39:11 -- common/autotest_common.sh@936 -- # '[' -z 3793647 ']' 00:14:51.673 11:39:11 -- common/autotest_common.sh@940 -- # kill -0 3793647 00:14:51.673 11:39:11 -- common/autotest_common.sh@941 -- # uname 00:14:51.673 11:39:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:51.673 11:39:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3793647 00:14:51.673 11:39:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:51.673 11:39:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:51.673 11:39:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3793647' 00:14:51.673 killing process with pid 3793647 00:14:51.673 11:39:11 -- common/autotest_common.sh@955 -- # kill 3793647 00:14:51.673 11:39:11 -- common/autotest_common.sh@960 -- # wait 3793647 00:14:51.932 11:39:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:51.932 11:39:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:51.932 11:39:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:51.932 11:39:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:51.932 11:39:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:51.932 11:39:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:51.932 11:39:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:51.932 11:39:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:53.836 11:39:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:53.836 00:14:53.836 real 0m44.567s 00:14:53.836 user 1m15.944s 00:14:53.836 sys 0m8.264s 00:14:53.836 11:39:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:53.836 11:39:13 -- common/autotest_common.sh@10 -- # set +x 00:14:53.836 ************************************ 00:14:53.836 END TEST nvmf_lvs_grow 00:14:53.836 ************************************ 00:14:53.836 11:39:13 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:14:53.836 11:39:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:53.836 11:39:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:53.836 11:39:13 -- common/autotest_common.sh@10 -- # set +x 00:14:53.836 ************************************ 00:14:53.836 START TEST nvmf_bdev_io_wait 00:14:53.836 ************************************ 00:14:53.836 11:39:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:14:54.095 * Looking for test storage... 00:14:54.095 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:54.095 11:39:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:54.095 11:39:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:54.095 11:39:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:54.095 11:39:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:54.095 11:39:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:54.095 11:39:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:54.095 11:39:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:54.095 11:39:14 -- scripts/common.sh@335 -- # IFS=.-: 00:14:54.095 11:39:14 -- scripts/common.sh@335 -- # read -ra ver1 00:14:54.095 11:39:14 -- scripts/common.sh@336 -- # IFS=.-: 00:14:54.095 11:39:14 -- scripts/common.sh@336 -- # read -ra ver2 00:14:54.095 11:39:14 -- scripts/common.sh@337 -- # local 'op=<' 00:14:54.095 11:39:14 -- scripts/common.sh@339 -- # ver1_l=2 00:14:54.095 11:39:14 -- scripts/common.sh@340 -- # ver2_l=1 00:14:54.095 11:39:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:54.095 11:39:14 -- scripts/common.sh@343 -- # case "$op" in 00:14:54.095 11:39:14 -- scripts/common.sh@344 -- # : 1 00:14:54.095 11:39:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:54.095 11:39:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:54.095 11:39:14 -- scripts/common.sh@364 -- # decimal 1 00:14:54.095 11:39:14 -- scripts/common.sh@352 -- # local d=1 00:14:54.095 11:39:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:54.095 11:39:14 -- scripts/common.sh@354 -- # echo 1 00:14:54.095 11:39:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:54.095 11:39:14 -- scripts/common.sh@365 -- # decimal 2 00:14:54.095 11:39:14 -- scripts/common.sh@352 -- # local d=2 00:14:54.095 11:39:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:54.095 11:39:14 -- scripts/common.sh@354 -- # echo 2 00:14:54.095 11:39:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:54.095 11:39:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:54.095 11:39:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:54.095 11:39:14 -- scripts/common.sh@367 -- # return 0 00:14:54.095 11:39:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:54.095 11:39:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:54.095 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:54.095 --rc genhtml_branch_coverage=1 00:14:54.095 --rc genhtml_function_coverage=1 00:14:54.095 --rc genhtml_legend=1 00:14:54.095 --rc geninfo_all_blocks=1 00:14:54.095 --rc geninfo_unexecuted_blocks=1 00:14:54.095 00:14:54.095 ' 00:14:54.095 11:39:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:54.095 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:54.095 --rc genhtml_branch_coverage=1 00:14:54.095 --rc genhtml_function_coverage=1 00:14:54.095 --rc genhtml_legend=1 00:14:54.095 --rc geninfo_all_blocks=1 00:14:54.095 --rc geninfo_unexecuted_blocks=1 00:14:54.095 00:14:54.095 ' 00:14:54.095 11:39:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:54.095 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:54.095 --rc genhtml_branch_coverage=1 00:14:54.095 --rc genhtml_function_coverage=1 00:14:54.095 --rc genhtml_legend=1 00:14:54.095 --rc geninfo_all_blocks=1 00:14:54.095 --rc geninfo_unexecuted_blocks=1 00:14:54.095 00:14:54.095 ' 00:14:54.095 11:39:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:54.095 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:54.095 --rc genhtml_branch_coverage=1 00:14:54.095 --rc genhtml_function_coverage=1 00:14:54.095 --rc genhtml_legend=1 00:14:54.096 --rc geninfo_all_blocks=1 00:14:54.096 --rc geninfo_unexecuted_blocks=1 00:14:54.096 00:14:54.096 ' 00:14:54.096 11:39:14 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:54.096 11:39:14 -- nvmf/common.sh@7 -- # uname -s 00:14:54.096 11:39:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:54.096 11:39:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:54.096 11:39:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:54.096 11:39:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:54.096 11:39:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:54.096 11:39:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:54.096 11:39:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:54.096 11:39:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:54.096 11:39:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:54.096 11:39:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:54.096 11:39:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:54.096 11:39:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:54.096 11:39:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:54.096 11:39:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:54.096 11:39:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:54.096 11:39:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:54.096 11:39:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:54.096 11:39:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:54.096 11:39:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:54.096 11:39:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:54.096 11:39:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:54.096 11:39:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:54.096 11:39:14 -- paths/export.sh@5 -- # export PATH 00:14:54.096 11:39:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:54.096 11:39:14 -- nvmf/common.sh@46 -- # : 0 00:14:54.096 11:39:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:54.096 11:39:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:54.096 11:39:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:54.096 11:39:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:54.096 11:39:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:54.096 11:39:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:54.096 11:39:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:54.096 11:39:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:54.096 11:39:14 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:54.096 11:39:14 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:54.096 11:39:14 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:14:54.096 11:39:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:54.096 11:39:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:54.096 11:39:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:54.096 11:39:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:54.096 11:39:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:54.096 11:39:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:54.096 11:39:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:54.096 11:39:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:54.096 11:39:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:54.096 11:39:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:54.096 11:39:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:54.096 11:39:14 -- common/autotest_common.sh@10 -- # set +x 00:14:56.628 11:39:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:56.628 11:39:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:56.628 11:39:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:56.628 11:39:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:56.628 11:39:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:56.628 11:39:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:56.628 11:39:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:56.628 11:39:16 -- nvmf/common.sh@294 -- # net_devs=() 00:14:56.628 11:39:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:56.628 11:39:16 -- nvmf/common.sh@295 -- # e810=() 00:14:56.628 11:39:16 -- nvmf/common.sh@295 -- # local -ga e810 00:14:56.628 11:39:16 -- nvmf/common.sh@296 -- # x722=() 00:14:56.628 11:39:16 -- nvmf/common.sh@296 -- # local -ga x722 00:14:56.628 11:39:16 -- nvmf/common.sh@297 -- # mlx=() 00:14:56.628 11:39:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:56.628 11:39:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:56.628 11:39:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:56.628 11:39:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:56.628 11:39:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:56.628 11:39:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:56.628 11:39:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:56.628 11:39:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:56.628 11:39:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:56.628 11:39:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:56.628 11:39:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:56.628 11:39:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:56.628 11:39:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:56.628 11:39:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:56.628 11:39:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:56.628 11:39:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:56.628 11:39:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:56.628 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:56.628 11:39:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:56.628 11:39:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:56.628 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:56.628 11:39:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:56.628 11:39:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:56.628 11:39:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:56.628 11:39:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:56.628 11:39:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:56.628 11:39:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:56.628 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:56.628 11:39:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:56.628 11:39:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:56.628 11:39:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:56.628 11:39:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:56.628 11:39:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:56.628 11:39:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:56.628 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:56.628 11:39:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:56.628 11:39:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:56.628 11:39:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:56.628 11:39:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:56.628 11:39:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:56.628 11:39:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:56.628 11:39:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:56.628 11:39:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:56.628 11:39:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:56.628 11:39:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:56.629 11:39:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:56.629 11:39:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:56.629 11:39:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:56.629 11:39:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:56.629 11:39:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:56.629 11:39:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:56.629 11:39:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:56.629 11:39:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:56.629 11:39:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:56.629 11:39:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:56.629 11:39:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:56.629 11:39:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:56.629 11:39:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:56.629 11:39:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:56.629 11:39:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:56.629 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:56.629 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:14:56.629 00:14:56.629 --- 10.0.0.2 ping statistics --- 00:14:56.629 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:56.629 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:14:56.629 11:39:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:56.629 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:56.629 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:14:56.629 00:14:56.629 --- 10.0.0.1 ping statistics --- 00:14:56.629 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:56.629 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:14:56.629 11:39:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:56.629 11:39:16 -- nvmf/common.sh@410 -- # return 0 00:14:56.629 11:39:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:56.629 11:39:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:56.629 11:39:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:56.629 11:39:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:56.629 11:39:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:56.629 11:39:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:56.629 11:39:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:14:56.629 11:39:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:56.629 11:39:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:56.629 11:39:16 -- common/autotest_common.sh@10 -- # set +x 00:14:56.629 11:39:16 -- nvmf/common.sh@469 -- # nvmfpid=3796844 00:14:56.629 11:39:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:14:56.629 11:39:16 -- nvmf/common.sh@470 -- # waitforlisten 3796844 00:14:56.629 11:39:16 -- common/autotest_common.sh@829 -- # '[' -z 3796844 ']' 00:14:56.629 11:39:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:56.629 11:39:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:56.629 11:39:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:56.629 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:56.629 11:39:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:56.629 11:39:16 -- common/autotest_common.sh@10 -- # set +x 00:14:56.629 [2024-11-28 11:39:16.261788] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:56.629 [2024-11-28 11:39:16.261898] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:56.629 EAL: No free 2048 kB hugepages reported on node 1 00:14:56.629 [2024-11-28 11:39:16.326173] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:56.629 [2024-11-28 11:39:16.438471] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:56.629 [2024-11-28 11:39:16.438659] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:56.629 [2024-11-28 11:39:16.438677] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:56.629 [2024-11-28 11:39:16.438689] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:56.629 [2024-11-28 11:39:16.438745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:56.629 [2024-11-28 11:39:16.438807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:56.629 [2024-11-28 11:39:16.438882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:56.629 [2024-11-28 11:39:16.438885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:56.629 11:39:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:56.629 11:39:16 -- common/autotest_common.sh@862 -- # return 0 00:14:56.629 11:39:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:56.629 11:39:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:56.629 11:39:16 -- common/autotest_common.sh@10 -- # set +x 00:14:56.629 11:39:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:14:56.629 11:39:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.629 11:39:16 -- common/autotest_common.sh@10 -- # set +x 00:14:56.629 11:39:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:14:56.629 11:39:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.629 11:39:16 -- common/autotest_common.sh@10 -- # set +x 00:14:56.629 11:39:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:56.629 11:39:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.629 11:39:16 -- common/autotest_common.sh@10 -- # set +x 00:14:56.629 [2024-11-28 11:39:16.588191] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:56.629 11:39:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:56.629 11:39:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.629 11:39:16 -- common/autotest_common.sh@10 -- # set +x 00:14:56.629 Malloc0 00:14:56.629 11:39:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:56.629 11:39:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.629 11:39:16 -- common/autotest_common.sh@10 -- # set +x 00:14:56.629 11:39:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:56.629 11:39:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.629 11:39:16 -- common/autotest_common.sh@10 -- # set +x 00:14:56.629 11:39:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:56.629 11:39:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.629 11:39:16 -- common/autotest_common.sh@10 -- # set +x 00:14:56.629 [2024-11-28 11:39:16.648085] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:56.629 11:39:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3796874 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@30 -- # READ_PID=3796876 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:14:56.629 11:39:16 -- nvmf/common.sh@520 -- # config=() 00:14:56.629 11:39:16 -- nvmf/common.sh@520 -- # local subsystem config 00:14:56.629 11:39:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:56.629 11:39:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:56.629 { 00:14:56.629 "params": { 00:14:56.629 "name": "Nvme$subsystem", 00:14:56.629 "trtype": "$TEST_TRANSPORT", 00:14:56.629 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:56.629 "adrfam": "ipv4", 00:14:56.629 "trsvcid": "$NVMF_PORT", 00:14:56.629 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:56.629 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:56.629 "hdgst": ${hdgst:-false}, 00:14:56.629 "ddgst": ${ddgst:-false} 00:14:56.629 }, 00:14:56.629 "method": "bdev_nvme_attach_controller" 00:14:56.629 } 00:14:56.629 EOF 00:14:56.629 )") 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3796878 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:14:56.629 11:39:16 -- nvmf/common.sh@520 -- # config=() 00:14:56.629 11:39:16 -- nvmf/common.sh@520 -- # local subsystem config 00:14:56.629 11:39:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:56.629 11:39:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:56.629 { 00:14:56.629 "params": { 00:14:56.629 "name": "Nvme$subsystem", 00:14:56.629 "trtype": "$TEST_TRANSPORT", 00:14:56.629 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:56.629 "adrfam": "ipv4", 00:14:56.629 "trsvcid": "$NVMF_PORT", 00:14:56.629 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:56.629 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:56.629 "hdgst": ${hdgst:-false}, 00:14:56.629 "ddgst": ${ddgst:-false} 00:14:56.629 }, 00:14:56.629 "method": "bdev_nvme_attach_controller" 00:14:56.629 } 00:14:56.629 EOF 00:14:56.629 )") 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3796881 00:14:56.629 11:39:16 -- target/bdev_io_wait.sh@35 -- # sync 00:14:56.629 11:39:16 -- nvmf/common.sh@520 -- # config=() 00:14:56.629 11:39:16 -- nvmf/common.sh@542 -- # cat 00:14:56.629 11:39:16 -- nvmf/common.sh@520 -- # local subsystem config 00:14:56.630 11:39:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:56.630 11:39:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:56.630 { 00:14:56.630 "params": { 00:14:56.630 "name": "Nvme$subsystem", 00:14:56.630 "trtype": "$TEST_TRANSPORT", 00:14:56.630 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:56.630 "adrfam": "ipv4", 00:14:56.630 "trsvcid": "$NVMF_PORT", 00:14:56.630 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:56.630 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:56.630 "hdgst": ${hdgst:-false}, 00:14:56.630 "ddgst": ${ddgst:-false} 00:14:56.630 }, 00:14:56.630 "method": "bdev_nvme_attach_controller" 00:14:56.630 } 00:14:56.630 EOF 00:14:56.630 )") 00:14:56.630 11:39:16 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:14:56.630 11:39:16 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:14:56.630 11:39:16 -- nvmf/common.sh@520 -- # config=() 00:14:56.630 11:39:16 -- nvmf/common.sh@542 -- # cat 00:14:56.630 11:39:16 -- nvmf/common.sh@520 -- # local subsystem config 00:14:56.630 11:39:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:56.630 11:39:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:56.630 { 00:14:56.630 "params": { 00:14:56.630 "name": "Nvme$subsystem", 00:14:56.630 "trtype": "$TEST_TRANSPORT", 00:14:56.630 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:56.630 "adrfam": "ipv4", 00:14:56.630 "trsvcid": "$NVMF_PORT", 00:14:56.630 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:56.630 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:56.630 "hdgst": ${hdgst:-false}, 00:14:56.630 "ddgst": ${ddgst:-false} 00:14:56.630 }, 00:14:56.630 "method": "bdev_nvme_attach_controller" 00:14:56.630 } 00:14:56.630 EOF 00:14:56.630 )") 00:14:56.630 11:39:16 -- nvmf/common.sh@542 -- # cat 00:14:56.630 11:39:16 -- target/bdev_io_wait.sh@37 -- # wait 3796874 00:14:56.630 11:39:16 -- nvmf/common.sh@542 -- # cat 00:14:56.630 11:39:16 -- nvmf/common.sh@544 -- # jq . 00:14:56.630 11:39:16 -- nvmf/common.sh@544 -- # jq . 00:14:56.630 11:39:16 -- nvmf/common.sh@544 -- # jq . 00:14:56.630 11:39:16 -- nvmf/common.sh@545 -- # IFS=, 00:14:56.630 11:39:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:56.630 "params": { 00:14:56.630 "name": "Nvme1", 00:14:56.630 "trtype": "tcp", 00:14:56.630 "traddr": "10.0.0.2", 00:14:56.630 "adrfam": "ipv4", 00:14:56.630 "trsvcid": "4420", 00:14:56.630 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:56.630 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:56.630 "hdgst": false, 00:14:56.630 "ddgst": false 00:14:56.630 }, 00:14:56.630 "method": "bdev_nvme_attach_controller" 00:14:56.630 }' 00:14:56.630 11:39:16 -- nvmf/common.sh@545 -- # IFS=, 00:14:56.630 11:39:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:56.630 "params": { 00:14:56.630 "name": "Nvme1", 00:14:56.630 "trtype": "tcp", 00:14:56.630 "traddr": "10.0.0.2", 00:14:56.630 "adrfam": "ipv4", 00:14:56.630 "trsvcid": "4420", 00:14:56.630 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:56.630 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:56.630 "hdgst": false, 00:14:56.630 "ddgst": false 00:14:56.630 }, 00:14:56.630 "method": "bdev_nvme_attach_controller" 00:14:56.630 }' 00:14:56.630 11:39:16 -- nvmf/common.sh@544 -- # jq . 00:14:56.630 11:39:16 -- nvmf/common.sh@545 -- # IFS=, 00:14:56.630 11:39:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:56.630 "params": { 00:14:56.630 "name": "Nvme1", 00:14:56.630 "trtype": "tcp", 00:14:56.630 "traddr": "10.0.0.2", 00:14:56.630 "adrfam": "ipv4", 00:14:56.630 "trsvcid": "4420", 00:14:56.630 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:56.630 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:56.630 "hdgst": false, 00:14:56.630 "ddgst": false 00:14:56.630 }, 00:14:56.630 "method": "bdev_nvme_attach_controller" 00:14:56.630 }' 00:14:56.630 11:39:16 -- nvmf/common.sh@545 -- # IFS=, 00:14:56.630 11:39:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:56.630 "params": { 00:14:56.630 "name": "Nvme1", 00:14:56.630 "trtype": "tcp", 00:14:56.630 "traddr": "10.0.0.2", 00:14:56.630 "adrfam": "ipv4", 00:14:56.630 "trsvcid": "4420", 00:14:56.630 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:56.630 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:56.630 "hdgst": false, 00:14:56.630 "ddgst": false 00:14:56.630 }, 00:14:56.630 "method": "bdev_nvme_attach_controller" 00:14:56.630 }' 00:14:56.888 [2024-11-28 11:39:16.690685] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:56.888 [2024-11-28 11:39:16.690685] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:56.888 [2024-11-28 11:39:16.690689] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:56.888 [2024-11-28 11:39:16.690772] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-28 11:39:16.690772] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-28 11:39:16.690773] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:14:56.888 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:14:56.888 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:14:56.888 [2024-11-28 11:39:16.691021] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:56.888 [2024-11-28 11:39:16.691087] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:14:56.888 EAL: No free 2048 kB hugepages reported on node 1 00:14:56.888 EAL: No free 2048 kB hugepages reported on node 1 00:14:56.888 [2024-11-28 11:39:16.864773] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:56.888 EAL: No free 2048 kB hugepages reported on node 1 00:14:57.146 [2024-11-28 11:39:16.958958] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:14:57.146 [2024-11-28 11:39:16.967300] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:57.146 EAL: No free 2048 kB hugepages reported on node 1 00:14:57.146 [2024-11-28 11:39:17.062172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:14:57.146 [2024-11-28 11:39:17.063900] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:57.146 [2024-11-28 11:39:17.139578] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:57.146 [2024-11-28 11:39:17.164062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:57.404 [2024-11-28 11:39:17.231437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:14:57.404 Running I/O for 1 seconds... 00:14:57.404 Running I/O for 1 seconds... 00:14:57.404 Running I/O for 1 seconds... 00:14:57.404 Running I/O for 1 seconds... 00:14:58.339 00:14:58.339 Latency(us) 00:14:58.339 [2024-11-28T10:39:18.395Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:58.339 [2024-11-28T10:39:18.395Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:14:58.339 Nvme1n1 : 1.00 173265.10 676.82 0.00 0.00 735.96 291.27 1049.79 00:14:58.339 [2024-11-28T10:39:18.395Z] =================================================================================================================== 00:14:58.339 [2024-11-28T10:39:18.395Z] Total : 173265.10 676.82 0.00 0.00 735.96 291.27 1049.79 00:14:58.598 00:14:58.598 Latency(us) 00:14:58.598 [2024-11-28T10:39:18.654Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:58.598 [2024-11-28T10:39:18.654Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:14:58.598 Nvme1n1 : 1.01 9314.53 36.38 0.00 0.00 13675.34 8883.77 23398.78 00:14:58.598 [2024-11-28T10:39:18.654Z] =================================================================================================================== 00:14:58.598 [2024-11-28T10:39:18.654Z] Total : 9314.53 36.38 0.00 0.00 13675.34 8883.77 23398.78 00:14:58.598 00:14:58.598 Latency(us) 00:14:58.598 [2024-11-28T10:39:18.654Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:58.598 [2024-11-28T10:39:18.654Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:14:58.598 Nvme1n1 : 1.01 11688.54 45.66 0.00 0.00 10917.08 5121.52 22039.51 00:14:58.598 [2024-11-28T10:39:18.654Z] =================================================================================================================== 00:14:58.598 [2024-11-28T10:39:18.654Z] Total : 11688.54 45.66 0.00 0.00 10917.08 5121.52 22039.51 00:14:58.598 00:14:58.598 Latency(us) 00:14:58.598 [2024-11-28T10:39:18.654Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:58.598 [2024-11-28T10:39:18.654Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:14:58.598 Nvme1n1 : 1.01 8162.94 31.89 0.00 0.00 15616.59 6893.42 29709.65 00:14:58.598 [2024-11-28T10:39:18.654Z] =================================================================================================================== 00:14:58.598 [2024-11-28T10:39:18.654Z] Total : 8162.94 31.89 0.00 0.00 15616.59 6893.42 29709.65 00:14:58.856 11:39:18 -- target/bdev_io_wait.sh@38 -- # wait 3796876 00:14:58.856 11:39:18 -- target/bdev_io_wait.sh@39 -- # wait 3796878 00:14:58.856 11:39:18 -- target/bdev_io_wait.sh@40 -- # wait 3796881 00:14:58.856 11:39:18 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:58.856 11:39:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.856 11:39:18 -- common/autotest_common.sh@10 -- # set +x 00:14:58.856 11:39:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.856 11:39:18 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:14:58.856 11:39:18 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:14:58.856 11:39:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:58.856 11:39:18 -- nvmf/common.sh@116 -- # sync 00:14:58.856 11:39:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:58.856 11:39:18 -- nvmf/common.sh@119 -- # set +e 00:14:58.856 11:39:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:58.856 11:39:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:58.856 rmmod nvme_tcp 00:14:58.856 rmmod nvme_fabrics 00:14:58.856 rmmod nvme_keyring 00:14:58.856 11:39:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:58.856 11:39:18 -- nvmf/common.sh@123 -- # set -e 00:14:58.856 11:39:18 -- nvmf/common.sh@124 -- # return 0 00:14:58.856 11:39:18 -- nvmf/common.sh@477 -- # '[' -n 3796844 ']' 00:14:58.856 11:39:18 -- nvmf/common.sh@478 -- # killprocess 3796844 00:14:58.856 11:39:18 -- common/autotest_common.sh@936 -- # '[' -z 3796844 ']' 00:14:58.856 11:39:18 -- common/autotest_common.sh@940 -- # kill -0 3796844 00:14:58.856 11:39:18 -- common/autotest_common.sh@941 -- # uname 00:14:58.856 11:39:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:58.856 11:39:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3796844 00:14:59.114 11:39:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:59.114 11:39:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:59.114 11:39:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3796844' 00:14:59.114 killing process with pid 3796844 00:14:59.114 11:39:18 -- common/autotest_common.sh@955 -- # kill 3796844 00:14:59.114 11:39:18 -- common/autotest_common.sh@960 -- # wait 3796844 00:14:59.373 11:39:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:59.373 11:39:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:59.373 11:39:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:59.373 11:39:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:59.373 11:39:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:59.373 11:39:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:59.373 11:39:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:59.373 11:39:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:01.278 11:39:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:01.278 00:15:01.278 real 0m7.365s 00:15:01.278 user 0m16.883s 00:15:01.278 sys 0m3.713s 00:15:01.278 11:39:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:01.278 11:39:21 -- common/autotest_common.sh@10 -- # set +x 00:15:01.278 ************************************ 00:15:01.278 END TEST nvmf_bdev_io_wait 00:15:01.278 ************************************ 00:15:01.278 11:39:21 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:01.278 11:39:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:01.278 11:39:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:01.278 11:39:21 -- common/autotest_common.sh@10 -- # set +x 00:15:01.278 ************************************ 00:15:01.278 START TEST nvmf_queue_depth 00:15:01.278 ************************************ 00:15:01.278 11:39:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:01.278 * Looking for test storage... 00:15:01.278 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:01.278 11:39:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:01.278 11:39:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:01.278 11:39:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:01.537 11:39:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:01.538 11:39:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:01.538 11:39:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:01.538 11:39:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:01.538 11:39:21 -- scripts/common.sh@335 -- # IFS=.-: 00:15:01.538 11:39:21 -- scripts/common.sh@335 -- # read -ra ver1 00:15:01.538 11:39:21 -- scripts/common.sh@336 -- # IFS=.-: 00:15:01.538 11:39:21 -- scripts/common.sh@336 -- # read -ra ver2 00:15:01.538 11:39:21 -- scripts/common.sh@337 -- # local 'op=<' 00:15:01.538 11:39:21 -- scripts/common.sh@339 -- # ver1_l=2 00:15:01.538 11:39:21 -- scripts/common.sh@340 -- # ver2_l=1 00:15:01.538 11:39:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:01.538 11:39:21 -- scripts/common.sh@343 -- # case "$op" in 00:15:01.538 11:39:21 -- scripts/common.sh@344 -- # : 1 00:15:01.538 11:39:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:01.538 11:39:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:01.538 11:39:21 -- scripts/common.sh@364 -- # decimal 1 00:15:01.538 11:39:21 -- scripts/common.sh@352 -- # local d=1 00:15:01.538 11:39:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:01.538 11:39:21 -- scripts/common.sh@354 -- # echo 1 00:15:01.538 11:39:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:01.538 11:39:21 -- scripts/common.sh@365 -- # decimal 2 00:15:01.538 11:39:21 -- scripts/common.sh@352 -- # local d=2 00:15:01.538 11:39:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:01.538 11:39:21 -- scripts/common.sh@354 -- # echo 2 00:15:01.538 11:39:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:01.538 11:39:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:01.538 11:39:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:01.538 11:39:21 -- scripts/common.sh@367 -- # return 0 00:15:01.538 11:39:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:01.538 11:39:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:01.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:01.538 --rc genhtml_branch_coverage=1 00:15:01.538 --rc genhtml_function_coverage=1 00:15:01.538 --rc genhtml_legend=1 00:15:01.538 --rc geninfo_all_blocks=1 00:15:01.538 --rc geninfo_unexecuted_blocks=1 00:15:01.538 00:15:01.538 ' 00:15:01.538 11:39:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:01.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:01.538 --rc genhtml_branch_coverage=1 00:15:01.538 --rc genhtml_function_coverage=1 00:15:01.538 --rc genhtml_legend=1 00:15:01.538 --rc geninfo_all_blocks=1 00:15:01.538 --rc geninfo_unexecuted_blocks=1 00:15:01.538 00:15:01.538 ' 00:15:01.538 11:39:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:01.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:01.538 --rc genhtml_branch_coverage=1 00:15:01.538 --rc genhtml_function_coverage=1 00:15:01.538 --rc genhtml_legend=1 00:15:01.538 --rc geninfo_all_blocks=1 00:15:01.538 --rc geninfo_unexecuted_blocks=1 00:15:01.538 00:15:01.538 ' 00:15:01.538 11:39:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:01.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:01.538 --rc genhtml_branch_coverage=1 00:15:01.538 --rc genhtml_function_coverage=1 00:15:01.538 --rc genhtml_legend=1 00:15:01.538 --rc geninfo_all_blocks=1 00:15:01.538 --rc geninfo_unexecuted_blocks=1 00:15:01.538 00:15:01.538 ' 00:15:01.538 11:39:21 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:01.538 11:39:21 -- nvmf/common.sh@7 -- # uname -s 00:15:01.538 11:39:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:01.538 11:39:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:01.538 11:39:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:01.538 11:39:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:01.538 11:39:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:01.538 11:39:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:01.538 11:39:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:01.538 11:39:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:01.538 11:39:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:01.538 11:39:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:01.538 11:39:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:01.538 11:39:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:01.538 11:39:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:01.538 11:39:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:01.538 11:39:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:01.538 11:39:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:01.538 11:39:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:01.538 11:39:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:01.538 11:39:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:01.538 11:39:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:01.538 11:39:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:01.538 11:39:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:01.538 11:39:21 -- paths/export.sh@5 -- # export PATH 00:15:01.538 11:39:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:01.538 11:39:21 -- nvmf/common.sh@46 -- # : 0 00:15:01.538 11:39:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:01.538 11:39:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:01.538 11:39:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:01.538 11:39:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:01.538 11:39:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:01.538 11:39:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:01.538 11:39:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:01.538 11:39:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:01.538 11:39:21 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:01.539 11:39:21 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:01.539 11:39:21 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:01.539 11:39:21 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:01.539 11:39:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:01.539 11:39:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:01.539 11:39:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:01.539 11:39:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:01.539 11:39:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:01.539 11:39:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:01.539 11:39:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:01.539 11:39:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:01.539 11:39:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:01.539 11:39:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:01.539 11:39:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:01.539 11:39:21 -- common/autotest_common.sh@10 -- # set +x 00:15:03.442 11:39:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:03.442 11:39:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:03.442 11:39:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:03.442 11:39:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:03.442 11:39:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:03.442 11:39:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:03.442 11:39:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:03.442 11:39:23 -- nvmf/common.sh@294 -- # net_devs=() 00:15:03.442 11:39:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:03.442 11:39:23 -- nvmf/common.sh@295 -- # e810=() 00:15:03.442 11:39:23 -- nvmf/common.sh@295 -- # local -ga e810 00:15:03.442 11:39:23 -- nvmf/common.sh@296 -- # x722=() 00:15:03.442 11:39:23 -- nvmf/common.sh@296 -- # local -ga x722 00:15:03.442 11:39:23 -- nvmf/common.sh@297 -- # mlx=() 00:15:03.442 11:39:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:03.442 11:39:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:03.442 11:39:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:03.442 11:39:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:03.442 11:39:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:03.442 11:39:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:03.442 11:39:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:03.442 11:39:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:03.442 11:39:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:03.442 11:39:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:03.442 11:39:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:03.442 11:39:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:03.442 11:39:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:03.442 11:39:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:03.442 11:39:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:03.442 11:39:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:03.442 11:39:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:03.442 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:03.442 11:39:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:03.442 11:39:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:03.442 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:03.442 11:39:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:03.442 11:39:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:03.442 11:39:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:03.442 11:39:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:03.442 11:39:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:03.442 11:39:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:03.442 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:03.442 11:39:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:03.442 11:39:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:03.442 11:39:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:03.442 11:39:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:03.442 11:39:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:03.442 11:39:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:03.442 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:03.442 11:39:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:03.442 11:39:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:03.442 11:39:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:03.442 11:39:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:03.442 11:39:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:03.443 11:39:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:03.443 11:39:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:03.443 11:39:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:03.443 11:39:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:03.443 11:39:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:03.443 11:39:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:03.443 11:39:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:03.443 11:39:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:03.443 11:39:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:03.443 11:39:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:03.443 11:39:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:03.443 11:39:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:03.443 11:39:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:03.443 11:39:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:03.701 11:39:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:03.701 11:39:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:03.701 11:39:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:03.701 11:39:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:03.701 11:39:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:03.701 11:39:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:03.701 11:39:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:03.701 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:03.701 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.381 ms 00:15:03.701 00:15:03.701 --- 10.0.0.2 ping statistics --- 00:15:03.701 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:03.701 rtt min/avg/max/mdev = 0.381/0.381/0.381/0.000 ms 00:15:03.701 11:39:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:03.701 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:03.701 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.162 ms 00:15:03.701 00:15:03.701 --- 10.0.0.1 ping statistics --- 00:15:03.701 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:03.701 rtt min/avg/max/mdev = 0.162/0.162/0.162/0.000 ms 00:15:03.701 11:39:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:03.701 11:39:23 -- nvmf/common.sh@410 -- # return 0 00:15:03.701 11:39:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:03.701 11:39:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:03.701 11:39:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:03.701 11:39:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:03.702 11:39:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:03.702 11:39:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:03.702 11:39:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:03.702 11:39:23 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:03.702 11:39:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:03.702 11:39:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:03.702 11:39:23 -- common/autotest_common.sh@10 -- # set +x 00:15:03.702 11:39:23 -- nvmf/common.sh@469 -- # nvmfpid=3799120 00:15:03.702 11:39:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:03.702 11:39:23 -- nvmf/common.sh@470 -- # waitforlisten 3799120 00:15:03.702 11:39:23 -- common/autotest_common.sh@829 -- # '[' -z 3799120 ']' 00:15:03.702 11:39:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:03.702 11:39:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:03.702 11:39:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:03.702 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:03.702 11:39:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:03.702 11:39:23 -- common/autotest_common.sh@10 -- # set +x 00:15:03.702 [2024-11-28 11:39:23.669642] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:03.702 [2024-11-28 11:39:23.669737] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:03.702 EAL: No free 2048 kB hugepages reported on node 1 00:15:03.702 [2024-11-28 11:39:23.740707] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:03.960 [2024-11-28 11:39:23.851824] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:03.960 [2024-11-28 11:39:23.851989] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:03.960 [2024-11-28 11:39:23.852005] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:03.960 [2024-11-28 11:39:23.852017] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:03.960 [2024-11-28 11:39:23.852046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:04.895 11:39:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:04.895 11:39:24 -- common/autotest_common.sh@862 -- # return 0 00:15:04.895 11:39:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:04.895 11:39:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:04.895 11:39:24 -- common/autotest_common.sh@10 -- # set +x 00:15:04.895 11:39:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:04.895 11:39:24 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:04.895 11:39:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.895 11:39:24 -- common/autotest_common.sh@10 -- # set +x 00:15:04.895 [2024-11-28 11:39:24.674829] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:04.895 11:39:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.895 11:39:24 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:04.895 11:39:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.895 11:39:24 -- common/autotest_common.sh@10 -- # set +x 00:15:04.895 Malloc0 00:15:04.895 11:39:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.895 11:39:24 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:04.895 11:39:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.895 11:39:24 -- common/autotest_common.sh@10 -- # set +x 00:15:04.895 11:39:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.895 11:39:24 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:04.895 11:39:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.895 11:39:24 -- common/autotest_common.sh@10 -- # set +x 00:15:04.895 11:39:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.895 11:39:24 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:04.895 11:39:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.895 11:39:24 -- common/autotest_common.sh@10 -- # set +x 00:15:04.895 [2024-11-28 11:39:24.733248] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:04.895 11:39:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.895 11:39:24 -- target/queue_depth.sh@30 -- # bdevperf_pid=3799279 00:15:04.895 11:39:24 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:04.895 11:39:24 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:04.895 11:39:24 -- target/queue_depth.sh@33 -- # waitforlisten 3799279 /var/tmp/bdevperf.sock 00:15:04.895 11:39:24 -- common/autotest_common.sh@829 -- # '[' -z 3799279 ']' 00:15:04.895 11:39:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:04.895 11:39:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:04.895 11:39:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:04.895 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:04.895 11:39:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:04.895 11:39:24 -- common/autotest_common.sh@10 -- # set +x 00:15:04.895 [2024-11-28 11:39:24.775594] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:04.895 [2024-11-28 11:39:24.775668] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3799279 ] 00:15:04.895 EAL: No free 2048 kB hugepages reported on node 1 00:15:04.895 [2024-11-28 11:39:24.838135] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:05.154 [2024-11-28 11:39:24.952383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:05.719 11:39:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:05.719 11:39:25 -- common/autotest_common.sh@862 -- # return 0 00:15:05.719 11:39:25 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:05.719 11:39:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.719 11:39:25 -- common/autotest_common.sh@10 -- # set +x 00:15:05.977 NVMe0n1 00:15:05.977 11:39:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.977 11:39:26 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:06.235 Running I/O for 10 seconds... 00:15:16.200 00:15:16.200 Latency(us) 00:15:16.200 [2024-11-28T10:39:36.256Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:16.200 [2024-11-28T10:39:36.256Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:16.200 Verification LBA range: start 0x0 length 0x4000 00:15:16.200 NVMe0n1 : 10.07 12387.87 48.39 0.00 0.00 82332.00 14951.92 62914.56 00:15:16.200 [2024-11-28T10:39:36.256Z] =================================================================================================================== 00:15:16.200 [2024-11-28T10:39:36.256Z] Total : 12387.87 48.39 0.00 0.00 82332.00 14951.92 62914.56 00:15:16.200 0 00:15:16.200 11:39:36 -- target/queue_depth.sh@39 -- # killprocess 3799279 00:15:16.200 11:39:36 -- common/autotest_common.sh@936 -- # '[' -z 3799279 ']' 00:15:16.200 11:39:36 -- common/autotest_common.sh@940 -- # kill -0 3799279 00:15:16.200 11:39:36 -- common/autotest_common.sh@941 -- # uname 00:15:16.458 11:39:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:16.458 11:39:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3799279 00:15:16.458 11:39:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:16.458 11:39:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:16.458 11:39:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3799279' 00:15:16.458 killing process with pid 3799279 00:15:16.458 11:39:36 -- common/autotest_common.sh@955 -- # kill 3799279 00:15:16.458 Received shutdown signal, test time was about 10.000000 seconds 00:15:16.458 00:15:16.458 Latency(us) 00:15:16.458 [2024-11-28T10:39:36.514Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:16.458 [2024-11-28T10:39:36.514Z] =================================================================================================================== 00:15:16.458 [2024-11-28T10:39:36.514Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:16.458 11:39:36 -- common/autotest_common.sh@960 -- # wait 3799279 00:15:16.717 11:39:36 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:16.717 11:39:36 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:16.717 11:39:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:16.717 11:39:36 -- nvmf/common.sh@116 -- # sync 00:15:16.717 11:39:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:16.717 11:39:36 -- nvmf/common.sh@119 -- # set +e 00:15:16.717 11:39:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:16.717 11:39:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:16.717 rmmod nvme_tcp 00:15:16.717 rmmod nvme_fabrics 00:15:16.717 rmmod nvme_keyring 00:15:16.717 11:39:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:16.717 11:39:36 -- nvmf/common.sh@123 -- # set -e 00:15:16.717 11:39:36 -- nvmf/common.sh@124 -- # return 0 00:15:16.717 11:39:36 -- nvmf/common.sh@477 -- # '[' -n 3799120 ']' 00:15:16.717 11:39:36 -- nvmf/common.sh@478 -- # killprocess 3799120 00:15:16.717 11:39:36 -- common/autotest_common.sh@936 -- # '[' -z 3799120 ']' 00:15:16.717 11:39:36 -- common/autotest_common.sh@940 -- # kill -0 3799120 00:15:16.717 11:39:36 -- common/autotest_common.sh@941 -- # uname 00:15:16.717 11:39:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:16.717 11:39:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3799120 00:15:16.717 11:39:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:16.717 11:39:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:16.717 11:39:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3799120' 00:15:16.717 killing process with pid 3799120 00:15:16.717 11:39:36 -- common/autotest_common.sh@955 -- # kill 3799120 00:15:16.717 11:39:36 -- common/autotest_common.sh@960 -- # wait 3799120 00:15:16.976 11:39:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:16.976 11:39:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:16.976 11:39:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:16.976 11:39:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:16.976 11:39:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:16.976 11:39:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:16.976 11:39:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:16.976 11:39:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:19.513 11:39:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:19.513 00:15:19.513 real 0m17.696s 00:15:19.513 user 0m25.499s 00:15:19.513 sys 0m3.124s 00:15:19.513 11:39:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:19.513 11:39:38 -- common/autotest_common.sh@10 -- # set +x 00:15:19.513 ************************************ 00:15:19.513 END TEST nvmf_queue_depth 00:15:19.513 ************************************ 00:15:19.513 11:39:38 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:19.513 11:39:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:19.513 11:39:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:19.513 11:39:38 -- common/autotest_common.sh@10 -- # set +x 00:15:19.513 ************************************ 00:15:19.513 START TEST nvmf_multipath 00:15:19.513 ************************************ 00:15:19.513 11:39:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:19.513 * Looking for test storage... 00:15:19.513 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:19.513 11:39:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:19.513 11:39:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:19.513 11:39:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:19.513 11:39:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:19.513 11:39:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:19.513 11:39:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:19.513 11:39:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:19.513 11:39:39 -- scripts/common.sh@335 -- # IFS=.-: 00:15:19.513 11:39:39 -- scripts/common.sh@335 -- # read -ra ver1 00:15:19.513 11:39:39 -- scripts/common.sh@336 -- # IFS=.-: 00:15:19.513 11:39:39 -- scripts/common.sh@336 -- # read -ra ver2 00:15:19.513 11:39:39 -- scripts/common.sh@337 -- # local 'op=<' 00:15:19.513 11:39:39 -- scripts/common.sh@339 -- # ver1_l=2 00:15:19.513 11:39:39 -- scripts/common.sh@340 -- # ver2_l=1 00:15:19.513 11:39:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:19.513 11:39:39 -- scripts/common.sh@343 -- # case "$op" in 00:15:19.513 11:39:39 -- scripts/common.sh@344 -- # : 1 00:15:19.513 11:39:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:19.513 11:39:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:19.513 11:39:39 -- scripts/common.sh@364 -- # decimal 1 00:15:19.513 11:39:39 -- scripts/common.sh@352 -- # local d=1 00:15:19.513 11:39:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:19.513 11:39:39 -- scripts/common.sh@354 -- # echo 1 00:15:19.513 11:39:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:19.513 11:39:39 -- scripts/common.sh@365 -- # decimal 2 00:15:19.513 11:39:39 -- scripts/common.sh@352 -- # local d=2 00:15:19.513 11:39:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:19.513 11:39:39 -- scripts/common.sh@354 -- # echo 2 00:15:19.513 11:39:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:19.513 11:39:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:19.513 11:39:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:19.513 11:39:39 -- scripts/common.sh@367 -- # return 0 00:15:19.513 11:39:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:19.513 11:39:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:19.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.513 --rc genhtml_branch_coverage=1 00:15:19.513 --rc genhtml_function_coverage=1 00:15:19.513 --rc genhtml_legend=1 00:15:19.513 --rc geninfo_all_blocks=1 00:15:19.513 --rc geninfo_unexecuted_blocks=1 00:15:19.513 00:15:19.513 ' 00:15:19.513 11:39:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:19.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.513 --rc genhtml_branch_coverage=1 00:15:19.513 --rc genhtml_function_coverage=1 00:15:19.513 --rc genhtml_legend=1 00:15:19.513 --rc geninfo_all_blocks=1 00:15:19.513 --rc geninfo_unexecuted_blocks=1 00:15:19.513 00:15:19.513 ' 00:15:19.513 11:39:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:19.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.513 --rc genhtml_branch_coverage=1 00:15:19.513 --rc genhtml_function_coverage=1 00:15:19.513 --rc genhtml_legend=1 00:15:19.513 --rc geninfo_all_blocks=1 00:15:19.513 --rc geninfo_unexecuted_blocks=1 00:15:19.513 00:15:19.513 ' 00:15:19.513 11:39:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:19.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.513 --rc genhtml_branch_coverage=1 00:15:19.513 --rc genhtml_function_coverage=1 00:15:19.513 --rc genhtml_legend=1 00:15:19.513 --rc geninfo_all_blocks=1 00:15:19.513 --rc geninfo_unexecuted_blocks=1 00:15:19.513 00:15:19.513 ' 00:15:19.513 11:39:39 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:19.513 11:39:39 -- nvmf/common.sh@7 -- # uname -s 00:15:19.513 11:39:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:19.513 11:39:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:19.513 11:39:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:19.513 11:39:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:19.513 11:39:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:19.513 11:39:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:19.513 11:39:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:19.513 11:39:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:19.513 11:39:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:19.513 11:39:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:19.513 11:39:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:19.513 11:39:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:19.513 11:39:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:19.513 11:39:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:19.513 11:39:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:19.513 11:39:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:19.513 11:39:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:19.513 11:39:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:19.513 11:39:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:19.513 11:39:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.513 11:39:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.514 11:39:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.514 11:39:39 -- paths/export.sh@5 -- # export PATH 00:15:19.514 11:39:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.514 11:39:39 -- nvmf/common.sh@46 -- # : 0 00:15:19.514 11:39:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:19.514 11:39:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:19.514 11:39:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:19.514 11:39:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:19.514 11:39:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:19.514 11:39:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:19.514 11:39:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:19.514 11:39:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:19.514 11:39:39 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:19.514 11:39:39 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:19.514 11:39:39 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:19.514 11:39:39 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:19.514 11:39:39 -- target/multipath.sh@43 -- # nvmftestinit 00:15:19.514 11:39:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:19.514 11:39:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:19.514 11:39:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:19.514 11:39:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:19.514 11:39:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:19.514 11:39:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:19.514 11:39:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:19.514 11:39:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:19.514 11:39:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:19.514 11:39:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:19.514 11:39:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:19.514 11:39:39 -- common/autotest_common.sh@10 -- # set +x 00:15:21.487 11:39:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:21.487 11:39:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:21.487 11:39:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:21.487 11:39:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:21.487 11:39:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:21.487 11:39:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:21.487 11:39:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:21.487 11:39:41 -- nvmf/common.sh@294 -- # net_devs=() 00:15:21.487 11:39:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:21.487 11:39:41 -- nvmf/common.sh@295 -- # e810=() 00:15:21.487 11:39:41 -- nvmf/common.sh@295 -- # local -ga e810 00:15:21.487 11:39:41 -- nvmf/common.sh@296 -- # x722=() 00:15:21.487 11:39:41 -- nvmf/common.sh@296 -- # local -ga x722 00:15:21.487 11:39:41 -- nvmf/common.sh@297 -- # mlx=() 00:15:21.487 11:39:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:21.487 11:39:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:21.487 11:39:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:21.487 11:39:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:21.487 11:39:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:21.487 11:39:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:21.487 11:39:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:21.487 11:39:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:21.487 11:39:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:21.487 11:39:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:21.487 11:39:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:21.487 11:39:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:21.487 11:39:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:21.487 11:39:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:21.487 11:39:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:21.487 11:39:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:21.487 11:39:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:21.487 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:21.487 11:39:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:21.487 11:39:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:21.487 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:21.487 11:39:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:21.487 11:39:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:21.487 11:39:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:21.487 11:39:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:21.487 11:39:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:21.487 11:39:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:21.487 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:21.487 11:39:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:21.487 11:39:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:21.487 11:39:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:21.487 11:39:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:21.487 11:39:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:21.487 11:39:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:21.487 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:21.487 11:39:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:21.487 11:39:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:21.487 11:39:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:21.487 11:39:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:21.487 11:39:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:21.487 11:39:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:21.487 11:39:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:21.487 11:39:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:21.487 11:39:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:21.487 11:39:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:21.487 11:39:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:21.487 11:39:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:21.487 11:39:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:21.487 11:39:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:21.487 11:39:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:21.487 11:39:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:21.487 11:39:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:21.487 11:39:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:21.487 11:39:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:21.487 11:39:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:21.487 11:39:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:21.487 11:39:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:21.487 11:39:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:21.487 11:39:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:21.487 11:39:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:21.487 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:21.487 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.384 ms 00:15:21.487 00:15:21.487 --- 10.0.0.2 ping statistics --- 00:15:21.487 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:21.487 rtt min/avg/max/mdev = 0.384/0.384/0.384/0.000 ms 00:15:21.487 11:39:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:21.487 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:21.487 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:15:21.487 00:15:21.487 --- 10.0.0.1 ping statistics --- 00:15:21.487 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:21.487 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:15:21.487 11:39:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:21.487 11:39:41 -- nvmf/common.sh@410 -- # return 0 00:15:21.487 11:39:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:21.487 11:39:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:21.488 11:39:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:21.488 11:39:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:21.488 11:39:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:21.488 11:39:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:21.488 11:39:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:21.488 11:39:41 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:21.488 11:39:41 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:21.488 only one NIC for nvmf test 00:15:21.488 11:39:41 -- target/multipath.sh@47 -- # nvmftestfini 00:15:21.488 11:39:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:21.488 11:39:41 -- nvmf/common.sh@116 -- # sync 00:15:21.488 11:39:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:21.488 11:39:41 -- nvmf/common.sh@119 -- # set +e 00:15:21.488 11:39:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:21.488 11:39:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:21.488 rmmod nvme_tcp 00:15:21.488 rmmod nvme_fabrics 00:15:21.488 rmmod nvme_keyring 00:15:21.488 11:39:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:21.488 11:39:41 -- nvmf/common.sh@123 -- # set -e 00:15:21.488 11:39:41 -- nvmf/common.sh@124 -- # return 0 00:15:21.488 11:39:41 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:21.488 11:39:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:21.488 11:39:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:21.488 11:39:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:21.488 11:39:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:21.488 11:39:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:21.488 11:39:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:21.488 11:39:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:21.488 11:39:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:24.022 11:39:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:24.022 11:39:43 -- target/multipath.sh@48 -- # exit 0 00:15:24.022 11:39:43 -- target/multipath.sh@1 -- # nvmftestfini 00:15:24.022 11:39:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:24.022 11:39:43 -- nvmf/common.sh@116 -- # sync 00:15:24.022 11:39:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:24.022 11:39:43 -- nvmf/common.sh@119 -- # set +e 00:15:24.022 11:39:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:24.022 11:39:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:24.022 11:39:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:24.022 11:39:43 -- nvmf/common.sh@123 -- # set -e 00:15:24.022 11:39:43 -- nvmf/common.sh@124 -- # return 0 00:15:24.022 11:39:43 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:24.022 11:39:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:24.022 11:39:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:24.022 11:39:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:24.022 11:39:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:24.022 11:39:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:24.022 11:39:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:24.022 11:39:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:24.022 11:39:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:24.022 11:39:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:24.022 00:15:24.022 real 0m4.545s 00:15:24.022 user 0m0.965s 00:15:24.022 sys 0m1.568s 00:15:24.022 11:39:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:24.022 11:39:43 -- common/autotest_common.sh@10 -- # set +x 00:15:24.022 ************************************ 00:15:24.022 END TEST nvmf_multipath 00:15:24.022 ************************************ 00:15:24.022 11:39:43 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:24.022 11:39:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:24.022 11:39:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:24.022 11:39:43 -- common/autotest_common.sh@10 -- # set +x 00:15:24.022 ************************************ 00:15:24.022 START TEST nvmf_zcopy 00:15:24.022 ************************************ 00:15:24.022 11:39:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:24.022 * Looking for test storage... 00:15:24.022 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:24.022 11:39:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:24.023 11:39:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:24.023 11:39:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:24.023 11:39:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:24.023 11:39:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:24.023 11:39:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:24.023 11:39:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:24.023 11:39:43 -- scripts/common.sh@335 -- # IFS=.-: 00:15:24.023 11:39:43 -- scripts/common.sh@335 -- # read -ra ver1 00:15:24.023 11:39:43 -- scripts/common.sh@336 -- # IFS=.-: 00:15:24.023 11:39:43 -- scripts/common.sh@336 -- # read -ra ver2 00:15:24.023 11:39:43 -- scripts/common.sh@337 -- # local 'op=<' 00:15:24.023 11:39:43 -- scripts/common.sh@339 -- # ver1_l=2 00:15:24.023 11:39:43 -- scripts/common.sh@340 -- # ver2_l=1 00:15:24.023 11:39:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:24.023 11:39:43 -- scripts/common.sh@343 -- # case "$op" in 00:15:24.023 11:39:43 -- scripts/common.sh@344 -- # : 1 00:15:24.023 11:39:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:24.023 11:39:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:24.023 11:39:43 -- scripts/common.sh@364 -- # decimal 1 00:15:24.023 11:39:43 -- scripts/common.sh@352 -- # local d=1 00:15:24.023 11:39:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:24.023 11:39:43 -- scripts/common.sh@354 -- # echo 1 00:15:24.023 11:39:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:24.023 11:39:43 -- scripts/common.sh@365 -- # decimal 2 00:15:24.023 11:39:43 -- scripts/common.sh@352 -- # local d=2 00:15:24.023 11:39:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:24.023 11:39:43 -- scripts/common.sh@354 -- # echo 2 00:15:24.023 11:39:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:24.023 11:39:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:24.023 11:39:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:24.023 11:39:43 -- scripts/common.sh@367 -- # return 0 00:15:24.023 11:39:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:24.023 11:39:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:24.023 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.023 --rc genhtml_branch_coverage=1 00:15:24.023 --rc genhtml_function_coverage=1 00:15:24.023 --rc genhtml_legend=1 00:15:24.023 --rc geninfo_all_blocks=1 00:15:24.023 --rc geninfo_unexecuted_blocks=1 00:15:24.023 00:15:24.023 ' 00:15:24.023 11:39:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:24.023 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.023 --rc genhtml_branch_coverage=1 00:15:24.023 --rc genhtml_function_coverage=1 00:15:24.023 --rc genhtml_legend=1 00:15:24.023 --rc geninfo_all_blocks=1 00:15:24.023 --rc geninfo_unexecuted_blocks=1 00:15:24.023 00:15:24.023 ' 00:15:24.023 11:39:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:24.023 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.023 --rc genhtml_branch_coverage=1 00:15:24.023 --rc genhtml_function_coverage=1 00:15:24.023 --rc genhtml_legend=1 00:15:24.023 --rc geninfo_all_blocks=1 00:15:24.023 --rc geninfo_unexecuted_blocks=1 00:15:24.023 00:15:24.023 ' 00:15:24.023 11:39:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:24.023 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.023 --rc genhtml_branch_coverage=1 00:15:24.023 --rc genhtml_function_coverage=1 00:15:24.023 --rc genhtml_legend=1 00:15:24.023 --rc geninfo_all_blocks=1 00:15:24.023 --rc geninfo_unexecuted_blocks=1 00:15:24.023 00:15:24.023 ' 00:15:24.023 11:39:43 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:24.023 11:39:43 -- nvmf/common.sh@7 -- # uname -s 00:15:24.023 11:39:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:24.023 11:39:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:24.023 11:39:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:24.023 11:39:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:24.023 11:39:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:24.023 11:39:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:24.023 11:39:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:24.023 11:39:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:24.023 11:39:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:24.023 11:39:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:24.023 11:39:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:24.023 11:39:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:24.023 11:39:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:24.023 11:39:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:24.023 11:39:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:24.023 11:39:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:24.023 11:39:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:24.023 11:39:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:24.023 11:39:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:24.023 11:39:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.023 11:39:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.023 11:39:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.023 11:39:43 -- paths/export.sh@5 -- # export PATH 00:15:24.023 11:39:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.023 11:39:43 -- nvmf/common.sh@46 -- # : 0 00:15:24.023 11:39:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:24.023 11:39:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:24.023 11:39:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:24.023 11:39:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:24.023 11:39:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:24.023 11:39:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:24.023 11:39:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:24.023 11:39:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:24.023 11:39:43 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:24.023 11:39:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:24.023 11:39:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:24.023 11:39:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:24.023 11:39:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:24.023 11:39:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:24.023 11:39:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:24.023 11:39:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:24.023 11:39:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:24.023 11:39:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:24.023 11:39:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:24.023 11:39:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:24.023 11:39:43 -- common/autotest_common.sh@10 -- # set +x 00:15:25.925 11:39:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:25.925 11:39:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:25.925 11:39:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:25.925 11:39:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:25.925 11:39:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:25.925 11:39:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:25.925 11:39:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:25.925 11:39:45 -- nvmf/common.sh@294 -- # net_devs=() 00:15:25.925 11:39:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:25.925 11:39:45 -- nvmf/common.sh@295 -- # e810=() 00:15:25.925 11:39:45 -- nvmf/common.sh@295 -- # local -ga e810 00:15:25.925 11:39:45 -- nvmf/common.sh@296 -- # x722=() 00:15:25.925 11:39:45 -- nvmf/common.sh@296 -- # local -ga x722 00:15:25.925 11:39:45 -- nvmf/common.sh@297 -- # mlx=() 00:15:25.925 11:39:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:25.925 11:39:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:25.925 11:39:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:25.925 11:39:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:25.925 11:39:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:25.925 11:39:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:25.925 11:39:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:25.925 11:39:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:25.925 11:39:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:25.925 11:39:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:25.925 11:39:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:25.925 11:39:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:25.925 11:39:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:25.925 11:39:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:25.925 11:39:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:25.925 11:39:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:25.925 11:39:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:25.925 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:25.925 11:39:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:25.925 11:39:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:25.925 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:25.925 11:39:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:25.925 11:39:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:25.925 11:39:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:25.925 11:39:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:25.925 11:39:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:25.926 11:39:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:25.926 11:39:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:25.926 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:25.926 11:39:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:25.926 11:39:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:25.926 11:39:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:25.926 11:39:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:25.926 11:39:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:25.926 11:39:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:25.926 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:25.926 11:39:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:25.926 11:39:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:25.926 11:39:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:25.926 11:39:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:25.926 11:39:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:25.926 11:39:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:25.926 11:39:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:25.926 11:39:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:25.926 11:39:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:25.926 11:39:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:25.926 11:39:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:25.926 11:39:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:25.926 11:39:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:25.926 11:39:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:25.926 11:39:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:25.926 11:39:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:25.926 11:39:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:25.926 11:39:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:25.926 11:39:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:25.926 11:39:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:25.926 11:39:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:25.926 11:39:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:25.926 11:39:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:26.185 11:39:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:26.185 11:39:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:26.185 11:39:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:26.185 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:26.185 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:15:26.185 00:15:26.185 --- 10.0.0.2 ping statistics --- 00:15:26.185 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:26.185 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:15:26.185 11:39:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:26.185 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:26.185 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.161 ms 00:15:26.185 00:15:26.185 --- 10.0.0.1 ping statistics --- 00:15:26.185 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:26.185 rtt min/avg/max/mdev = 0.161/0.161/0.161/0.000 ms 00:15:26.185 11:39:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:26.185 11:39:46 -- nvmf/common.sh@410 -- # return 0 00:15:26.185 11:39:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:26.185 11:39:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:26.185 11:39:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:26.185 11:39:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:26.185 11:39:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:26.185 11:39:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:26.185 11:39:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:26.185 11:39:46 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:26.185 11:39:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:26.185 11:39:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:26.185 11:39:46 -- common/autotest_common.sh@10 -- # set +x 00:15:26.185 11:39:46 -- nvmf/common.sh@469 -- # nvmfpid=3804659 00:15:26.185 11:39:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:26.185 11:39:46 -- nvmf/common.sh@470 -- # waitforlisten 3804659 00:15:26.185 11:39:46 -- common/autotest_common.sh@829 -- # '[' -z 3804659 ']' 00:15:26.185 11:39:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:26.185 11:39:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:26.185 11:39:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:26.185 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:26.185 11:39:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:26.185 11:39:46 -- common/autotest_common.sh@10 -- # set +x 00:15:26.185 [2024-11-28 11:39:46.084663] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:26.185 [2024-11-28 11:39:46.084748] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:26.185 EAL: No free 2048 kB hugepages reported on node 1 00:15:26.185 [2024-11-28 11:39:46.159632] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:26.444 [2024-11-28 11:39:46.282475] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:26.444 [2024-11-28 11:39:46.282648] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:26.444 [2024-11-28 11:39:46.282669] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:26.444 [2024-11-28 11:39:46.282684] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:26.444 [2024-11-28 11:39:46.282715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:27.378 11:39:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:27.378 11:39:47 -- common/autotest_common.sh@862 -- # return 0 00:15:27.378 11:39:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:27.378 11:39:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:27.378 11:39:47 -- common/autotest_common.sh@10 -- # set +x 00:15:27.378 11:39:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:27.378 11:39:47 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:27.379 11:39:47 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:27.379 11:39:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.379 11:39:47 -- common/autotest_common.sh@10 -- # set +x 00:15:27.379 [2024-11-28 11:39:47.132716] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:27.379 11:39:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.379 11:39:47 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:27.379 11:39:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.379 11:39:47 -- common/autotest_common.sh@10 -- # set +x 00:15:27.379 11:39:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.379 11:39:47 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:27.379 11:39:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.379 11:39:47 -- common/autotest_common.sh@10 -- # set +x 00:15:27.379 [2024-11-28 11:39:47.148934] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:27.379 11:39:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.379 11:39:47 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:27.379 11:39:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.379 11:39:47 -- common/autotest_common.sh@10 -- # set +x 00:15:27.379 11:39:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.379 11:39:47 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:27.379 11:39:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.379 11:39:47 -- common/autotest_common.sh@10 -- # set +x 00:15:27.379 malloc0 00:15:27.379 11:39:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.379 11:39:47 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:27.379 11:39:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.379 11:39:47 -- common/autotest_common.sh@10 -- # set +x 00:15:27.379 11:39:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.379 11:39:47 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:27.379 11:39:47 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:27.379 11:39:47 -- nvmf/common.sh@520 -- # config=() 00:15:27.379 11:39:47 -- nvmf/common.sh@520 -- # local subsystem config 00:15:27.379 11:39:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:27.379 11:39:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:27.379 { 00:15:27.379 "params": { 00:15:27.379 "name": "Nvme$subsystem", 00:15:27.379 "trtype": "$TEST_TRANSPORT", 00:15:27.379 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:27.379 "adrfam": "ipv4", 00:15:27.379 "trsvcid": "$NVMF_PORT", 00:15:27.379 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:27.379 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:27.379 "hdgst": ${hdgst:-false}, 00:15:27.379 "ddgst": ${ddgst:-false} 00:15:27.379 }, 00:15:27.379 "method": "bdev_nvme_attach_controller" 00:15:27.379 } 00:15:27.379 EOF 00:15:27.379 )") 00:15:27.379 11:39:47 -- nvmf/common.sh@542 -- # cat 00:15:27.379 11:39:47 -- nvmf/common.sh@544 -- # jq . 00:15:27.379 11:39:47 -- nvmf/common.sh@545 -- # IFS=, 00:15:27.379 11:39:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:27.379 "params": { 00:15:27.379 "name": "Nvme1", 00:15:27.379 "trtype": "tcp", 00:15:27.379 "traddr": "10.0.0.2", 00:15:27.379 "adrfam": "ipv4", 00:15:27.379 "trsvcid": "4420", 00:15:27.379 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:27.379 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:27.379 "hdgst": false, 00:15:27.379 "ddgst": false 00:15:27.379 }, 00:15:27.379 "method": "bdev_nvme_attach_controller" 00:15:27.379 }' 00:15:27.379 [2024-11-28 11:39:47.218162] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:27.379 [2024-11-28 11:39:47.218235] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3804821 ] 00:15:27.379 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.379 [2024-11-28 11:39:47.279675] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:27.379 [2024-11-28 11:39:47.398112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:27.945 Running I/O for 10 seconds... 00:15:37.914 00:15:37.914 Latency(us) 00:15:37.914 [2024-11-28T10:39:57.970Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:37.914 [2024-11-28T10:39:57.970Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:15:37.914 Verification LBA range: start 0x0 length 0x1000 00:15:37.914 Nvme1n1 : 10.06 8601.53 67.20 0.00 0.00 14789.91 3325.35 45438.29 00:15:37.914 [2024-11-28T10:39:57.970Z] =================================================================================================================== 00:15:37.914 [2024-11-28T10:39:57.970Z] Total : 8601.53 67.20 0.00 0.00 14789.91 3325.35 45438.29 00:15:38.173 11:39:58 -- target/zcopy.sh@39 -- # perfpid=3806051 00:15:38.173 11:39:58 -- target/zcopy.sh@41 -- # xtrace_disable 00:15:38.173 11:39:58 -- common/autotest_common.sh@10 -- # set +x 00:15:38.173 11:39:58 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:15:38.173 11:39:58 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:15:38.173 11:39:58 -- nvmf/common.sh@520 -- # config=() 00:15:38.173 11:39:58 -- nvmf/common.sh@520 -- # local subsystem config 00:15:38.173 11:39:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:38.173 11:39:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:38.173 { 00:15:38.173 "params": { 00:15:38.173 "name": "Nvme$subsystem", 00:15:38.173 "trtype": "$TEST_TRANSPORT", 00:15:38.173 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:38.173 "adrfam": "ipv4", 00:15:38.173 "trsvcid": "$NVMF_PORT", 00:15:38.173 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:38.173 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:38.173 "hdgst": ${hdgst:-false}, 00:15:38.173 "ddgst": ${ddgst:-false} 00:15:38.173 }, 00:15:38.173 "method": "bdev_nvme_attach_controller" 00:15:38.173 } 00:15:38.173 EOF 00:15:38.173 )") 00:15:38.173 11:39:58 -- nvmf/common.sh@542 -- # cat 00:15:38.173 11:39:58 -- nvmf/common.sh@544 -- # jq . 00:15:38.173 [2024-11-28 11:39:58.090620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.090665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 11:39:58 -- nvmf/common.sh@545 -- # IFS=, 00:15:38.173 11:39:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:38.173 "params": { 00:15:38.173 "name": "Nvme1", 00:15:38.173 "trtype": "tcp", 00:15:38.173 "traddr": "10.0.0.2", 00:15:38.173 "adrfam": "ipv4", 00:15:38.173 "trsvcid": "4420", 00:15:38.173 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:38.173 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:38.173 "hdgst": false, 00:15:38.173 "ddgst": false 00:15:38.173 }, 00:15:38.173 "method": "bdev_nvme_attach_controller" 00:15:38.173 }' 00:15:38.173 [2024-11-28 11:39:58.098594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.098621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.106597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.106622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.114602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.114625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.122622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.122644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.123871] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:38.173 [2024-11-28 11:39:58.123940] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3806051 ] 00:15:38.173 [2024-11-28 11:39:58.130644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.130666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.138665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.138687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.146689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.146711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 EAL: No free 2048 kB hugepages reported on node 1 00:15:38.173 [2024-11-28 11:39:58.154710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.154734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.162732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.162754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.170752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.170773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.178775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.178797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.186801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.186837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.187410] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:38.173 [2024-11-28 11:39:58.194863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.194910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.202900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.202939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.210899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.210925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.218909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.173 [2024-11-28 11:39:58.218934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.173 [2024-11-28 11:39:58.226942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.174 [2024-11-28 11:39:58.226967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.234966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.234991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.242989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.243014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.251011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.251037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.259063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.259100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.267060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.267085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.275081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.275106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.283104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.283129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.291148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.291184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.299150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.299175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.307176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.307200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.307916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:38.432 [2024-11-28 11:39:58.315196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.315220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.323236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.323267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.331264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.331300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.339289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.339325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.347311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.347349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.355341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.355378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.363362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.363401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.371378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.371416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.379375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.432 [2024-11-28 11:39:58.379400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.432 [2024-11-28 11:39:58.387423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.433 [2024-11-28 11:39:58.387460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.433 [2024-11-28 11:39:58.395445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.433 [2024-11-28 11:39:58.395483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.433 [2024-11-28 11:39:58.403468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.433 [2024-11-28 11:39:58.403505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.433 [2024-11-28 11:39:58.411466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.433 [2024-11-28 11:39:58.411491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.433 [2024-11-28 11:39:58.419496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.433 [2024-11-28 11:39:58.419522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.433 [2024-11-28 11:39:58.427520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.433 [2024-11-28 11:39:58.427570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.433 [2024-11-28 11:39:58.435548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.433 [2024-11-28 11:39:58.435587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.433 [2024-11-28 11:39:58.443581] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.433 [2024-11-28 11:39:58.443603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.433 [2024-11-28 11:39:58.451597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.433 [2024-11-28 11:39:58.451620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.433 [2024-11-28 11:39:58.459618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.433 [2024-11-28 11:39:58.459639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.433 [2024-11-28 11:39:58.467632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.433 [2024-11-28 11:39:58.467653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.433 [2024-11-28 11:39:58.475652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.433 [2024-11-28 11:39:58.475673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.433 [2024-11-28 11:39:58.483698] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.433 [2024-11-28 11:39:58.483721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.491705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.491728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.499743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.499768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.507746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.507768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.515765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.515786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.523788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.523822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.531823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.531844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.539860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.539885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.547881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.547907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.555904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.555929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.563933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.563958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.571960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.571985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.579975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.580000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.588002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.588035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.596022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.596047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.604043] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.604067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.612064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.612088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.620089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.620113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.628116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.628141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.636140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.636164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.644171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.644200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.652185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.652210] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 Running I/O for 5 seconds... 00:15:38.691 [2024-11-28 11:39:58.663378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.663409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.673378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.691 [2024-11-28 11:39:58.673409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.691 [2024-11-28 11:39:58.685257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.692 [2024-11-28 11:39:58.685288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.692 [2024-11-28 11:39:58.696704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.692 [2024-11-28 11:39:58.696731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.692 [2024-11-28 11:39:58.710078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.692 [2024-11-28 11:39:58.710108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.692 [2024-11-28 11:39:58.720486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.692 [2024-11-28 11:39:58.720515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.692 [2024-11-28 11:39:58.732077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.692 [2024-11-28 11:39:58.732107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.692 [2024-11-28 11:39:58.743066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.692 [2024-11-28 11:39:58.743096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.754740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.754767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.765918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.765948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.776938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.776977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.787845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.787875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.798846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.798890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.810117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.810146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.820928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.820959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.831819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.831864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.844968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.844998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.855408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.855438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.866038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.866068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.877020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.877050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.888045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.888076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.899435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.899464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.910374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.910403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.921593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.921621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.932513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.932551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.943485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.943515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.954829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.954873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.967595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.967622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.978460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.978490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:58.990046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:58.990084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.950 [2024-11-28 11:39:59.001054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.950 [2024-11-28 11:39:59.001084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.208 [2024-11-28 11:39:59.011965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.208 [2024-11-28 11:39:59.011995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.208 [2024-11-28 11:39:59.023085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.208 [2024-11-28 11:39:59.023114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.208 [2024-11-28 11:39:59.036183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.208 [2024-11-28 11:39:59.036213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.208 [2024-11-28 11:39:59.046146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.208 [2024-11-28 11:39:59.046176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.208 [2024-11-28 11:39:59.056957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.208 [2024-11-28 11:39:59.056986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.208 [2024-11-28 11:39:59.069581] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.208 [2024-11-28 11:39:59.069608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.208 [2024-11-28 11:39:59.079896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.079926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.090536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.090581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.101702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.101729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.112685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.112713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.125656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.125683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.135699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.135727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.146737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.146765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.159740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.159767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.170108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.170138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.181187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.181217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.192265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.192295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.203208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.203234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.213105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.213132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.222825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.222851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.232668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.232695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.242444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.242471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.252170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.252197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.209 [2024-11-28 11:39:59.262196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.209 [2024-11-28 11:39:59.262223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.271915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.271943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.281889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.281917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.291459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.291487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.301643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.301671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.313857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.313884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.323365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.323393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.335669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.335696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.345344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.345372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.355372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.355400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.365512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.365551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.375179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.375207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.386906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.386934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.396194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.396222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.406364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.406391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.416047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.416074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.426061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.426087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.436276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.436303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.446123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.446149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.456364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.456390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.469109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.469136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.480620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.480648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.488795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.488822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.467 [2024-11-28 11:39:59.500427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.467 [2024-11-28 11:39:59.500453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.468 [2024-11-28 11:39:59.510203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.468 [2024-11-28 11:39:59.510231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.468 [2024-11-28 11:39:59.520030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.468 [2024-11-28 11:39:59.520057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.726 [2024-11-28 11:39:59.529927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.726 [2024-11-28 11:39:59.529954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.726 [2024-11-28 11:39:59.540067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.726 [2024-11-28 11:39:59.540094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.726 [2024-11-28 11:39:59.550232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.550259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.560045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.560072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.570203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.570229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.580207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.580234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.590027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.590054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.599980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.600008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.610086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.610113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.620587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.620614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.631130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.631157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.643373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.643400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.652611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.652638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.662978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.663005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.674677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.674704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.683893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.683919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.694147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.694174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.706954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.706984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.717098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.717128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.728087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.728117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.740795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.740822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.750595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.750622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.762218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.762248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.727 [2024-11-28 11:39:59.775624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.727 [2024-11-28 11:39:59.775650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.985 [2024-11-28 11:39:59.785586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.985 [2024-11-28 11:39:59.785613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.985 [2024-11-28 11:39:59.797197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.985 [2024-11-28 11:39:59.797227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.985 [2024-11-28 11:39:59.808503] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.985 [2024-11-28 11:39:59.808542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.985 [2024-11-28 11:39:59.821997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.985 [2024-11-28 11:39:59.822027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.985 [2024-11-28 11:39:59.831712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.985 [2024-11-28 11:39:59.831739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.985 [2024-11-28 11:39:59.842290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.985 [2024-11-28 11:39:59.842320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.985 [2024-11-28 11:39:59.855049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.985 [2024-11-28 11:39:59.855079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.985 [2024-11-28 11:39:59.864317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.985 [2024-11-28 11:39:59.864347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.985 [2024-11-28 11:39:59.875870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.985 [2024-11-28 11:39:59.875900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.985 [2024-11-28 11:39:59.889001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.986 [2024-11-28 11:39:59.889032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.986 [2024-11-28 11:39:59.899354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.986 [2024-11-28 11:39:59.899384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.986 [2024-11-28 11:39:59.910070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.986 [2024-11-28 11:39:59.910100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.986 [2024-11-28 11:39:59.920905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.986 [2024-11-28 11:39:59.920935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.986 [2024-11-28 11:39:59.932084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.986 [2024-11-28 11:39:59.932113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.986 [2024-11-28 11:39:59.944452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.986 [2024-11-28 11:39:59.944481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.986 [2024-11-28 11:39:59.953835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.986 [2024-11-28 11:39:59.953880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.986 [2024-11-28 11:39:59.965466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.986 [2024-11-28 11:39:59.965497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.986 [2024-11-28 11:39:59.976578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.986 [2024-11-28 11:39:59.976622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.986 [2024-11-28 11:39:59.987244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.986 [2024-11-28 11:39:59.987274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.986 [2024-11-28 11:40:00.000455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.986 [2024-11-28 11:40:00.000495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.986 [2024-11-28 11:40:00.010978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.986 [2024-11-28 11:40:00.011011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.986 [2024-11-28 11:40:00.021864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.986 [2024-11-28 11:40:00.021910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.986 [2024-11-28 11:40:00.034470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.986 [2024-11-28 11:40:00.034499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.046444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.046475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.055891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.055921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.068135] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.068166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.079577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.079605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.092665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.092693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.103557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.103604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.114634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.114666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.125590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.125618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.136653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.136680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.147265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.147295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.158084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.158114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.171105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.171135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.181238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.181268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.191862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.191890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.202882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.202908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.244 [2024-11-28 11:40:00.213682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.244 [2024-11-28 11:40:00.213723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.245 [2024-11-28 11:40:00.224096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.245 [2024-11-28 11:40:00.224123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.245 [2024-11-28 11:40:00.234626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.245 [2024-11-28 11:40:00.234653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.245 [2024-11-28 11:40:00.245614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.245 [2024-11-28 11:40:00.245643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.245 [2024-11-28 11:40:00.256499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.245 [2024-11-28 11:40:00.256537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.245 [2024-11-28 11:40:00.267668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.245 [2024-11-28 11:40:00.267696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.245 [2024-11-28 11:40:00.278724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.245 [2024-11-28 11:40:00.278752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.245 [2024-11-28 11:40:00.289403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.245 [2024-11-28 11:40:00.289433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.300122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.300152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.310866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.310897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.321624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.321651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.332986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.333016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.343801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.343847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.354901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.354932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.365942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.365972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.376885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.376913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.387821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.387849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.400120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.400161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.410057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.410087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.420840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.420876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.431844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.431890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.442779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.442823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.453671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.453699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.464743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.464771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.475192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.475223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.485719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.485747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.496455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.496486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.509376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.509407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.519637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.519666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.530362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.530393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.543972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.544003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.503 [2024-11-28 11:40:00.554052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.503 [2024-11-28 11:40:00.554083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.564815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.564843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.577892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.577922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.588237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.588267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.599102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.599133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.609953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.609983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.621031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.621061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.634095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.634134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.644232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.644262] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.654973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.655003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.667716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.667743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.677863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.677892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.689293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.689322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.700119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.700149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.710615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.710643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.721596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.721624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.732622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.732649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.743174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.743204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.754284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.754314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.765270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.765299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.777834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.777879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.788237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.788267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.799090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.799119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.762 [2024-11-28 11:40:00.811662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.762 [2024-11-28 11:40:00.811689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.821610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.821637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.832740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.832767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.845256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.845293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.856987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.857017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.866611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.866639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.878343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.878372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.889389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.889420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.901878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.901909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.912052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.912082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.922880] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.922911] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.934068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.934098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.944719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.944746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.955146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.955176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.965730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.965757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.976495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.976533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.989067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.989097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:00.998457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:00.998486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:01.009737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:01.009764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:01.020129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:01.020159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:01.030960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:01.030990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:01.041705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:01.041732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:01.054309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:01.054338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:01.064574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:01.064600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.021 [2024-11-28 11:40:01.075587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.021 [2024-11-28 11:40:01.075614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.088269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.088299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.098435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.098466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.109022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.109052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.121830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.121860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.131465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.131494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.142690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.142718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.153210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.153240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.163860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.163890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.174626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.174653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.185723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.185751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.198700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.198728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.209014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.209045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.219704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.219732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.230177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.230208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.280 [2024-11-28 11:40:01.241073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.280 [2024-11-28 11:40:01.241104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.281 [2024-11-28 11:40:01.254052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.281 [2024-11-28 11:40:01.254083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.281 [2024-11-28 11:40:01.263951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.281 [2024-11-28 11:40:01.263981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.281 [2024-11-28 11:40:01.274979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.281 [2024-11-28 11:40:01.275011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.281 [2024-11-28 11:40:01.287931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.281 [2024-11-28 11:40:01.287980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.281 [2024-11-28 11:40:01.298432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.281 [2024-11-28 11:40:01.298463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.281 [2024-11-28 11:40:01.309236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.281 [2024-11-28 11:40:01.309266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.281 [2024-11-28 11:40:01.321771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.281 [2024-11-28 11:40:01.321798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.281 [2024-11-28 11:40:01.331972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.281 [2024-11-28 11:40:01.332003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.343437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.343468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.355042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.355072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.366392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.366422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.377332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.377362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.389996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.390026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.399217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.399247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.410329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.410359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.421323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.421352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.433900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.433930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.443929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.443960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.454864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.454894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.465872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.465902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.476638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.476665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.489297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.489326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.499343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.499373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.510462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.510491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.521513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.521552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.532285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.532315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.545283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.545313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.555635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.555663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.566966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.566998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.579978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.580009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-28 11:40:01.590352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-28 11:40:01.590382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.601068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.601109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.612386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.612417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.624011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.624041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.635166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.635196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.646933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.646963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.658518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.658573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.671504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.671546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.682071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.682109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.693231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.693261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.706228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.706259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.716285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.716315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.727024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.727053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.737791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.737818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.748718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.748745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.759952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.759982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.770702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.770729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.781588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.781615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.792501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.792539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.805364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.805393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.815412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.815442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.825902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.825932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.836572] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.836598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-28 11:40:01.847628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-28 11:40:01.847655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:01.860419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:01.860449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:01.870452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:01.870482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:01.881671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:01.881698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:01.894689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:01.894724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:01.904907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:01.904937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:01.916181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:01.916211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:01.929237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:01.929267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:01.939405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:01.939435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:01.949993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:01.950023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:01.962705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:01.962732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:01.972742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:01.972770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:01.983998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:01.984028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:01.997142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:01.997172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:02.006930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:02.006959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:02.017808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:02.017851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:02.028995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:02.029025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:02.039797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:02.039842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:02.052615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:02.052642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:02.062493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:02.062523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:02.072949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:02.072980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:02.084085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:02.084115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:02.094769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:02.094797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.057 [2024-11-28 11:40:02.108318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.057 [2024-11-28 11:40:02.108356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.117997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.118027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.129337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.129367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.139787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.139814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.150166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.150195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.160652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.160679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.171210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.171240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.181662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.181689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.192618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.192645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.203495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.203533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.216275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.216305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.224882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.224912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.238069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.238100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.248456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.248487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.258908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.258938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.269775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.269802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.280927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.280958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.293899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.293927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.304222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.304252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.314751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.314786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.327746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.327774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.337970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.338000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.348841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.348886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.359220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.359250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-28 11:40:02.369970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.316 [2024-11-28 11:40:02.370000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.574 [2024-11-28 11:40:02.382668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.574 [2024-11-28 11:40:02.382696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.574 [2024-11-28 11:40:02.392902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.574 [2024-11-28 11:40:02.392933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.574 [2024-11-28 11:40:02.403855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.574 [2024-11-28 11:40:02.403885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.574 [2024-11-28 11:40:02.416666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.416693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.426645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.426672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.437938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.437968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.450783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.450810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.461652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.461682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.472809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.472836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.485755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.485782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.496235] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.496264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.507515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.507569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.518902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.518932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.530059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.530097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.543431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.543461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.554188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.554217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.565130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.565160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.576146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.576176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.586751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.586779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.597910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.597941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.610584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.610611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.575 [2024-11-28 11:40:02.620827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.575 [2024-11-28 11:40:02.620857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.833 [2024-11-28 11:40:02.631671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.833 [2024-11-28 11:40:02.631698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.644506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.644545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.654816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.654860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.666153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.666183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.679340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.679370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.689215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.689245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.700159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.700190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.711312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.711342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.722038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.722068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.733674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.733702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.745083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.745114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.756193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.756223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.769141] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.769171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.779250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.779280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.790736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.790764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.801815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.801864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.812821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.812864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.824296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.824326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.835446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.835476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.846953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.846984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.858081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.858110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.871004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.871034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.834 [2024-11-28 11:40:02.881090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.834 [2024-11-28 11:40:02.881120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.092 [2024-11-28 11:40:02.892397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.092 [2024-11-28 11:40:02.892428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.092 [2024-11-28 11:40:02.905178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.092 [2024-11-28 11:40:02.905208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.092 [2024-11-28 11:40:02.915063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.092 [2024-11-28 11:40:02.915093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.092 [2024-11-28 11:40:02.926395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.092 [2024-11-28 11:40:02.926424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.092 [2024-11-28 11:40:02.937017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.092 [2024-11-28 11:40:02.937046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.092 [2024-11-28 11:40:02.948000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.092 [2024-11-28 11:40:02.948031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.092 [2024-11-28 11:40:02.961050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.092 [2024-11-28 11:40:02.961081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.092 [2024-11-28 11:40:02.971286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.092 [2024-11-28 11:40:02.971316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.092 [2024-11-28 11:40:02.982550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.092 [2024-11-28 11:40:02.982597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.092 [2024-11-28 11:40:02.995319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.092 [2024-11-28 11:40:02.995349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.092 [2024-11-28 11:40:03.005122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.092 [2024-11-28 11:40:03.005152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.092 [2024-11-28 11:40:03.015813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.092 [2024-11-28 11:40:03.015859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.092 [2024-11-28 11:40:03.028662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.093 [2024-11-28 11:40:03.028689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.093 [2024-11-28 11:40:03.039184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.093 [2024-11-28 11:40:03.039214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.093 [2024-11-28 11:40:03.050510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.093 [2024-11-28 11:40:03.050551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.093 [2024-11-28 11:40:03.063727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.093 [2024-11-28 11:40:03.063754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.093 [2024-11-28 11:40:03.074114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.093 [2024-11-28 11:40:03.074144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.093 [2024-11-28 11:40:03.084997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.093 [2024-11-28 11:40:03.085028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.093 [2024-11-28 11:40:03.097588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.093 [2024-11-28 11:40:03.097615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.093 [2024-11-28 11:40:03.107638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.093 [2024-11-28 11:40:03.107665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.093 [2024-11-28 11:40:03.119286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.093 [2024-11-28 11:40:03.119315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.093 [2024-11-28 11:40:03.130330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.093 [2024-11-28 11:40:03.130359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.093 [2024-11-28 11:40:03.141498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.093 [2024-11-28 11:40:03.141539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.152289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.152319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.165074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.165104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.175687] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.175714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.186810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.186856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.198333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.198363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.209752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.209782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.221123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.221153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.233820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.233849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.244627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.244655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.256215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.256245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.267393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.267423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.278676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.278703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.289963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.289993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.300735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.300763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.311737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.311764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.324627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.324654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.334344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.334373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.346048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.346078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.358968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.358998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.369455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.351 [2024-11-28 11:40:03.369485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.351 [2024-11-28 11:40:03.380183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.352 [2024-11-28 11:40:03.380225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.352 [2024-11-28 11:40:03.393277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.352 [2024-11-28 11:40:03.393308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.352 [2024-11-28 11:40:03.403144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.352 [2024-11-28 11:40:03.403173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.417934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.417966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.428695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.428724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.439851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.439881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.450615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.450651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.461679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.461707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.474374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.474404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.484161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.484191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.495329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.495358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.506755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.506783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.519696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.519724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.529286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.529316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.541217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.541248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.552228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.552258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.563399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.563429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.574611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.574638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.585513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.585552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.596438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.596486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.607238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.607267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.617910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.617940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.630810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.630853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.641192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.641222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.651979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.652009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.610 [2024-11-28 11:40:03.664621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.610 [2024-11-28 11:40:03.664648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.673573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.673600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 00:15:43.869 Latency(us) 00:15:43.869 [2024-11-28T10:40:03.925Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:43.869 [2024-11-28T10:40:03.925Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:15:43.869 Nvme1n1 : 5.01 11732.69 91.66 0.00 0.00 10896.07 4660.34 18350.08 00:15:43.869 [2024-11-28T10:40:03.925Z] =================================================================================================================== 00:15:43.869 [2024-11-28T10:40:03.925Z] Total : 11732.69 91.66 0.00 0.00 10896.07 4660.34 18350.08 00:15:43.869 [2024-11-28 11:40:03.680336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.680365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.688363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.688394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.696375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.696401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.704446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.704493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.712467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.712513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.720493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.720547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.728496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.728551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.736540] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.736585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.744555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.744618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.752579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.752625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.760603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.760649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.768625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.768670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.776641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.776687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.784665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.784710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.792683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.792729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.800706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.800750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.808675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.808696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.816694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.816715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.824719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.824742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.832736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.832758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.840783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.840817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.848831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.848874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.856860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.856917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.864842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.864864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.872878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.872903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.880897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.880921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.888917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.888942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.896971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.897027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.905000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.905046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.869 [2024-11-28 11:40:03.912982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.869 [2024-11-28 11:40:03.913010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.870 [2024-11-28 11:40:03.921001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.870 [2024-11-28 11:40:03.921025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.128 [2024-11-28 11:40:03.929024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.128 [2024-11-28 11:40:03.929049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.128 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (3806051) - No such process 00:15:44.128 11:40:03 -- target/zcopy.sh@49 -- # wait 3806051 00:15:44.128 11:40:03 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:44.128 11:40:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:44.128 11:40:03 -- common/autotest_common.sh@10 -- # set +x 00:15:44.128 11:40:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:44.128 11:40:03 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:44.128 11:40:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:44.128 11:40:03 -- common/autotest_common.sh@10 -- # set +x 00:15:44.128 delay0 00:15:44.128 11:40:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:44.128 11:40:03 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:15:44.128 11:40:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:44.128 11:40:03 -- common/autotest_common.sh@10 -- # set +x 00:15:44.128 11:40:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:44.128 11:40:03 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:15:44.128 EAL: No free 2048 kB hugepages reported on node 1 00:15:44.128 [2024-11-28 11:40:04.051503] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:15:52.242 Initializing NVMe Controllers 00:15:52.242 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:52.242 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:15:52.242 Initialization complete. Launching workers. 00:15:52.242 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 240, failed: 19606 00:15:52.242 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 19727, failed to submit 119 00:15:52.242 success 19663, unsuccess 64, failed 0 00:15:52.242 11:40:11 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:15:52.242 11:40:11 -- target/zcopy.sh@60 -- # nvmftestfini 00:15:52.242 11:40:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:52.242 11:40:11 -- nvmf/common.sh@116 -- # sync 00:15:52.242 11:40:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:52.242 11:40:11 -- nvmf/common.sh@119 -- # set +e 00:15:52.242 11:40:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:52.242 11:40:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:52.242 rmmod nvme_tcp 00:15:52.242 rmmod nvme_fabrics 00:15:52.242 rmmod nvme_keyring 00:15:52.242 11:40:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:52.242 11:40:11 -- nvmf/common.sh@123 -- # set -e 00:15:52.242 11:40:11 -- nvmf/common.sh@124 -- # return 0 00:15:52.242 11:40:11 -- nvmf/common.sh@477 -- # '[' -n 3804659 ']' 00:15:52.242 11:40:11 -- nvmf/common.sh@478 -- # killprocess 3804659 00:15:52.242 11:40:11 -- common/autotest_common.sh@936 -- # '[' -z 3804659 ']' 00:15:52.242 11:40:11 -- common/autotest_common.sh@940 -- # kill -0 3804659 00:15:52.242 11:40:11 -- common/autotest_common.sh@941 -- # uname 00:15:52.242 11:40:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:52.242 11:40:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3804659 00:15:52.242 11:40:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:52.242 11:40:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:52.242 11:40:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3804659' 00:15:52.242 killing process with pid 3804659 00:15:52.242 11:40:11 -- common/autotest_common.sh@955 -- # kill 3804659 00:15:52.242 11:40:11 -- common/autotest_common.sh@960 -- # wait 3804659 00:15:52.242 11:40:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:52.242 11:40:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:52.242 11:40:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:52.242 11:40:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:52.242 11:40:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:52.242 11:40:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:52.242 11:40:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:52.242 11:40:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:53.621 11:40:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:53.621 00:15:53.621 real 0m29.950s 00:15:53.621 user 0m41.485s 00:15:53.621 sys 0m9.771s 00:15:53.621 11:40:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:53.621 11:40:13 -- common/autotest_common.sh@10 -- # set +x 00:15:53.621 ************************************ 00:15:53.621 END TEST nvmf_zcopy 00:15:53.621 ************************************ 00:15:53.621 11:40:13 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:15:53.621 11:40:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:53.621 11:40:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:53.621 11:40:13 -- common/autotest_common.sh@10 -- # set +x 00:15:53.621 ************************************ 00:15:53.621 START TEST nvmf_nmic 00:15:53.621 ************************************ 00:15:53.621 11:40:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:15:53.621 * Looking for test storage... 00:15:53.621 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:53.621 11:40:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:53.621 11:40:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:53.621 11:40:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:53.881 11:40:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:53.881 11:40:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:53.881 11:40:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:53.881 11:40:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:53.881 11:40:13 -- scripts/common.sh@335 -- # IFS=.-: 00:15:53.881 11:40:13 -- scripts/common.sh@335 -- # read -ra ver1 00:15:53.881 11:40:13 -- scripts/common.sh@336 -- # IFS=.-: 00:15:53.881 11:40:13 -- scripts/common.sh@336 -- # read -ra ver2 00:15:53.881 11:40:13 -- scripts/common.sh@337 -- # local 'op=<' 00:15:53.881 11:40:13 -- scripts/common.sh@339 -- # ver1_l=2 00:15:53.881 11:40:13 -- scripts/common.sh@340 -- # ver2_l=1 00:15:53.881 11:40:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:53.881 11:40:13 -- scripts/common.sh@343 -- # case "$op" in 00:15:53.881 11:40:13 -- scripts/common.sh@344 -- # : 1 00:15:53.881 11:40:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:53.881 11:40:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:53.881 11:40:13 -- scripts/common.sh@364 -- # decimal 1 00:15:53.881 11:40:13 -- scripts/common.sh@352 -- # local d=1 00:15:53.881 11:40:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:53.881 11:40:13 -- scripts/common.sh@354 -- # echo 1 00:15:53.881 11:40:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:53.881 11:40:13 -- scripts/common.sh@365 -- # decimal 2 00:15:53.881 11:40:13 -- scripts/common.sh@352 -- # local d=2 00:15:53.881 11:40:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:53.881 11:40:13 -- scripts/common.sh@354 -- # echo 2 00:15:53.881 11:40:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:53.881 11:40:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:53.881 11:40:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:53.881 11:40:13 -- scripts/common.sh@367 -- # return 0 00:15:53.881 11:40:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:53.881 11:40:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:53.881 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:53.881 --rc genhtml_branch_coverage=1 00:15:53.881 --rc genhtml_function_coverage=1 00:15:53.881 --rc genhtml_legend=1 00:15:53.881 --rc geninfo_all_blocks=1 00:15:53.881 --rc geninfo_unexecuted_blocks=1 00:15:53.881 00:15:53.881 ' 00:15:53.881 11:40:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:53.881 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:53.881 --rc genhtml_branch_coverage=1 00:15:53.881 --rc genhtml_function_coverage=1 00:15:53.881 --rc genhtml_legend=1 00:15:53.881 --rc geninfo_all_blocks=1 00:15:53.881 --rc geninfo_unexecuted_blocks=1 00:15:53.881 00:15:53.881 ' 00:15:53.881 11:40:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:53.881 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:53.881 --rc genhtml_branch_coverage=1 00:15:53.881 --rc genhtml_function_coverage=1 00:15:53.881 --rc genhtml_legend=1 00:15:53.881 --rc geninfo_all_blocks=1 00:15:53.881 --rc geninfo_unexecuted_blocks=1 00:15:53.881 00:15:53.881 ' 00:15:53.881 11:40:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:53.881 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:53.881 --rc genhtml_branch_coverage=1 00:15:53.881 --rc genhtml_function_coverage=1 00:15:53.881 --rc genhtml_legend=1 00:15:53.881 --rc geninfo_all_blocks=1 00:15:53.881 --rc geninfo_unexecuted_blocks=1 00:15:53.881 00:15:53.881 ' 00:15:53.881 11:40:13 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:53.881 11:40:13 -- nvmf/common.sh@7 -- # uname -s 00:15:53.881 11:40:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:53.881 11:40:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:53.881 11:40:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:53.881 11:40:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:53.881 11:40:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:53.881 11:40:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:53.881 11:40:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:53.881 11:40:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:53.881 11:40:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:53.882 11:40:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:53.882 11:40:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:53.882 11:40:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:53.882 11:40:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:53.882 11:40:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:53.882 11:40:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:53.882 11:40:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:53.882 11:40:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:53.882 11:40:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:53.882 11:40:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:53.882 11:40:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.882 11:40:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.882 11:40:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.882 11:40:13 -- paths/export.sh@5 -- # export PATH 00:15:53.882 11:40:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.882 11:40:13 -- nvmf/common.sh@46 -- # : 0 00:15:53.882 11:40:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:53.882 11:40:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:53.882 11:40:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:53.882 11:40:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:53.882 11:40:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:53.882 11:40:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:53.882 11:40:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:53.882 11:40:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:53.882 11:40:13 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:53.882 11:40:13 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:53.882 11:40:13 -- target/nmic.sh@14 -- # nvmftestinit 00:15:53.882 11:40:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:53.882 11:40:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:53.882 11:40:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:53.882 11:40:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:53.882 11:40:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:53.882 11:40:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:53.882 11:40:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:53.882 11:40:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:53.882 11:40:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:53.882 11:40:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:53.882 11:40:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:53.882 11:40:13 -- common/autotest_common.sh@10 -- # set +x 00:15:55.785 11:40:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:55.785 11:40:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:55.785 11:40:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:55.785 11:40:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:55.785 11:40:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:55.785 11:40:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:55.785 11:40:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:55.785 11:40:15 -- nvmf/common.sh@294 -- # net_devs=() 00:15:55.785 11:40:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:55.785 11:40:15 -- nvmf/common.sh@295 -- # e810=() 00:15:55.785 11:40:15 -- nvmf/common.sh@295 -- # local -ga e810 00:15:55.785 11:40:15 -- nvmf/common.sh@296 -- # x722=() 00:15:55.785 11:40:15 -- nvmf/common.sh@296 -- # local -ga x722 00:15:55.785 11:40:15 -- nvmf/common.sh@297 -- # mlx=() 00:15:55.785 11:40:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:55.785 11:40:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:55.785 11:40:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:55.785 11:40:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:55.785 11:40:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:55.785 11:40:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:55.785 11:40:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:55.785 11:40:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:55.785 11:40:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:55.785 11:40:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:55.785 11:40:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:55.785 11:40:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:55.785 11:40:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:55.785 11:40:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:55.785 11:40:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:55.785 11:40:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:55.785 11:40:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:55.785 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:55.785 11:40:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:55.785 11:40:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:55.785 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:55.785 11:40:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:55.785 11:40:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:55.785 11:40:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:55.785 11:40:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:55.785 11:40:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:55.785 11:40:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:55.785 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:55.785 11:40:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:55.785 11:40:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:55.785 11:40:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:55.785 11:40:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:55.785 11:40:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:55.785 11:40:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:55.785 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:55.785 11:40:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:55.785 11:40:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:55.785 11:40:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:55.785 11:40:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:55.785 11:40:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:55.785 11:40:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:55.785 11:40:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:55.785 11:40:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:55.785 11:40:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:55.785 11:40:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:55.785 11:40:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:55.785 11:40:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:55.785 11:40:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:55.785 11:40:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:55.785 11:40:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:55.785 11:40:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:55.785 11:40:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:55.785 11:40:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:56.044 11:40:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:56.044 11:40:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:56.044 11:40:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:56.044 11:40:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:56.044 11:40:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:56.044 11:40:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:56.044 11:40:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:56.044 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:56.044 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:15:56.044 00:15:56.044 --- 10.0.0.2 ping statistics --- 00:15:56.044 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:56.044 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:15:56.044 11:40:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:56.044 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:56.044 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:15:56.044 00:15:56.044 --- 10.0.0.1 ping statistics --- 00:15:56.044 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:56.044 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:15:56.044 11:40:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:56.044 11:40:16 -- nvmf/common.sh@410 -- # return 0 00:15:56.044 11:40:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:56.044 11:40:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:56.044 11:40:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:56.044 11:40:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:56.044 11:40:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:56.044 11:40:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:56.044 11:40:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:56.044 11:40:16 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:15:56.044 11:40:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:56.044 11:40:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:56.044 11:40:16 -- common/autotest_common.sh@10 -- # set +x 00:15:56.044 11:40:16 -- nvmf/common.sh@469 -- # nvmfpid=3809629 00:15:56.044 11:40:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:56.044 11:40:16 -- nvmf/common.sh@470 -- # waitforlisten 3809629 00:15:56.044 11:40:16 -- common/autotest_common.sh@829 -- # '[' -z 3809629 ']' 00:15:56.044 11:40:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:56.044 11:40:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:56.044 11:40:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:56.044 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:56.044 11:40:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:56.044 11:40:16 -- common/autotest_common.sh@10 -- # set +x 00:15:56.044 [2024-11-28 11:40:16.074321] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:56.044 [2024-11-28 11:40:16.074393] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:56.303 EAL: No free 2048 kB hugepages reported on node 1 00:15:56.303 [2024-11-28 11:40:16.138117] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:56.303 [2024-11-28 11:40:16.245554] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:56.303 [2024-11-28 11:40:16.245726] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:56.303 [2024-11-28 11:40:16.245743] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:56.303 [2024-11-28 11:40:16.245756] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:56.303 [2024-11-28 11:40:16.245822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:56.303 [2024-11-28 11:40:16.245884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:56.303 [2024-11-28 11:40:16.245933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:56.303 [2024-11-28 11:40:16.245936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:57.237 11:40:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:57.237 11:40:17 -- common/autotest_common.sh@862 -- # return 0 00:15:57.237 11:40:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:57.237 11:40:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:57.237 11:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:57.238 11:40:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:57.238 11:40:17 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:57.238 11:40:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.238 11:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:57.238 [2024-11-28 11:40:17.130337] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:57.238 11:40:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.238 11:40:17 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:57.238 11:40:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.238 11:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:57.238 Malloc0 00:15:57.238 11:40:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.238 11:40:17 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:15:57.238 11:40:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.238 11:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:57.238 11:40:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.238 11:40:17 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:57.238 11:40:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.238 11:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:57.238 11:40:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.238 11:40:17 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:57.238 11:40:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.238 11:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:57.238 [2024-11-28 11:40:17.184122] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:57.238 11:40:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.238 11:40:17 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:15:57.238 test case1: single bdev can't be used in multiple subsystems 00:15:57.238 11:40:17 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:15:57.238 11:40:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.238 11:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:57.238 11:40:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.238 11:40:17 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:15:57.238 11:40:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.238 11:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:57.238 11:40:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.238 11:40:17 -- target/nmic.sh@28 -- # nmic_status=0 00:15:57.238 11:40:17 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:15:57.238 11:40:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.238 11:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:57.238 [2024-11-28 11:40:17.207985] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:15:57.238 [2024-11-28 11:40:17.208013] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:15:57.238 [2024-11-28 11:40:17.208044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:57.238 request: 00:15:57.238 { 00:15:57.238 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:15:57.238 "namespace": { 00:15:57.238 "bdev_name": "Malloc0" 00:15:57.238 }, 00:15:57.238 "method": "nvmf_subsystem_add_ns", 00:15:57.238 "req_id": 1 00:15:57.238 } 00:15:57.238 Got JSON-RPC error response 00:15:57.238 response: 00:15:57.238 { 00:15:57.238 "code": -32602, 00:15:57.238 "message": "Invalid parameters" 00:15:57.238 } 00:15:57.238 11:40:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:15:57.238 11:40:17 -- target/nmic.sh@29 -- # nmic_status=1 00:15:57.238 11:40:17 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:15:57.238 11:40:17 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:15:57.238 Adding namespace failed - expected result. 00:15:57.238 11:40:17 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:15:57.238 test case2: host connect to nvmf target in multiple paths 00:15:57.238 11:40:17 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:15:57.238 11:40:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.238 11:40:17 -- common/autotest_common.sh@10 -- # set +x 00:15:57.238 [2024-11-28 11:40:17.216101] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:15:57.238 11:40:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.238 11:40:17 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:58.171 11:40:17 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:15:58.736 11:40:18 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:15:58.736 11:40:18 -- common/autotest_common.sh@1187 -- # local i=0 00:15:58.736 11:40:18 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:58.736 11:40:18 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:15:58.736 11:40:18 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:00.634 11:40:20 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:00.634 11:40:20 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:00.634 11:40:20 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:00.634 11:40:20 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:00.634 11:40:20 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:00.634 11:40:20 -- common/autotest_common.sh@1197 -- # return 0 00:16:00.634 11:40:20 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:00.634 [global] 00:16:00.634 thread=1 00:16:00.634 invalidate=1 00:16:00.634 rw=write 00:16:00.634 time_based=1 00:16:00.634 runtime=1 00:16:00.634 ioengine=libaio 00:16:00.634 direct=1 00:16:00.634 bs=4096 00:16:00.634 iodepth=1 00:16:00.634 norandommap=0 00:16:00.634 numjobs=1 00:16:00.634 00:16:00.634 verify_dump=1 00:16:00.634 verify_backlog=512 00:16:00.634 verify_state_save=0 00:16:00.634 do_verify=1 00:16:00.634 verify=crc32c-intel 00:16:00.634 [job0] 00:16:00.634 filename=/dev/nvme0n1 00:16:00.634 Could not set queue depth (nvme0n1) 00:16:00.893 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:00.893 fio-3.35 00:16:00.893 Starting 1 thread 00:16:02.266 00:16:02.266 job0: (groupid=0, jobs=1): err= 0: pid=3810291: Thu Nov 28 11:40:21 2024 00:16:02.266 read: IOPS=992, BW=3969KiB/s (4065kB/s)(4136KiB/1042msec) 00:16:02.266 slat (nsec): min=5336, max=49171, avg=11777.34, stdev=5279.44 00:16:02.266 clat (usec): min=227, max=42039, avg=667.17, stdev=4048.05 00:16:02.266 lat (usec): min=232, max=42072, avg=678.95, stdev=4049.84 00:16:02.266 clat percentiles (usec): 00:16:02.266 | 1.00th=[ 235], 5.00th=[ 243], 10.00th=[ 247], 20.00th=[ 253], 00:16:02.266 | 30.00th=[ 258], 40.00th=[ 265], 50.00th=[ 269], 60.00th=[ 273], 00:16:02.266 | 70.00th=[ 277], 80.00th=[ 281], 90.00th=[ 289], 95.00th=[ 293], 00:16:02.266 | 99.00th=[ 355], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:16:02.266 | 99.99th=[42206] 00:16:02.266 write: IOPS=1474, BW=5896KiB/s (6038kB/s)(6144KiB/1042msec); 0 zone resets 00:16:02.266 slat (nsec): min=6744, max=58232, avg=16082.00, stdev=7722.10 00:16:02.267 clat (usec): min=152, max=373, avg=198.15, stdev=25.96 00:16:02.267 lat (usec): min=159, max=412, avg=214.23, stdev=32.06 00:16:02.267 clat percentiles (usec): 00:16:02.267 | 1.00th=[ 157], 5.00th=[ 165], 10.00th=[ 169], 20.00th=[ 176], 00:16:02.267 | 30.00th=[ 180], 40.00th=[ 190], 50.00th=[ 200], 60.00th=[ 204], 00:16:02.267 | 70.00th=[ 210], 80.00th=[ 217], 90.00th=[ 227], 95.00th=[ 239], 00:16:02.267 | 99.00th=[ 293], 99.50th=[ 310], 99.90th=[ 343], 99.95th=[ 375], 00:16:02.267 | 99.99th=[ 375] 00:16:02.267 bw ( KiB/s): min= 4088, max= 8200, per=100.00%, avg=6144.00, stdev=2907.62, samples=2 00:16:02.267 iops : min= 1022, max= 2050, avg=1536.00, stdev=726.91, samples=2 00:16:02.267 lat (usec) : 250=64.36%, 500=35.25% 00:16:02.267 lat (msec) : 50=0.39% 00:16:02.267 cpu : usr=2.79%, sys=4.71%, ctx=2570, majf=0, minf=1 00:16:02.267 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:02.267 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:02.267 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:02.267 issued rwts: total=1034,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:02.267 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:02.267 00:16:02.267 Run status group 0 (all jobs): 00:16:02.267 READ: bw=3969KiB/s (4065kB/s), 3969KiB/s-3969KiB/s (4065kB/s-4065kB/s), io=4136KiB (4235kB), run=1042-1042msec 00:16:02.267 WRITE: bw=5896KiB/s (6038kB/s), 5896KiB/s-5896KiB/s (6038kB/s-6038kB/s), io=6144KiB (6291kB), run=1042-1042msec 00:16:02.267 00:16:02.267 Disk stats (read/write): 00:16:02.267 nvme0n1: ios=1080/1536, merge=0/0, ticks=523/283, in_queue=806, util=91.48% 00:16:02.267 11:40:21 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:02.267 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:02.267 11:40:22 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:02.267 11:40:22 -- common/autotest_common.sh@1208 -- # local i=0 00:16:02.267 11:40:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:02.267 11:40:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:02.267 11:40:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:02.267 11:40:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:02.267 11:40:22 -- common/autotest_common.sh@1220 -- # return 0 00:16:02.267 11:40:22 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:02.267 11:40:22 -- target/nmic.sh@53 -- # nvmftestfini 00:16:02.267 11:40:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:02.267 11:40:22 -- nvmf/common.sh@116 -- # sync 00:16:02.267 11:40:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:02.267 11:40:22 -- nvmf/common.sh@119 -- # set +e 00:16:02.267 11:40:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:02.267 11:40:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:02.267 rmmod nvme_tcp 00:16:02.267 rmmod nvme_fabrics 00:16:02.267 rmmod nvme_keyring 00:16:02.267 11:40:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:02.267 11:40:22 -- nvmf/common.sh@123 -- # set -e 00:16:02.267 11:40:22 -- nvmf/common.sh@124 -- # return 0 00:16:02.267 11:40:22 -- nvmf/common.sh@477 -- # '[' -n 3809629 ']' 00:16:02.267 11:40:22 -- nvmf/common.sh@478 -- # killprocess 3809629 00:16:02.267 11:40:22 -- common/autotest_common.sh@936 -- # '[' -z 3809629 ']' 00:16:02.267 11:40:22 -- common/autotest_common.sh@940 -- # kill -0 3809629 00:16:02.267 11:40:22 -- common/autotest_common.sh@941 -- # uname 00:16:02.267 11:40:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:02.267 11:40:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3809629 00:16:02.267 11:40:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:02.267 11:40:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:02.267 11:40:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3809629' 00:16:02.267 killing process with pid 3809629 00:16:02.267 11:40:22 -- common/autotest_common.sh@955 -- # kill 3809629 00:16:02.267 11:40:22 -- common/autotest_common.sh@960 -- # wait 3809629 00:16:02.525 11:40:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:02.525 11:40:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:02.525 11:40:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:02.525 11:40:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:02.525 11:40:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:02.525 11:40:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:02.525 11:40:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:02.525 11:40:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:04.434 11:40:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:04.434 00:16:04.434 real 0m10.898s 00:16:04.434 user 0m25.638s 00:16:04.434 sys 0m2.550s 00:16:04.434 11:40:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:04.434 11:40:24 -- common/autotest_common.sh@10 -- # set +x 00:16:04.434 ************************************ 00:16:04.434 END TEST nvmf_nmic 00:16:04.434 ************************************ 00:16:04.434 11:40:24 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:04.434 11:40:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:04.434 11:40:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:04.434 11:40:24 -- common/autotest_common.sh@10 -- # set +x 00:16:04.434 ************************************ 00:16:04.434 START TEST nvmf_fio_target 00:16:04.434 ************************************ 00:16:04.434 11:40:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:04.714 * Looking for test storage... 00:16:04.714 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:04.714 11:40:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:04.714 11:40:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:04.714 11:40:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:04.714 11:40:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:04.714 11:40:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:04.714 11:40:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:04.714 11:40:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:04.714 11:40:24 -- scripts/common.sh@335 -- # IFS=.-: 00:16:04.714 11:40:24 -- scripts/common.sh@335 -- # read -ra ver1 00:16:04.714 11:40:24 -- scripts/common.sh@336 -- # IFS=.-: 00:16:04.714 11:40:24 -- scripts/common.sh@336 -- # read -ra ver2 00:16:04.714 11:40:24 -- scripts/common.sh@337 -- # local 'op=<' 00:16:04.714 11:40:24 -- scripts/common.sh@339 -- # ver1_l=2 00:16:04.714 11:40:24 -- scripts/common.sh@340 -- # ver2_l=1 00:16:04.714 11:40:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:04.714 11:40:24 -- scripts/common.sh@343 -- # case "$op" in 00:16:04.714 11:40:24 -- scripts/common.sh@344 -- # : 1 00:16:04.714 11:40:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:04.714 11:40:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:04.714 11:40:24 -- scripts/common.sh@364 -- # decimal 1 00:16:04.714 11:40:24 -- scripts/common.sh@352 -- # local d=1 00:16:04.714 11:40:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:04.714 11:40:24 -- scripts/common.sh@354 -- # echo 1 00:16:04.714 11:40:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:04.714 11:40:24 -- scripts/common.sh@365 -- # decimal 2 00:16:04.714 11:40:24 -- scripts/common.sh@352 -- # local d=2 00:16:04.714 11:40:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:04.714 11:40:24 -- scripts/common.sh@354 -- # echo 2 00:16:04.714 11:40:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:04.714 11:40:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:04.714 11:40:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:04.714 11:40:24 -- scripts/common.sh@367 -- # return 0 00:16:04.714 11:40:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:04.714 11:40:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:04.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:04.714 --rc genhtml_branch_coverage=1 00:16:04.714 --rc genhtml_function_coverage=1 00:16:04.714 --rc genhtml_legend=1 00:16:04.714 --rc geninfo_all_blocks=1 00:16:04.714 --rc geninfo_unexecuted_blocks=1 00:16:04.714 00:16:04.714 ' 00:16:04.714 11:40:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:04.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:04.714 --rc genhtml_branch_coverage=1 00:16:04.714 --rc genhtml_function_coverage=1 00:16:04.714 --rc genhtml_legend=1 00:16:04.714 --rc geninfo_all_blocks=1 00:16:04.714 --rc geninfo_unexecuted_blocks=1 00:16:04.714 00:16:04.714 ' 00:16:04.714 11:40:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:04.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:04.714 --rc genhtml_branch_coverage=1 00:16:04.714 --rc genhtml_function_coverage=1 00:16:04.714 --rc genhtml_legend=1 00:16:04.714 --rc geninfo_all_blocks=1 00:16:04.714 --rc geninfo_unexecuted_blocks=1 00:16:04.714 00:16:04.714 ' 00:16:04.714 11:40:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:04.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:04.714 --rc genhtml_branch_coverage=1 00:16:04.714 --rc genhtml_function_coverage=1 00:16:04.714 --rc genhtml_legend=1 00:16:04.714 --rc geninfo_all_blocks=1 00:16:04.714 --rc geninfo_unexecuted_blocks=1 00:16:04.714 00:16:04.714 ' 00:16:04.714 11:40:24 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:04.714 11:40:24 -- nvmf/common.sh@7 -- # uname -s 00:16:04.714 11:40:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:04.714 11:40:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:04.714 11:40:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:04.714 11:40:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:04.714 11:40:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:04.714 11:40:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:04.714 11:40:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:04.714 11:40:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:04.714 11:40:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:04.714 11:40:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:04.714 11:40:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:04.714 11:40:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:04.714 11:40:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:04.714 11:40:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:04.714 11:40:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:04.714 11:40:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:04.714 11:40:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:04.714 11:40:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:04.714 11:40:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:04.714 11:40:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:04.714 11:40:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:04.715 11:40:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:04.715 11:40:24 -- paths/export.sh@5 -- # export PATH 00:16:04.715 11:40:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:04.715 11:40:24 -- nvmf/common.sh@46 -- # : 0 00:16:04.715 11:40:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:04.715 11:40:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:04.715 11:40:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:04.715 11:40:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:04.715 11:40:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:04.715 11:40:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:04.715 11:40:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:04.715 11:40:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:04.715 11:40:24 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:04.715 11:40:24 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:04.715 11:40:24 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:04.715 11:40:24 -- target/fio.sh@16 -- # nvmftestinit 00:16:04.715 11:40:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:04.715 11:40:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:04.715 11:40:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:04.715 11:40:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:04.715 11:40:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:04.715 11:40:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:04.715 11:40:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:04.715 11:40:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:04.715 11:40:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:04.715 11:40:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:04.715 11:40:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:04.715 11:40:24 -- common/autotest_common.sh@10 -- # set +x 00:16:06.612 11:40:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:06.612 11:40:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:06.612 11:40:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:06.612 11:40:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:06.613 11:40:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:06.613 11:40:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:06.613 11:40:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:06.613 11:40:26 -- nvmf/common.sh@294 -- # net_devs=() 00:16:06.613 11:40:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:06.613 11:40:26 -- nvmf/common.sh@295 -- # e810=() 00:16:06.613 11:40:26 -- nvmf/common.sh@295 -- # local -ga e810 00:16:06.613 11:40:26 -- nvmf/common.sh@296 -- # x722=() 00:16:06.613 11:40:26 -- nvmf/common.sh@296 -- # local -ga x722 00:16:06.613 11:40:26 -- nvmf/common.sh@297 -- # mlx=() 00:16:06.613 11:40:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:06.613 11:40:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:06.613 11:40:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:06.613 11:40:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:06.613 11:40:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:06.613 11:40:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:06.613 11:40:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:06.613 11:40:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:06.613 11:40:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:06.613 11:40:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:06.613 11:40:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:06.613 11:40:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:06.613 11:40:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:06.613 11:40:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:06.613 11:40:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:06.613 11:40:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:06.613 11:40:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:06.613 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:06.613 11:40:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:06.613 11:40:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:06.613 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:06.613 11:40:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:06.613 11:40:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:06.613 11:40:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:06.613 11:40:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:06.613 11:40:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:06.613 11:40:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:06.613 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:06.613 11:40:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:06.613 11:40:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:06.613 11:40:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:06.613 11:40:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:06.613 11:40:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:06.613 11:40:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:06.613 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:06.613 11:40:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:06.613 11:40:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:06.613 11:40:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:06.613 11:40:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:06.613 11:40:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:06.613 11:40:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:06.613 11:40:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:06.613 11:40:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:06.613 11:40:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:06.613 11:40:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:06.613 11:40:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:06.613 11:40:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:06.613 11:40:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:06.613 11:40:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:06.613 11:40:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:06.613 11:40:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:06.613 11:40:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:06.613 11:40:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:06.896 11:40:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:06.897 11:40:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:06.897 11:40:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:06.897 11:40:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:06.897 11:40:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:06.897 11:40:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:06.897 11:40:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:06.897 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:06.897 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:16:06.897 00:16:06.897 --- 10.0.0.2 ping statistics --- 00:16:06.897 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:06.897 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:16:06.897 11:40:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:06.897 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:06.897 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:16:06.897 00:16:06.897 --- 10.0.0.1 ping statistics --- 00:16:06.897 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:06.897 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:16:06.897 11:40:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:06.897 11:40:26 -- nvmf/common.sh@410 -- # return 0 00:16:06.897 11:40:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:06.897 11:40:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:06.897 11:40:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:06.897 11:40:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:06.897 11:40:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:06.897 11:40:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:06.897 11:40:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:06.897 11:40:26 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:06.897 11:40:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:06.897 11:40:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:06.897 11:40:26 -- common/autotest_common.sh@10 -- # set +x 00:16:06.897 11:40:26 -- nvmf/common.sh@469 -- # nvmfpid=3812506 00:16:06.897 11:40:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:06.897 11:40:26 -- nvmf/common.sh@470 -- # waitforlisten 3812506 00:16:06.897 11:40:26 -- common/autotest_common.sh@829 -- # '[' -z 3812506 ']' 00:16:06.897 11:40:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:06.897 11:40:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:06.897 11:40:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:06.897 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:06.897 11:40:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:06.897 11:40:26 -- common/autotest_common.sh@10 -- # set +x 00:16:06.897 [2024-11-28 11:40:26.839389] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:06.897 [2024-11-28 11:40:26.839459] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:06.897 EAL: No free 2048 kB hugepages reported on node 1 00:16:06.897 [2024-11-28 11:40:26.908657] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:07.178 [2024-11-28 11:40:27.029375] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:07.178 [2024-11-28 11:40:27.029537] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:07.178 [2024-11-28 11:40:27.029567] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:07.178 [2024-11-28 11:40:27.029582] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:07.178 [2024-11-28 11:40:27.029640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:07.178 [2024-11-28 11:40:27.029671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:07.178 [2024-11-28 11:40:27.029724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:07.178 [2024-11-28 11:40:27.029728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:08.110 11:40:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:08.110 11:40:27 -- common/autotest_common.sh@862 -- # return 0 00:16:08.110 11:40:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:08.110 11:40:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:08.110 11:40:27 -- common/autotest_common.sh@10 -- # set +x 00:16:08.110 11:40:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:08.110 11:40:27 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:08.110 [2024-11-28 11:40:28.158285] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:08.368 11:40:28 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:08.627 11:40:28 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:08.627 11:40:28 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:08.885 11:40:28 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:08.885 11:40:28 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:09.143 11:40:28 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:09.143 11:40:28 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:09.400 11:40:29 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:09.400 11:40:29 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:09.658 11:40:29 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:09.916 11:40:29 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:09.916 11:40:29 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:10.175 11:40:30 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:10.175 11:40:30 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:10.432 11:40:30 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:10.432 11:40:30 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:10.690 11:40:30 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:10.947 11:40:30 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:10.947 11:40:30 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:11.205 11:40:31 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:11.205 11:40:31 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:11.464 11:40:31 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:11.721 [2024-11-28 11:40:31.552917] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:11.721 11:40:31 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:11.980 11:40:31 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:12.237 11:40:32 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:12.802 11:40:32 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:12.802 11:40:32 -- common/autotest_common.sh@1187 -- # local i=0 00:16:12.802 11:40:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:12.802 11:40:32 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:12.802 11:40:32 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:12.802 11:40:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:14.708 11:40:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:14.708 11:40:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:14.708 11:40:34 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:14.967 11:40:34 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:14.967 11:40:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:14.967 11:40:34 -- common/autotest_common.sh@1197 -- # return 0 00:16:14.967 11:40:34 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:14.967 [global] 00:16:14.967 thread=1 00:16:14.967 invalidate=1 00:16:14.967 rw=write 00:16:14.967 time_based=1 00:16:14.967 runtime=1 00:16:14.967 ioengine=libaio 00:16:14.967 direct=1 00:16:14.967 bs=4096 00:16:14.967 iodepth=1 00:16:14.967 norandommap=0 00:16:14.967 numjobs=1 00:16:14.967 00:16:14.967 verify_dump=1 00:16:14.967 verify_backlog=512 00:16:14.967 verify_state_save=0 00:16:14.967 do_verify=1 00:16:14.967 verify=crc32c-intel 00:16:14.967 [job0] 00:16:14.967 filename=/dev/nvme0n1 00:16:14.967 [job1] 00:16:14.967 filename=/dev/nvme0n2 00:16:14.967 [job2] 00:16:14.967 filename=/dev/nvme0n3 00:16:14.967 [job3] 00:16:14.967 filename=/dev/nvme0n4 00:16:14.967 Could not set queue depth (nvme0n1) 00:16:14.967 Could not set queue depth (nvme0n2) 00:16:14.967 Could not set queue depth (nvme0n3) 00:16:14.967 Could not set queue depth (nvme0n4) 00:16:14.967 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:14.967 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:14.967 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:14.967 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:14.967 fio-3.35 00:16:14.967 Starting 4 threads 00:16:16.352 00:16:16.352 job0: (groupid=0, jobs=1): err= 0: pid=3813618: Thu Nov 28 11:40:36 2024 00:16:16.352 read: IOPS=22, BW=89.5KiB/s (91.6kB/s)(92.0KiB/1028msec) 00:16:16.352 slat (nsec): min=8297, max=29379, avg=14415.74, stdev=3832.92 00:16:16.352 clat (usec): min=265, max=42154, avg=37849.20, stdev=11829.69 00:16:16.352 lat (usec): min=280, max=42163, avg=37863.61, stdev=11829.82 00:16:16.352 clat percentiles (usec): 00:16:16.352 | 1.00th=[ 265], 5.00th=[ 523], 10.00th=[40633], 20.00th=[41157], 00:16:16.352 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:16.352 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:16.352 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:16.352 | 99.99th=[42206] 00:16:16.352 write: IOPS=498, BW=1992KiB/s (2040kB/s)(2048KiB/1028msec); 0 zone resets 00:16:16.352 slat (nsec): min=7531, max=75443, avg=23864.32, stdev=12004.35 00:16:16.352 clat (usec): min=157, max=531, avg=276.17, stdev=72.59 00:16:16.352 lat (usec): min=183, max=558, avg=300.03, stdev=71.29 00:16:16.352 clat percentiles (usec): 00:16:16.352 | 1.00th=[ 165], 5.00th=[ 178], 10.00th=[ 192], 20.00th=[ 206], 00:16:16.352 | 30.00th=[ 215], 40.00th=[ 235], 50.00th=[ 265], 60.00th=[ 310], 00:16:16.352 | 70.00th=[ 334], 80.00th=[ 351], 90.00th=[ 371], 95.00th=[ 383], 00:16:16.352 | 99.00th=[ 424], 99.50th=[ 437], 99.90th=[ 529], 99.95th=[ 529], 00:16:16.352 | 99.99th=[ 529] 00:16:16.352 bw ( KiB/s): min= 4096, max= 4096, per=22.93%, avg=4096.00, stdev= 0.00, samples=1 00:16:16.352 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:16.352 lat (usec) : 250=44.49%, 500=51.21%, 750=0.37% 00:16:16.352 lat (msec) : 50=3.93% 00:16:16.352 cpu : usr=0.58%, sys=1.17%, ctx=536, majf=0, minf=1 00:16:16.352 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:16.352 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.352 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.352 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:16.352 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:16.352 job1: (groupid=0, jobs=1): err= 0: pid=3813619: Thu Nov 28 11:40:36 2024 00:16:16.352 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:16:16.352 slat (nsec): min=5561, max=65590, avg=10263.25, stdev=5804.98 00:16:16.352 clat (usec): min=226, max=1018, avg=333.76, stdev=55.01 00:16:16.352 lat (usec): min=232, max=1024, avg=344.03, stdev=56.49 00:16:16.352 clat percentiles (usec): 00:16:16.352 | 1.00th=[ 243], 5.00th=[ 281], 10.00th=[ 289], 20.00th=[ 302], 00:16:16.352 | 30.00th=[ 310], 40.00th=[ 318], 50.00th=[ 326], 60.00th=[ 334], 00:16:16.352 | 70.00th=[ 343], 80.00th=[ 355], 90.00th=[ 375], 95.00th=[ 433], 00:16:16.353 | 99.00th=[ 537], 99.50th=[ 619], 99.90th=[ 775], 99.95th=[ 1020], 00:16:16.353 | 99.99th=[ 1020] 00:16:16.353 write: IOPS=2028, BW=8116KiB/s (8311kB/s)(8124KiB/1001msec); 0 zone resets 00:16:16.353 slat (nsec): min=7242, max=68154, avg=13970.91, stdev=7868.54 00:16:16.353 clat (usec): min=163, max=470, avg=212.04, stdev=39.02 00:16:16.353 lat (usec): min=171, max=504, avg=226.01, stdev=43.90 00:16:16.353 clat percentiles (usec): 00:16:16.353 | 1.00th=[ 169], 5.00th=[ 174], 10.00th=[ 178], 20.00th=[ 184], 00:16:16.353 | 30.00th=[ 190], 40.00th=[ 198], 50.00th=[ 204], 60.00th=[ 210], 00:16:16.353 | 70.00th=[ 217], 80.00th=[ 231], 90.00th=[ 258], 95.00th=[ 281], 00:16:16.353 | 99.00th=[ 375], 99.50th=[ 396], 99.90th=[ 441], 99.95th=[ 465], 00:16:16.353 | 99.99th=[ 469] 00:16:16.353 bw ( KiB/s): min= 8192, max= 8192, per=45.86%, avg=8192.00, stdev= 0.00, samples=1 00:16:16.353 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:16.353 lat (usec) : 250=50.88%, 500=48.44%, 750=0.62%, 1000=0.03% 00:16:16.353 lat (msec) : 2=0.03% 00:16:16.353 cpu : usr=3.50%, sys=5.60%, ctx=3568, majf=0, minf=1 00:16:16.353 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:16.353 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.353 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.353 issued rwts: total=1536,2031,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:16.353 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:16.353 job2: (groupid=0, jobs=1): err= 0: pid=3813620: Thu Nov 28 11:40:36 2024 00:16:16.353 read: IOPS=183, BW=734KiB/s (751kB/s)(736KiB/1003msec) 00:16:16.353 slat (nsec): min=6540, max=33963, avg=8768.87, stdev=3917.09 00:16:16.353 clat (usec): min=264, max=42214, avg=4679.12, stdev=12548.62 00:16:16.353 lat (usec): min=272, max=42223, avg=4687.89, stdev=12550.66 00:16:16.353 clat percentiles (usec): 00:16:16.353 | 1.00th=[ 265], 5.00th=[ 273], 10.00th=[ 285], 20.00th=[ 318], 00:16:16.353 | 30.00th=[ 330], 40.00th=[ 347], 50.00th=[ 371], 60.00th=[ 392], 00:16:16.353 | 70.00th=[ 474], 80.00th=[ 506], 90.00th=[40633], 95.00th=[41681], 00:16:16.353 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:16.353 | 99.99th=[42206] 00:16:16.353 write: IOPS=510, BW=2042KiB/s (2091kB/s)(2048KiB/1003msec); 0 zone resets 00:16:16.353 slat (nsec): min=7961, max=58836, avg=20529.58, stdev=10202.24 00:16:16.353 clat (usec): min=177, max=422, avg=246.60, stdev=46.80 00:16:16.353 lat (usec): min=187, max=449, avg=267.12, stdev=46.02 00:16:16.353 clat percentiles (usec): 00:16:16.353 | 1.00th=[ 184], 5.00th=[ 192], 10.00th=[ 202], 20.00th=[ 212], 00:16:16.353 | 30.00th=[ 221], 40.00th=[ 225], 50.00th=[ 233], 60.00th=[ 239], 00:16:16.353 | 70.00th=[ 258], 80.00th=[ 277], 90.00th=[ 322], 95.00th=[ 343], 00:16:16.353 | 99.00th=[ 383], 99.50th=[ 404], 99.90th=[ 424], 99.95th=[ 424], 00:16:16.353 | 99.99th=[ 424] 00:16:16.353 bw ( KiB/s): min= 4096, max= 4096, per=22.93%, avg=4096.00, stdev= 0.00, samples=1 00:16:16.353 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:16.353 lat (usec) : 250=49.43%, 500=44.25%, 750=3.16%, 1000=0.29% 00:16:16.353 lat (msec) : 10=0.14%, 50=2.73% 00:16:16.353 cpu : usr=0.30%, sys=1.50%, ctx=697, majf=0, minf=1 00:16:16.353 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:16.353 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.353 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.353 issued rwts: total=184,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:16.353 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:16.353 job3: (groupid=0, jobs=1): err= 0: pid=3813621: Thu Nov 28 11:40:36 2024 00:16:16.353 read: IOPS=1002, BW=4012KiB/s (4108kB/s)(4112KiB/1025msec) 00:16:16.353 slat (nsec): min=6011, max=52568, avg=11150.50, stdev=5385.10 00:16:16.353 clat (usec): min=256, max=42085, avg=606.72, stdev=3354.53 00:16:16.353 lat (usec): min=262, max=42093, avg=617.87, stdev=3354.65 00:16:16.353 clat percentiles (usec): 00:16:16.353 | 1.00th=[ 262], 5.00th=[ 269], 10.00th=[ 277], 20.00th=[ 285], 00:16:16.353 | 30.00th=[ 289], 40.00th=[ 302], 50.00th=[ 310], 60.00th=[ 318], 00:16:16.353 | 70.00th=[ 326], 80.00th=[ 351], 90.00th=[ 449], 95.00th=[ 482], 00:16:16.353 | 99.00th=[ 881], 99.50th=[41157], 99.90th=[41157], 99.95th=[42206], 00:16:16.353 | 99.99th=[42206] 00:16:16.353 write: IOPS=1498, BW=5994KiB/s (6138kB/s)(6144KiB/1025msec); 0 zone resets 00:16:16.353 slat (nsec): min=7785, max=81356, avg=14935.77, stdev=10884.66 00:16:16.353 clat (usec): min=145, max=494, avg=232.16, stdev=70.50 00:16:16.353 lat (usec): min=153, max=536, avg=247.09, stdev=78.80 00:16:16.353 clat percentiles (usec): 00:16:16.353 | 1.00th=[ 153], 5.00th=[ 157], 10.00th=[ 163], 20.00th=[ 174], 00:16:16.353 | 30.00th=[ 190], 40.00th=[ 200], 50.00th=[ 208], 60.00th=[ 217], 00:16:16.353 | 70.00th=[ 265], 80.00th=[ 289], 90.00th=[ 347], 95.00th=[ 383], 00:16:16.353 | 99.00th=[ 437], 99.50th=[ 449], 99.90th=[ 490], 99.95th=[ 494], 00:16:16.353 | 99.99th=[ 494] 00:16:16.353 bw ( KiB/s): min= 4096, max= 8192, per=34.39%, avg=6144.00, stdev=2896.31, samples=2 00:16:16.353 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:16:16.353 lat (usec) : 250=40.76%, 500=57.61%, 750=1.17%, 1000=0.16% 00:16:16.353 lat (msec) : 2=0.04%, 50=0.27% 00:16:16.353 cpu : usr=2.15%, sys=4.59%, ctx=2567, majf=0, minf=1 00:16:16.353 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:16.353 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.353 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.353 issued rwts: total=1028,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:16.353 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:16.353 00:16:16.353 Run status group 0 (all jobs): 00:16:16.353 READ: bw=10.5MiB/s (11.0MB/s), 89.5KiB/s-6138KiB/s (91.6kB/s-6285kB/s), io=10.8MiB (11.3MB), run=1001-1028msec 00:16:16.353 WRITE: bw=17.4MiB/s (18.3MB/s), 1992KiB/s-8116KiB/s (2040kB/s-8311kB/s), io=17.9MiB (18.8MB), run=1001-1028msec 00:16:16.353 00:16:16.353 Disk stats (read/write): 00:16:16.353 nvme0n1: ios=70/512, merge=0/0, ticks=1417/128, in_queue=1545, util=98.00% 00:16:16.353 nvme0n2: ios=1457/1536, merge=0/0, ticks=1423/316, in_queue=1739, util=98.37% 00:16:16.353 nvme0n3: ios=238/512, merge=0/0, ticks=1435/120, in_queue=1555, util=98.43% 00:16:16.353 nvme0n4: ios=1082/1504, merge=0/0, ticks=1162/331, in_queue=1493, util=98.32% 00:16:16.353 11:40:36 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:16.353 [global] 00:16:16.353 thread=1 00:16:16.353 invalidate=1 00:16:16.353 rw=randwrite 00:16:16.353 time_based=1 00:16:16.353 runtime=1 00:16:16.353 ioengine=libaio 00:16:16.353 direct=1 00:16:16.353 bs=4096 00:16:16.353 iodepth=1 00:16:16.353 norandommap=0 00:16:16.353 numjobs=1 00:16:16.353 00:16:16.353 verify_dump=1 00:16:16.353 verify_backlog=512 00:16:16.353 verify_state_save=0 00:16:16.353 do_verify=1 00:16:16.353 verify=crc32c-intel 00:16:16.353 [job0] 00:16:16.353 filename=/dev/nvme0n1 00:16:16.353 [job1] 00:16:16.353 filename=/dev/nvme0n2 00:16:16.353 [job2] 00:16:16.353 filename=/dev/nvme0n3 00:16:16.353 [job3] 00:16:16.353 filename=/dev/nvme0n4 00:16:16.353 Could not set queue depth (nvme0n1) 00:16:16.353 Could not set queue depth (nvme0n2) 00:16:16.353 Could not set queue depth (nvme0n3) 00:16:16.353 Could not set queue depth (nvme0n4) 00:16:16.612 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:16.612 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:16.612 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:16.612 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:16.612 fio-3.35 00:16:16.612 Starting 4 threads 00:16:17.989 00:16:17.989 job0: (groupid=0, jobs=1): err= 0: pid=3813852: Thu Nov 28 11:40:37 2024 00:16:17.989 read: IOPS=522, BW=2090KiB/s (2140kB/s)(2100KiB/1005msec) 00:16:17.989 slat (nsec): min=5772, max=46859, avg=11665.26, stdev=5932.93 00:16:17.989 clat (usec): min=227, max=42000, avg=1472.97, stdev=6515.20 00:16:17.989 lat (usec): min=233, max=42028, avg=1484.64, stdev=6516.30 00:16:17.989 clat percentiles (usec): 00:16:17.989 | 1.00th=[ 239], 5.00th=[ 265], 10.00th=[ 273], 20.00th=[ 289], 00:16:17.989 | 30.00th=[ 310], 40.00th=[ 408], 50.00th=[ 416], 60.00th=[ 420], 00:16:17.989 | 70.00th=[ 433], 80.00th=[ 494], 90.00th=[ 523], 95.00th=[ 553], 00:16:17.989 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:17.989 | 99.99th=[42206] 00:16:17.989 write: IOPS=1018, BW=4076KiB/s (4173kB/s)(4096KiB/1005msec); 0 zone resets 00:16:17.989 slat (nsec): min=7294, max=43029, avg=11886.90, stdev=6389.16 00:16:17.989 clat (usec): min=147, max=3257, avg=203.20, stdev=111.66 00:16:17.989 lat (usec): min=155, max=3265, avg=215.09, stdev=112.53 00:16:17.989 clat percentiles (usec): 00:16:17.989 | 1.00th=[ 153], 5.00th=[ 159], 10.00th=[ 161], 20.00th=[ 167], 00:16:17.989 | 30.00th=[ 174], 40.00th=[ 182], 50.00th=[ 190], 60.00th=[ 196], 00:16:17.989 | 70.00th=[ 202], 80.00th=[ 215], 90.00th=[ 255], 95.00th=[ 273], 00:16:17.989 | 99.00th=[ 404], 99.50th=[ 441], 99.90th=[ 1188], 99.95th=[ 3261], 00:16:17.989 | 99.99th=[ 3261] 00:16:17.989 bw ( KiB/s): min= 8192, max= 8192, per=50.80%, avg=8192.00, stdev= 0.00, samples=1 00:16:17.989 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:17.989 lat (usec) : 250=59.59%, 500=34.09%, 750=4.78%, 1000=0.39% 00:16:17.989 lat (msec) : 2=0.13%, 4=0.13%, 50=0.90% 00:16:17.989 cpu : usr=1.20%, sys=2.59%, ctx=1550, majf=0, minf=1 00:16:17.989 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:17.989 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:17.989 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:17.989 issued rwts: total=525,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:17.989 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:17.989 job1: (groupid=0, jobs=1): err= 0: pid=3813853: Thu Nov 28 11:40:37 2024 00:16:17.989 read: IOPS=1927, BW=7708KiB/s (7893kB/s)(7716KiB/1001msec) 00:16:17.989 slat (nsec): min=4299, max=46598, avg=9187.91, stdev=5048.52 00:16:17.989 clat (usec): min=220, max=1320, avg=287.26, stdev=57.76 00:16:17.989 lat (usec): min=226, max=1328, avg=296.45, stdev=59.24 00:16:17.989 clat percentiles (usec): 00:16:17.989 | 1.00th=[ 231], 5.00th=[ 245], 10.00th=[ 251], 20.00th=[ 262], 00:16:17.989 | 30.00th=[ 269], 40.00th=[ 277], 50.00th=[ 281], 60.00th=[ 285], 00:16:17.989 | 70.00th=[ 293], 80.00th=[ 302], 90.00th=[ 322], 95.00th=[ 334], 00:16:17.989 | 99.00th=[ 408], 99.50th=[ 553], 99.90th=[ 1319], 99.95th=[ 1319], 00:16:17.989 | 99.99th=[ 1319] 00:16:17.989 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:16:17.989 slat (nsec): min=5534, max=46858, avg=10740.45, stdev=5528.17 00:16:17.989 clat (usec): min=137, max=426, avg=192.41, stdev=29.34 00:16:17.989 lat (usec): min=146, max=439, avg=203.15, stdev=29.56 00:16:17.989 clat percentiles (usec): 00:16:17.989 | 1.00th=[ 145], 5.00th=[ 153], 10.00th=[ 159], 20.00th=[ 174], 00:16:17.989 | 30.00th=[ 182], 40.00th=[ 186], 50.00th=[ 190], 60.00th=[ 194], 00:16:17.989 | 70.00th=[ 200], 80.00th=[ 206], 90.00th=[ 225], 95.00th=[ 239], 00:16:17.989 | 99.00th=[ 293], 99.50th=[ 371], 99.90th=[ 404], 99.95th=[ 424], 00:16:17.989 | 99.99th=[ 429] 00:16:17.989 bw ( KiB/s): min= 8192, max= 8192, per=50.80%, avg=8192.00, stdev= 0.00, samples=1 00:16:17.989 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:17.989 lat (usec) : 250=54.26%, 500=45.46%, 750=0.10%, 1000=0.08% 00:16:17.989 lat (msec) : 2=0.10% 00:16:17.989 cpu : usr=3.50%, sys=4.50%, ctx=3977, majf=0, minf=1 00:16:17.989 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:17.989 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:17.989 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:17.989 issued rwts: total=1929,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:17.989 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:17.989 job2: (groupid=0, jobs=1): err= 0: pid=3813854: Thu Nov 28 11:40:37 2024 00:16:17.989 read: IOPS=21, BW=86.6KiB/s (88.7kB/s)(88.0KiB/1016msec) 00:16:17.989 slat (nsec): min=6543, max=35924, avg=17536.41, stdev=7821.06 00:16:17.989 clat (usec): min=40700, max=41042, avg=40969.16, stdev=64.91 00:16:17.989 lat (usec): min=40706, max=41078, avg=40986.69, stdev=67.52 00:16:17.989 clat percentiles (usec): 00:16:17.989 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:17.989 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:17.989 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:17.989 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:17.989 | 99.99th=[41157] 00:16:17.990 write: IOPS=503, BW=2016KiB/s (2064kB/s)(2048KiB/1016msec); 0 zone resets 00:16:17.990 slat (nsec): min=6248, max=34662, avg=12258.82, stdev=5707.79 00:16:17.990 clat (usec): min=169, max=322, avg=207.63, stdev=19.81 00:16:17.990 lat (usec): min=176, max=330, avg=219.89, stdev=20.87 00:16:17.990 clat percentiles (usec): 00:16:17.990 | 1.00th=[ 178], 5.00th=[ 184], 10.00th=[ 188], 20.00th=[ 192], 00:16:17.990 | 30.00th=[ 196], 40.00th=[ 200], 50.00th=[ 204], 60.00th=[ 208], 00:16:17.990 | 70.00th=[ 215], 80.00th=[ 221], 90.00th=[ 235], 95.00th=[ 249], 00:16:17.990 | 99.00th=[ 265], 99.50th=[ 306], 99.90th=[ 322], 99.95th=[ 322], 00:16:17.990 | 99.99th=[ 322] 00:16:17.990 bw ( KiB/s): min= 4096, max= 4096, per=25.40%, avg=4096.00, stdev= 0.00, samples=1 00:16:17.990 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:17.990 lat (usec) : 250=92.13%, 500=3.75% 00:16:17.990 lat (msec) : 50=4.12% 00:16:17.990 cpu : usr=0.30%, sys=0.59%, ctx=535, majf=0, minf=1 00:16:17.990 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:17.990 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:17.990 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:17.990 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:17.990 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:17.990 job3: (groupid=0, jobs=1): err= 0: pid=3813855: Thu Nov 28 11:40:37 2024 00:16:17.990 read: IOPS=20, BW=82.8KiB/s (84.8kB/s)(84.0KiB/1014msec) 00:16:17.990 slat (nsec): min=12697, max=34959, avg=19229.71, stdev=8487.18 00:16:17.990 clat (usec): min=40930, max=42022, avg=41670.34, stdev=464.37 00:16:17.990 lat (usec): min=40953, max=42049, avg=41689.57, stdev=463.42 00:16:17.990 clat percentiles (usec): 00:16:17.990 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:17.990 | 30.00th=[41681], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:16:17.990 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:17.990 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:17.990 | 99.99th=[42206] 00:16:17.990 write: IOPS=504, BW=2020KiB/s (2068kB/s)(2048KiB/1014msec); 0 zone resets 00:16:17.990 slat (nsec): min=7587, max=55583, avg=15244.88, stdev=7775.87 00:16:17.990 clat (usec): min=173, max=504, avg=251.00, stdev=54.00 00:16:17.990 lat (usec): min=181, max=547, avg=266.25, stdev=56.58 00:16:17.990 clat percentiles (usec): 00:16:17.990 | 1.00th=[ 182], 5.00th=[ 190], 10.00th=[ 198], 20.00th=[ 208], 00:16:17.990 | 30.00th=[ 215], 40.00th=[ 227], 50.00th=[ 237], 60.00th=[ 258], 00:16:17.990 | 70.00th=[ 273], 80.00th=[ 281], 90.00th=[ 314], 95.00th=[ 379], 00:16:17.990 | 99.00th=[ 416], 99.50th=[ 429], 99.90th=[ 506], 99.95th=[ 506], 00:16:17.990 | 99.99th=[ 506] 00:16:17.990 bw ( KiB/s): min= 4096, max= 4096, per=25.40%, avg=4096.00, stdev= 0.00, samples=1 00:16:17.990 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:17.990 lat (usec) : 250=54.22%, 500=41.65%, 750=0.19% 00:16:17.990 lat (msec) : 50=3.94% 00:16:17.990 cpu : usr=0.79%, sys=0.69%, ctx=534, majf=0, minf=1 00:16:17.990 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:17.990 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:17.990 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:17.990 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:17.990 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:17.990 00:16:17.990 Run status group 0 (all jobs): 00:16:17.990 READ: bw=9831KiB/s (10.1MB/s), 82.8KiB/s-7708KiB/s (84.8kB/s-7893kB/s), io=9988KiB (10.2MB), run=1001-1016msec 00:16:17.990 WRITE: bw=15.7MiB/s (16.5MB/s), 2016KiB/s-8184KiB/s (2064kB/s-8380kB/s), io=16.0MiB (16.8MB), run=1001-1016msec 00:16:17.990 00:16:17.990 Disk stats (read/write): 00:16:17.990 nvme0n1: ios=561/1024, merge=0/0, ticks=1017/193, in_queue=1210, util=97.19% 00:16:17.990 nvme0n2: ios=1551/1995, merge=0/0, ticks=432/350, in_queue=782, util=87.01% 00:16:17.990 nvme0n3: ios=76/512, merge=0/0, ticks=1067/105, in_queue=1172, util=98.65% 00:16:17.990 nvme0n4: ios=44/512, merge=0/0, ticks=1673/125, in_queue=1798, util=98.64% 00:16:17.990 11:40:37 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:17.990 [global] 00:16:17.990 thread=1 00:16:17.990 invalidate=1 00:16:17.990 rw=write 00:16:17.990 time_based=1 00:16:17.990 runtime=1 00:16:17.990 ioengine=libaio 00:16:17.990 direct=1 00:16:17.990 bs=4096 00:16:17.990 iodepth=128 00:16:17.990 norandommap=0 00:16:17.990 numjobs=1 00:16:17.990 00:16:17.990 verify_dump=1 00:16:17.990 verify_backlog=512 00:16:17.990 verify_state_save=0 00:16:17.990 do_verify=1 00:16:17.990 verify=crc32c-intel 00:16:17.990 [job0] 00:16:17.990 filename=/dev/nvme0n1 00:16:17.990 [job1] 00:16:17.990 filename=/dev/nvme0n2 00:16:17.990 [job2] 00:16:17.990 filename=/dev/nvme0n3 00:16:17.990 [job3] 00:16:17.990 filename=/dev/nvme0n4 00:16:17.990 Could not set queue depth (nvme0n1) 00:16:17.990 Could not set queue depth (nvme0n2) 00:16:17.990 Could not set queue depth (nvme0n3) 00:16:17.990 Could not set queue depth (nvme0n4) 00:16:17.990 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:17.990 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:17.990 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:17.990 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:17.990 fio-3.35 00:16:17.990 Starting 4 threads 00:16:19.366 00:16:19.367 job0: (groupid=0, jobs=1): err= 0: pid=3814109: Thu Nov 28 11:40:39 2024 00:16:19.367 read: IOPS=2069, BW=8279KiB/s (8477kB/s)(8320KiB/1005msec) 00:16:19.367 slat (usec): min=3, max=13106, avg=220.81, stdev=1161.64 00:16:19.367 clat (usec): min=756, max=77026, avg=29229.95, stdev=14245.97 00:16:19.367 lat (usec): min=6071, max=77053, avg=29450.77, stdev=14273.35 00:16:19.367 clat percentiles (usec): 00:16:19.367 | 1.00th=[ 7898], 5.00th=[ 9503], 10.00th=[10159], 20.00th=[17957], 00:16:19.367 | 30.00th=[20055], 40.00th=[26870], 50.00th=[27919], 60.00th=[31851], 00:16:19.367 | 70.00th=[34341], 80.00th=[36439], 90.00th=[42730], 95.00th=[62653], 00:16:19.367 | 99.00th=[76022], 99.50th=[76022], 99.90th=[77071], 99.95th=[77071], 00:16:19.367 | 99.99th=[77071] 00:16:19.367 write: IOPS=2547, BW=9.95MiB/s (10.4MB/s)(10.0MiB/1005msec); 0 zone resets 00:16:19.367 slat (usec): min=4, max=16429, avg=203.19, stdev=949.36 00:16:19.367 clat (usec): min=7571, max=54988, avg=25828.60, stdev=12115.04 00:16:19.367 lat (usec): min=7589, max=62578, avg=26031.79, stdev=12199.79 00:16:19.367 clat percentiles (usec): 00:16:19.367 | 1.00th=[ 7832], 5.00th=[ 8455], 10.00th=[ 9634], 20.00th=[11076], 00:16:19.367 | 30.00th=[19006], 40.00th=[20317], 50.00th=[24511], 60.00th=[28181], 00:16:19.367 | 70.00th=[32637], 80.00th=[38536], 90.00th=[43779], 95.00th=[46924], 00:16:19.367 | 99.00th=[51119], 99.50th=[52691], 99.90th=[54789], 99.95th=[54789], 00:16:19.367 | 99.99th=[54789] 00:16:19.367 bw ( KiB/s): min= 7680, max=12032, per=17.39%, avg=9856.00, stdev=3077.33, samples=2 00:16:19.367 iops : min= 1920, max= 3008, avg=2464.00, stdev=769.33, samples=2 00:16:19.367 lat (usec) : 1000=0.02% 00:16:19.367 lat (msec) : 10=11.25%, 20=24.14%, 50=61.19%, 100=3.41% 00:16:19.367 cpu : usr=2.79%, sys=5.18%, ctx=331, majf=0, minf=1 00:16:19.367 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:16:19.367 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.367 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:19.367 issued rwts: total=2080,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:19.367 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:19.367 job1: (groupid=0, jobs=1): err= 0: pid=3814117: Thu Nov 28 11:40:39 2024 00:16:19.367 read: IOPS=4083, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1003msec) 00:16:19.367 slat (usec): min=3, max=6307, avg=105.15, stdev=550.97 00:16:19.367 clat (usec): min=7752, max=26969, avg=13627.02, stdev=2752.84 00:16:19.367 lat (usec): min=7758, max=30196, avg=13732.17, stdev=2796.80 00:16:19.367 clat percentiles (usec): 00:16:19.367 | 1.00th=[ 8848], 5.00th=[ 9765], 10.00th=[10290], 20.00th=[11600], 00:16:19.367 | 30.00th=[12387], 40.00th=[12780], 50.00th=[13304], 60.00th=[13829], 00:16:19.367 | 70.00th=[14484], 80.00th=[15270], 90.00th=[17171], 95.00th=[19006], 00:16:19.367 | 99.00th=[21103], 99.50th=[22152], 99.90th=[26870], 99.95th=[26870], 00:16:19.367 | 99.99th=[26870] 00:16:19.367 write: IOPS=4336, BW=16.9MiB/s (17.8MB/s)(17.0MiB/1003msec); 0 zone resets 00:16:19.367 slat (usec): min=3, max=23202, avg=118.57, stdev=776.85 00:16:19.367 clat (usec): min=321, max=63733, avg=16127.31, stdev=7129.19 00:16:19.367 lat (usec): min=537, max=63785, avg=16245.88, stdev=7191.64 00:16:19.367 clat percentiles (usec): 00:16:19.367 | 1.00th=[ 3687], 5.00th=[ 6390], 10.00th=[ 8717], 20.00th=[11731], 00:16:19.367 | 30.00th=[12911], 40.00th=[14353], 50.00th=[15008], 60.00th=[16909], 00:16:19.367 | 70.00th=[19268], 80.00th=[19792], 90.00th=[20317], 95.00th=[23462], 00:16:19.367 | 99.00th=[46924], 99.50th=[46924], 99.90th=[47449], 99.95th=[47449], 00:16:19.367 | 99.99th=[63701] 00:16:19.367 bw ( KiB/s): min=16384, max=17392, per=29.79%, avg=16888.00, stdev=712.76, samples=2 00:16:19.367 iops : min= 4096, max= 4348, avg=4222.00, stdev=178.19, samples=2 00:16:19.367 lat (usec) : 500=0.01%, 750=0.02% 00:16:19.367 lat (msec) : 4=0.88%, 10=10.30%, 20=78.68%, 50=10.09%, 100=0.02% 00:16:19.367 cpu : usr=4.09%, sys=8.78%, ctx=406, majf=0, minf=1 00:16:19.367 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:19.367 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.367 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:19.367 issued rwts: total=4096,4350,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:19.367 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:19.367 job2: (groupid=0, jobs=1): err= 0: pid=3814155: Thu Nov 28 11:40:39 2024 00:16:19.367 read: IOPS=2549, BW=9.96MiB/s (10.4MB/s)(10.0MiB/1004msec) 00:16:19.367 slat (usec): min=3, max=11867, avg=189.15, stdev=949.80 00:16:19.367 clat (usec): min=9040, max=48178, avg=24166.41, stdev=8636.04 00:16:19.367 lat (usec): min=10065, max=48183, avg=24355.56, stdev=8658.01 00:16:19.367 clat percentiles (usec): 00:16:19.367 | 1.00th=[10421], 5.00th=[11994], 10.00th=[12780], 20.00th=[14484], 00:16:19.367 | 30.00th=[19530], 40.00th=[20055], 50.00th=[23200], 60.00th=[27395], 00:16:19.367 | 70.00th=[29230], 80.00th=[31589], 90.00th=[34341], 95.00th=[38011], 00:16:19.367 | 99.00th=[47449], 99.50th=[47973], 99.90th=[47973], 99.95th=[47973], 00:16:19.367 | 99.99th=[47973] 00:16:19.367 write: IOPS=2639, BW=10.3MiB/s (10.8MB/s)(10.4MiB/1004msec); 0 zone resets 00:16:19.367 slat (usec): min=4, max=23968, avg=185.12, stdev=1050.92 00:16:19.367 clat (usec): min=3347, max=78076, avg=23751.90, stdev=11223.42 00:16:19.367 lat (usec): min=4117, max=78096, avg=23937.01, stdev=11267.87 00:16:19.367 clat percentiles (usec): 00:16:19.367 | 1.00th=[ 6652], 5.00th=[12387], 10.00th=[13435], 20.00th=[18744], 00:16:19.367 | 30.00th=[19792], 40.00th=[20055], 50.00th=[21103], 60.00th=[23462], 00:16:19.367 | 70.00th=[26346], 80.00th=[28967], 90.00th=[30802], 95.00th=[35914], 00:16:19.367 | 99.00th=[78119], 99.50th=[78119], 99.90th=[78119], 99.95th=[78119], 00:16:19.367 | 99.99th=[78119] 00:16:19.367 bw ( KiB/s): min= 8192, max=12288, per=18.06%, avg=10240.00, stdev=2896.31, samples=2 00:16:19.367 iops : min= 2048, max= 3072, avg=2560.00, stdev=724.08, samples=2 00:16:19.367 lat (msec) : 4=0.02%, 10=1.54%, 20=37.24%, 50=59.37%, 100=1.84% 00:16:19.367 cpu : usr=3.59%, sys=4.89%, ctx=313, majf=0, minf=1 00:16:19.367 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:16:19.367 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.367 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:19.367 issued rwts: total=2560,2650,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:19.367 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:19.367 job3: (groupid=0, jobs=1): err= 0: pid=3814166: Thu Nov 28 11:40:39 2024 00:16:19.367 read: IOPS=4585, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1005msec) 00:16:19.367 slat (usec): min=2, max=14722, avg=105.12, stdev=635.50 00:16:19.367 clat (usec): min=5004, max=31831, avg=13576.35, stdev=2932.14 00:16:19.367 lat (usec): min=5013, max=31837, avg=13681.47, stdev=2991.71 00:16:19.367 clat percentiles (usec): 00:16:19.367 | 1.00th=[ 5997], 5.00th=[ 9765], 10.00th=[10814], 20.00th=[11600], 00:16:19.367 | 30.00th=[12387], 40.00th=[12911], 50.00th=[13304], 60.00th=[13566], 00:16:19.367 | 70.00th=[13960], 80.00th=[15533], 90.00th=[17695], 95.00th=[18220], 00:16:19.367 | 99.00th=[22152], 99.50th=[23987], 99.90th=[31851], 99.95th=[31851], 00:16:19.367 | 99.99th=[31851] 00:16:19.367 write: IOPS=4660, BW=18.2MiB/s (19.1MB/s)(18.3MiB/1005msec); 0 zone resets 00:16:19.367 slat (usec): min=3, max=12659, avg=98.05, stdev=627.59 00:16:19.367 clat (usec): min=743, max=37012, avg=13867.42, stdev=4567.13 00:16:19.367 lat (usec): min=927, max=37023, avg=13965.47, stdev=4594.41 00:16:19.367 clat percentiles (usec): 00:16:19.367 | 1.00th=[ 5997], 5.00th=[ 7832], 10.00th=[ 9765], 20.00th=[11338], 00:16:19.367 | 30.00th=[11731], 40.00th=[11863], 50.00th=[12125], 60.00th=[13042], 00:16:19.367 | 70.00th=[15008], 80.00th=[17695], 90.00th=[19006], 95.00th=[21103], 00:16:19.367 | 99.00th=[31065], 99.50th=[31589], 99.90th=[36963], 99.95th=[36963], 00:16:19.367 | 99.99th=[36963] 00:16:19.367 bw ( KiB/s): min=16448, max=20416, per=32.51%, avg=18432.00, stdev=2805.80, samples=2 00:16:19.367 iops : min= 4112, max= 5104, avg=4608.00, stdev=701.45, samples=2 00:16:19.367 lat (usec) : 750=0.01%, 1000=0.04% 00:16:19.367 lat (msec) : 4=0.15%, 10=9.52%, 20=86.10%, 50=4.18% 00:16:19.367 cpu : usr=5.78%, sys=7.87%, ctx=350, majf=0, minf=1 00:16:19.367 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:19.367 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.367 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:19.367 issued rwts: total=4608,4684,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:19.367 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:19.367 00:16:19.367 Run status group 0 (all jobs): 00:16:19.367 READ: bw=51.9MiB/s (54.4MB/s), 8279KiB/s-17.9MiB/s (8477kB/s-18.8MB/s), io=52.1MiB (54.7MB), run=1003-1005msec 00:16:19.367 WRITE: bw=55.4MiB/s (58.1MB/s), 9.95MiB/s-18.2MiB/s (10.4MB/s-19.1MB/s), io=55.6MiB (58.3MB), run=1003-1005msec 00:16:19.367 00:16:19.367 Disk stats (read/write): 00:16:19.367 nvme0n1: ios=1831/2048, merge=0/0, ticks=14821/12652, in_queue=27473, util=98.20% 00:16:19.367 nvme0n2: ios=3112/3575, merge=0/0, ticks=22363/29520, in_queue=51883, util=97.36% 00:16:19.367 nvme0n3: ios=2006/2048, merge=0/0, ticks=13076/13189, in_queue=26265, util=90.49% 00:16:19.367 nvme0n4: ios=4096/4135, merge=0/0, ticks=31631/32093, in_queue=63724, util=89.67% 00:16:19.367 11:40:39 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:19.367 [global] 00:16:19.367 thread=1 00:16:19.367 invalidate=1 00:16:19.367 rw=randwrite 00:16:19.367 time_based=1 00:16:19.367 runtime=1 00:16:19.367 ioengine=libaio 00:16:19.367 direct=1 00:16:19.367 bs=4096 00:16:19.367 iodepth=128 00:16:19.367 norandommap=0 00:16:19.367 numjobs=1 00:16:19.367 00:16:19.367 verify_dump=1 00:16:19.367 verify_backlog=512 00:16:19.367 verify_state_save=0 00:16:19.367 do_verify=1 00:16:19.367 verify=crc32c-intel 00:16:19.367 [job0] 00:16:19.367 filename=/dev/nvme0n1 00:16:19.367 [job1] 00:16:19.367 filename=/dev/nvme0n2 00:16:19.367 [job2] 00:16:19.367 filename=/dev/nvme0n3 00:16:19.367 [job3] 00:16:19.367 filename=/dev/nvme0n4 00:16:19.367 Could not set queue depth (nvme0n1) 00:16:19.367 Could not set queue depth (nvme0n2) 00:16:19.367 Could not set queue depth (nvme0n3) 00:16:19.368 Could not set queue depth (nvme0n4) 00:16:19.368 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:19.368 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:19.368 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:19.368 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:19.368 fio-3.35 00:16:19.368 Starting 4 threads 00:16:20.742 00:16:20.742 job0: (groupid=0, jobs=1): err= 0: pid=3814449: Thu Nov 28 11:40:40 2024 00:16:20.742 read: IOPS=3752, BW=14.7MiB/s (15.4MB/s)(14.7MiB/1002msec) 00:16:20.742 slat (usec): min=2, max=29494, avg=122.80, stdev=979.58 00:16:20.742 clat (usec): min=672, max=96245, avg=15018.87, stdev=14917.95 00:16:20.742 lat (usec): min=3136, max=96251, avg=15141.68, stdev=15014.16 00:16:20.742 clat percentiles (usec): 00:16:20.742 | 1.00th=[ 5211], 5.00th=[ 9241], 10.00th=[ 9896], 20.00th=[10159], 00:16:20.742 | 30.00th=[10290], 40.00th=[10683], 50.00th=[11207], 60.00th=[11338], 00:16:20.742 | 70.00th=[11600], 80.00th=[11863], 90.00th=[20317], 95.00th=[48497], 00:16:20.742 | 99.00th=[90702], 99.50th=[95945], 99.90th=[95945], 99.95th=[95945], 00:16:20.742 | 99.99th=[95945] 00:16:20.742 write: IOPS=4087, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1002msec); 0 zone resets 00:16:20.742 slat (usec): min=3, max=22479, avg=123.25, stdev=805.20 00:16:20.742 clat (usec): min=1722, max=87479, avg=17258.11, stdev=15180.60 00:16:20.742 lat (usec): min=1731, max=87513, avg=17381.36, stdev=15262.69 00:16:20.742 clat percentiles (usec): 00:16:20.742 | 1.00th=[ 4228], 5.00th=[ 9765], 10.00th=[10159], 20.00th=[10421], 00:16:20.742 | 30.00th=[10552], 40.00th=[10945], 50.00th=[11469], 60.00th=[11731], 00:16:20.742 | 70.00th=[12387], 80.00th=[16909], 90.00th=[39584], 95.00th=[57410], 00:16:20.742 | 99.00th=[78119], 99.50th=[81265], 99.90th=[87557], 99.95th=[87557], 00:16:20.742 | 99.99th=[87557] 00:16:20.742 bw ( KiB/s): min=11152, max=21616, per=22.66%, avg=16384.00, stdev=7399.17, samples=2 00:16:20.742 iops : min= 2788, max= 5404, avg=4096.00, stdev=1849.79, samples=2 00:16:20.742 lat (usec) : 750=0.01% 00:16:20.742 lat (msec) : 2=0.14%, 4=0.67%, 10=10.07%, 20=75.93%, 50=7.09% 00:16:20.742 lat (msec) : 100=6.08% 00:16:20.742 cpu : usr=3.90%, sys=6.79%, ctx=386, majf=0, minf=1 00:16:20.742 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:20.742 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:20.742 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:20.742 issued rwts: total=3760,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:20.742 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:20.742 job1: (groupid=0, jobs=1): err= 0: pid=3814450: Thu Nov 28 11:40:40 2024 00:16:20.742 read: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec) 00:16:20.742 slat (usec): min=3, max=24671, avg=114.95, stdev=757.18 00:16:20.742 clat (usec): min=8276, max=63480, avg=14600.71, stdev=8823.32 00:16:20.743 lat (usec): min=8282, max=63488, avg=14715.66, stdev=8871.74 00:16:20.743 clat percentiles (usec): 00:16:20.743 | 1.00th=[ 9241], 5.00th=[10028], 10.00th=[10814], 20.00th=[11207], 00:16:20.743 | 30.00th=[11469], 40.00th=[11731], 50.00th=[11994], 60.00th=[12387], 00:16:20.743 | 70.00th=[13042], 80.00th=[13566], 90.00th=[22676], 95.00th=[24511], 00:16:20.743 | 99.00th=[63177], 99.50th=[63177], 99.90th=[63701], 99.95th=[63701], 00:16:20.743 | 99.99th=[63701] 00:16:20.743 write: IOPS=4482, BW=17.5MiB/s (18.4MB/s)(17.5MiB/1001msec); 0 zone resets 00:16:20.743 slat (usec): min=3, max=14095, avg=108.43, stdev=598.96 00:16:20.743 clat (usec): min=419, max=71575, avg=14706.07, stdev=9230.50 00:16:20.743 lat (usec): min=3781, max=71584, avg=14814.50, stdev=9280.43 00:16:20.743 clat percentiles (usec): 00:16:20.743 | 1.00th=[ 6194], 5.00th=[ 9765], 10.00th=[10290], 20.00th=[11338], 00:16:20.743 | 30.00th=[11600], 40.00th=[11731], 50.00th=[12125], 60.00th=[12387], 00:16:20.743 | 70.00th=[13173], 80.00th=[14091], 90.00th=[22938], 95.00th=[30278], 00:16:20.743 | 99.00th=[67634], 99.50th=[69731], 99.90th=[71828], 99.95th=[71828], 00:16:20.743 | 99.99th=[71828] 00:16:20.743 bw ( KiB/s): min=20480, max=20480, per=28.32%, avg=20480.00, stdev= 0.00, samples=1 00:16:20.743 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:16:20.743 lat (usec) : 500=0.01% 00:16:20.743 lat (msec) : 4=0.22%, 10=5.95%, 20=81.52%, 50=10.00%, 100=2.30% 00:16:20.743 cpu : usr=5.60%, sys=8.60%, ctx=504, majf=0, minf=1 00:16:20.743 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:20.743 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:20.743 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:20.743 issued rwts: total=4096,4487,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:20.743 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:20.743 job2: (groupid=0, jobs=1): err= 0: pid=3814451: Thu Nov 28 11:40:40 2024 00:16:20.743 read: IOPS=4580, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1006msec) 00:16:20.743 slat (usec): min=2, max=14612, avg=96.99, stdev=581.91 00:16:20.743 clat (usec): min=4434, max=30628, avg=13804.00, stdev=2996.89 00:16:20.743 lat (usec): min=4440, max=30822, avg=13900.98, stdev=3012.19 00:16:20.743 clat percentiles (usec): 00:16:20.743 | 1.00th=[ 6718], 5.00th=[10552], 10.00th=[11207], 20.00th=[11731], 00:16:20.743 | 30.00th=[12256], 40.00th=[12911], 50.00th=[13304], 60.00th=[13829], 00:16:20.743 | 70.00th=[14484], 80.00th=[15664], 90.00th=[16450], 95.00th=[18482], 00:16:20.743 | 99.00th=[26870], 99.50th=[27919], 99.90th=[30540], 99.95th=[30540], 00:16:20.743 | 99.99th=[30540] 00:16:20.743 write: IOPS=4720, BW=18.4MiB/s (19.3MB/s)(18.6MiB/1006msec); 0 zone resets 00:16:20.743 slat (usec): min=3, max=13024, avg=102.82, stdev=672.30 00:16:20.743 clat (usec): min=1257, max=24081, avg=13473.28, stdev=3587.72 00:16:20.743 lat (usec): min=1559, max=24103, avg=13576.10, stdev=3588.13 00:16:20.743 clat percentiles (usec): 00:16:20.743 | 1.00th=[ 3752], 5.00th=[ 7177], 10.00th=[10028], 20.00th=[11076], 00:16:20.743 | 30.00th=[11863], 40.00th=[12256], 50.00th=[12649], 60.00th=[13304], 00:16:20.743 | 70.00th=[15008], 80.00th=[16909], 90.00th=[18220], 95.00th=[20055], 00:16:20.743 | 99.00th=[22676], 99.50th=[22938], 99.90th=[23200], 99.95th=[23200], 00:16:20.743 | 99.99th=[23987] 00:16:20.743 bw ( KiB/s): min=17176, max=19976, per=25.69%, avg=18576.00, stdev=1979.90, samples=2 00:16:20.743 iops : min= 4294, max= 4994, avg=4644.00, stdev=494.97, samples=2 00:16:20.743 lat (msec) : 2=0.05%, 4=0.49%, 10=5.81%, 20=89.55%, 50=4.09% 00:16:20.743 cpu : usr=3.88%, sys=8.06%, ctx=395, majf=0, minf=1 00:16:20.743 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:20.743 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:20.743 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:20.743 issued rwts: total=4608,4749,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:20.743 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:20.743 job3: (groupid=0, jobs=1): err= 0: pid=3814452: Thu Nov 28 11:40:40 2024 00:16:20.743 read: IOPS=4562, BW=17.8MiB/s (18.7MB/s)(18.0MiB/1010msec) 00:16:20.743 slat (usec): min=2, max=12073, avg=104.65, stdev=725.29 00:16:20.743 clat (usec): min=4967, max=32148, avg=13081.78, stdev=3612.82 00:16:20.743 lat (usec): min=5098, max=32797, avg=13186.43, stdev=3657.49 00:16:20.743 clat percentiles (usec): 00:16:20.743 | 1.00th=[ 6587], 5.00th=[ 8225], 10.00th=[ 9765], 20.00th=[11076], 00:16:20.743 | 30.00th=[11600], 40.00th=[11994], 50.00th=[12387], 60.00th=[12780], 00:16:20.743 | 70.00th=[13435], 80.00th=[14484], 90.00th=[17433], 95.00th=[20317], 00:16:20.743 | 99.00th=[25822], 99.50th=[30540], 99.90th=[32113], 99.95th=[32113], 00:16:20.743 | 99.99th=[32113] 00:16:20.743 write: IOPS=4877, BW=19.1MiB/s (20.0MB/s)(19.2MiB/1010msec); 0 zone resets 00:16:20.743 slat (usec): min=3, max=10668, avg=93.20, stdev=407.20 00:16:20.743 clat (usec): min=371, max=32787, avg=13784.73, stdev=4689.67 00:16:20.743 lat (usec): min=844, max=32795, avg=13877.93, stdev=4713.96 00:16:20.743 clat percentiles (usec): 00:16:20.743 | 1.00th=[ 4752], 5.00th=[ 7308], 10.00th=[ 8717], 20.00th=[10421], 00:16:20.743 | 30.00th=[11863], 40.00th=[12387], 50.00th=[12780], 60.00th=[13566], 00:16:20.743 | 70.00th=[14091], 80.00th=[16450], 90.00th=[22414], 95.00th=[23462], 00:16:20.743 | 99.00th=[25035], 99.50th=[26346], 99.90th=[29230], 99.95th=[29230], 00:16:20.743 | 99.99th=[32900] 00:16:20.743 bw ( KiB/s): min=17912, max=20480, per=26.55%, avg=19196.00, stdev=1815.85, samples=2 00:16:20.743 iops : min= 4478, max= 5120, avg=4799.00, stdev=453.96, samples=2 00:16:20.743 lat (usec) : 500=0.01%, 1000=0.01% 00:16:20.743 lat (msec) : 2=0.09%, 4=0.14%, 10=15.47%, 20=73.96%, 50=10.32% 00:16:20.743 cpu : usr=4.56%, sys=6.34%, ctx=580, majf=0, minf=1 00:16:20.743 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:20.743 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:20.743 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:20.743 issued rwts: total=4608,4926,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:20.743 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:20.743 00:16:20.743 Run status group 0 (all jobs): 00:16:20.743 READ: bw=66.0MiB/s (69.2MB/s), 14.7MiB/s-17.9MiB/s (15.4MB/s-18.8MB/s), io=66.7MiB (69.9MB), run=1001-1010msec 00:16:20.743 WRITE: bw=70.6MiB/s (74.0MB/s), 16.0MiB/s-19.1MiB/s (16.7MB/s-20.0MB/s), io=71.3MiB (74.8MB), run=1001-1010msec 00:16:20.743 00:16:20.743 Disk stats (read/write): 00:16:20.743 nvme0n1: ios=3119/3183, merge=0/0, ticks=16830/19455, in_queue=36285, util=98.00% 00:16:20.743 nvme0n2: ios=3458/3584, merge=0/0, ticks=15485/18234, in_queue=33719, util=97.77% 00:16:20.743 nvme0n3: ios=4100/4096, merge=0/0, ticks=26933/25309, in_queue=52242, util=98.44% 00:16:20.743 nvme0n4: ios=3888/4096, merge=0/0, ticks=37368/40514, in_queue=77882, util=97.80% 00:16:20.743 11:40:40 -- target/fio.sh@55 -- # sync 00:16:20.743 11:40:40 -- target/fio.sh@59 -- # fio_pid=3814592 00:16:20.743 11:40:40 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:20.743 11:40:40 -- target/fio.sh@61 -- # sleep 3 00:16:20.743 [global] 00:16:20.743 thread=1 00:16:20.743 invalidate=1 00:16:20.743 rw=read 00:16:20.743 time_based=1 00:16:20.743 runtime=10 00:16:20.743 ioengine=libaio 00:16:20.743 direct=1 00:16:20.743 bs=4096 00:16:20.743 iodepth=1 00:16:20.743 norandommap=1 00:16:20.743 numjobs=1 00:16:20.743 00:16:20.743 [job0] 00:16:20.743 filename=/dev/nvme0n1 00:16:20.743 [job1] 00:16:20.743 filename=/dev/nvme0n2 00:16:20.743 [job2] 00:16:20.743 filename=/dev/nvme0n3 00:16:20.743 [job3] 00:16:20.743 filename=/dev/nvme0n4 00:16:20.743 Could not set queue depth (nvme0n1) 00:16:20.743 Could not set queue depth (nvme0n2) 00:16:20.743 Could not set queue depth (nvme0n3) 00:16:20.743 Could not set queue depth (nvme0n4) 00:16:21.001 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:21.001 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:21.001 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:21.001 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:21.001 fio-3.35 00:16:21.001 Starting 4 threads 00:16:24.289 11:40:43 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:24.289 11:40:43 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:24.289 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=1900544, buflen=4096 00:16:24.289 fio: pid=3814689, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:24.289 11:40:44 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:24.289 11:40:44 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:24.289 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=40775680, buflen=4096 00:16:24.289 fio: pid=3814688, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:24.547 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=45277184, buflen=4096 00:16:24.547 fio: pid=3814686, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:24.547 11:40:44 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:24.547 11:40:44 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:24.807 11:40:44 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:24.807 11:40:44 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:24.807 fio: io_u error on file /dev/nvme0n2: Input/output error: read offset=18329600, buflen=4096 00:16:24.807 fio: pid=3814687, err=5/file:io_u.c:1889, func=io_u error, error=Input/output error 00:16:24.807 00:16:24.807 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3814686: Thu Nov 28 11:40:44 2024 00:16:24.807 read: IOPS=3230, BW=12.6MiB/s (13.2MB/s)(43.2MiB/3422msec) 00:16:24.807 slat (usec): min=4, max=27527, avg=16.15, stdev=291.08 00:16:24.807 clat (usec): min=199, max=41310, avg=288.39, stdev=550.93 00:16:24.807 lat (usec): min=205, max=41323, avg=304.55, stdev=624.24 00:16:24.807 clat percentiles (usec): 00:16:24.807 | 1.00th=[ 212], 5.00th=[ 223], 10.00th=[ 231], 20.00th=[ 241], 00:16:24.807 | 30.00th=[ 247], 40.00th=[ 255], 50.00th=[ 265], 60.00th=[ 273], 00:16:24.807 | 70.00th=[ 289], 80.00th=[ 322], 90.00th=[ 367], 95.00th=[ 388], 00:16:24.807 | 99.00th=[ 469], 99.50th=[ 523], 99.90th=[ 668], 99.95th=[ 725], 00:16:24.807 | 99.99th=[40633] 00:16:24.807 bw ( KiB/s): min=11208, max=15288, per=47.25%, avg=13053.33, stdev=1630.98, samples=6 00:16:24.807 iops : min= 2802, max= 3822, avg=3263.33, stdev=407.74, samples=6 00:16:24.807 lat (usec) : 250=33.41%, 500=65.94%, 750=0.59%, 1000=0.01% 00:16:24.807 lat (msec) : 2=0.01%, 10=0.01%, 50=0.02% 00:16:24.807 cpu : usr=1.61%, sys=4.36%, ctx=11060, majf=0, minf=2 00:16:24.807 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:24.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.807 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.807 issued rwts: total=11055,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:24.807 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:24.807 job1: (groupid=0, jobs=1): err= 5 (file:io_u.c:1889, func=io_u error, error=Input/output error): pid=3814687: Thu Nov 28 11:40:44 2024 00:16:24.807 read: IOPS=1191, BW=4764KiB/s (4879kB/s)(17.5MiB/3757msec) 00:16:24.807 slat (usec): min=4, max=14924, avg=23.00, stdev=351.02 00:16:24.807 clat (usec): min=206, max=42177, avg=808.65, stdev=4584.58 00:16:24.807 lat (usec): min=211, max=55994, avg=830.15, stdev=4671.02 00:16:24.807 clat percentiles (usec): 00:16:24.807 | 1.00th=[ 221], 5.00th=[ 229], 10.00th=[ 233], 20.00th=[ 243], 00:16:24.807 | 30.00th=[ 251], 40.00th=[ 260], 50.00th=[ 269], 60.00th=[ 281], 00:16:24.807 | 70.00th=[ 297], 80.00th=[ 334], 90.00th=[ 379], 95.00th=[ 429], 00:16:24.807 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:16:24.807 | 99.99th=[42206] 00:16:24.807 bw ( KiB/s): min= 92, max=13072, per=18.49%, avg=5108.00, stdev=5699.40, samples=7 00:16:24.807 iops : min= 23, max= 3268, avg=1277.00, stdev=1424.85, samples=7 00:16:24.807 lat (usec) : 250=29.29%, 500=68.52%, 750=0.85%, 1000=0.02% 00:16:24.807 lat (msec) : 10=0.02%, 50=1.27% 00:16:24.807 cpu : usr=0.72%, sys=1.92%, ctx=4481, majf=0, minf=1 00:16:24.807 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:24.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.807 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.807 issued rwts: total=4476,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:24.807 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:24.807 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3814688: Thu Nov 28 11:40:44 2024 00:16:24.807 read: IOPS=3147, BW=12.3MiB/s (12.9MB/s)(38.9MiB/3163msec) 00:16:24.807 slat (nsec): min=5673, max=54487, avg=11469.43, stdev=5831.79 00:16:24.807 clat (usec): min=216, max=41042, avg=300.92, stdev=579.56 00:16:24.807 lat (usec): min=222, max=41055, avg=312.39, stdev=579.71 00:16:24.807 clat percentiles (usec): 00:16:24.807 | 1.00th=[ 231], 5.00th=[ 241], 10.00th=[ 247], 20.00th=[ 260], 00:16:24.807 | 30.00th=[ 269], 40.00th=[ 281], 50.00th=[ 289], 60.00th=[ 297], 00:16:24.807 | 70.00th=[ 306], 80.00th=[ 314], 90.00th=[ 330], 95.00th=[ 359], 00:16:24.807 | 99.00th=[ 461], 99.50th=[ 523], 99.90th=[ 930], 99.95th=[ 1221], 00:16:24.807 | 99.99th=[41157] 00:16:24.807 bw ( KiB/s): min=11152, max=15144, per=47.12%, avg=13018.67, stdev=1316.93, samples=6 00:16:24.807 iops : min= 2788, max= 3786, avg=3254.67, stdev=329.23, samples=6 00:16:24.807 lat (usec) : 250=11.90%, 500=87.46%, 750=0.45%, 1000=0.10% 00:16:24.807 lat (msec) : 2=0.04%, 4=0.01%, 50=0.02% 00:16:24.807 cpu : usr=1.80%, sys=5.95%, ctx=9957, majf=0, minf=2 00:16:24.807 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:24.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.807 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.807 issued rwts: total=9956,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:24.807 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:24.808 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3814689: Thu Nov 28 11:40:44 2024 00:16:24.808 read: IOPS=159, BW=638KiB/s (653kB/s)(1856KiB/2911msec) 00:16:24.808 slat (nsec): min=5952, max=39540, avg=16339.51, stdev=8705.14 00:16:24.808 clat (usec): min=215, max=41189, avg=6232.63, stdev=14404.55 00:16:24.808 lat (usec): min=221, max=41213, avg=6248.97, stdev=14406.57 00:16:24.808 clat percentiles (usec): 00:16:24.808 | 1.00th=[ 219], 5.00th=[ 233], 10.00th=[ 239], 20.00th=[ 245], 00:16:24.808 | 30.00th=[ 249], 40.00th=[ 255], 50.00th=[ 262], 60.00th=[ 277], 00:16:24.808 | 70.00th=[ 297], 80.00th=[ 330], 90.00th=[41157], 95.00th=[41157], 00:16:24.808 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:24.808 | 99.99th=[41157] 00:16:24.808 bw ( KiB/s): min= 96, max= 2864, per=2.39%, avg=659.20, stdev=1232.59, samples=5 00:16:24.808 iops : min= 24, max= 716, avg=164.80, stdev=308.15, samples=5 00:16:24.808 lat (usec) : 250=30.75%, 500=54.19% 00:16:24.808 lat (msec) : 2=0.22%, 50=14.62% 00:16:24.808 cpu : usr=0.07%, sys=0.31%, ctx=468, majf=0, minf=1 00:16:24.808 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:24.808 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.808 complete : 0=0.2%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.808 issued rwts: total=465,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:24.808 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:24.808 00:16:24.808 Run status group 0 (all jobs): 00:16:24.808 READ: bw=27.0MiB/s (28.3MB/s), 638KiB/s-12.6MiB/s (653kB/s-13.2MB/s), io=101MiB (106MB), run=2911-3757msec 00:16:24.808 00:16:24.808 Disk stats (read/write): 00:16:24.808 nvme0n1: ios=10891/0, merge=0/0, ticks=3047/0, in_queue=3047, util=94.68% 00:16:24.808 nvme0n2: ios=4472/0, merge=0/0, ticks=3431/0, in_queue=3431, util=95.87% 00:16:24.808 nvme0n3: ios=10002/0, merge=0/0, ticks=3481/0, in_queue=3481, util=99.69% 00:16:24.808 nvme0n4: ios=511/0, merge=0/0, ticks=3217/0, in_queue=3217, util=99.66% 00:16:25.066 11:40:45 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:25.066 11:40:45 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:25.324 11:40:45 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:25.324 11:40:45 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:25.582 11:40:45 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:25.582 11:40:45 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:25.841 11:40:45 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:25.841 11:40:45 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:26.099 11:40:46 -- target/fio.sh@69 -- # fio_status=0 00:16:26.099 11:40:46 -- target/fio.sh@70 -- # wait 3814592 00:16:26.099 11:40:46 -- target/fio.sh@70 -- # fio_status=4 00:16:26.099 11:40:46 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:26.358 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:26.358 11:40:46 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:26.358 11:40:46 -- common/autotest_common.sh@1208 -- # local i=0 00:16:26.358 11:40:46 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:26.358 11:40:46 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:26.358 11:40:46 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:26.358 11:40:46 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:26.358 11:40:46 -- common/autotest_common.sh@1220 -- # return 0 00:16:26.358 11:40:46 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:26.358 11:40:46 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:26.358 nvmf hotplug test: fio failed as expected 00:16:26.358 11:40:46 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:26.619 11:40:46 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:26.619 11:40:46 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:26.619 11:40:46 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:26.619 11:40:46 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:26.619 11:40:46 -- target/fio.sh@91 -- # nvmftestfini 00:16:26.619 11:40:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:26.619 11:40:46 -- nvmf/common.sh@116 -- # sync 00:16:26.619 11:40:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:26.619 11:40:46 -- nvmf/common.sh@119 -- # set +e 00:16:26.619 11:40:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:26.619 11:40:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:26.619 rmmod nvme_tcp 00:16:26.619 rmmod nvme_fabrics 00:16:26.619 rmmod nvme_keyring 00:16:26.619 11:40:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:26.619 11:40:46 -- nvmf/common.sh@123 -- # set -e 00:16:26.619 11:40:46 -- nvmf/common.sh@124 -- # return 0 00:16:26.619 11:40:46 -- nvmf/common.sh@477 -- # '[' -n 3812506 ']' 00:16:26.619 11:40:46 -- nvmf/common.sh@478 -- # killprocess 3812506 00:16:26.619 11:40:46 -- common/autotest_common.sh@936 -- # '[' -z 3812506 ']' 00:16:26.619 11:40:46 -- common/autotest_common.sh@940 -- # kill -0 3812506 00:16:26.619 11:40:46 -- common/autotest_common.sh@941 -- # uname 00:16:26.619 11:40:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:26.619 11:40:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3812506 00:16:26.619 11:40:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:26.619 11:40:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:26.619 11:40:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3812506' 00:16:26.619 killing process with pid 3812506 00:16:26.619 11:40:46 -- common/autotest_common.sh@955 -- # kill 3812506 00:16:26.619 11:40:46 -- common/autotest_common.sh@960 -- # wait 3812506 00:16:26.877 11:40:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:26.878 11:40:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:26.878 11:40:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:26.878 11:40:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:26.878 11:40:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:26.878 11:40:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:26.878 11:40:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:26.878 11:40:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:29.417 11:40:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:29.417 00:16:29.417 real 0m24.448s 00:16:29.417 user 1m25.387s 00:16:29.417 sys 0m7.151s 00:16:29.417 11:40:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:29.417 11:40:48 -- common/autotest_common.sh@10 -- # set +x 00:16:29.417 ************************************ 00:16:29.417 END TEST nvmf_fio_target 00:16:29.417 ************************************ 00:16:29.417 11:40:48 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:29.417 11:40:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:29.417 11:40:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:29.417 11:40:48 -- common/autotest_common.sh@10 -- # set +x 00:16:29.417 ************************************ 00:16:29.417 START TEST nvmf_bdevio 00:16:29.417 ************************************ 00:16:29.417 11:40:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:29.417 * Looking for test storage... 00:16:29.417 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:29.417 11:40:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:29.417 11:40:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:29.417 11:40:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:29.417 11:40:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:29.417 11:40:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:29.417 11:40:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:29.417 11:40:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:29.417 11:40:49 -- scripts/common.sh@335 -- # IFS=.-: 00:16:29.417 11:40:49 -- scripts/common.sh@335 -- # read -ra ver1 00:16:29.417 11:40:49 -- scripts/common.sh@336 -- # IFS=.-: 00:16:29.417 11:40:49 -- scripts/common.sh@336 -- # read -ra ver2 00:16:29.417 11:40:49 -- scripts/common.sh@337 -- # local 'op=<' 00:16:29.417 11:40:49 -- scripts/common.sh@339 -- # ver1_l=2 00:16:29.417 11:40:49 -- scripts/common.sh@340 -- # ver2_l=1 00:16:29.417 11:40:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:29.417 11:40:49 -- scripts/common.sh@343 -- # case "$op" in 00:16:29.417 11:40:49 -- scripts/common.sh@344 -- # : 1 00:16:29.417 11:40:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:29.417 11:40:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:29.417 11:40:49 -- scripts/common.sh@364 -- # decimal 1 00:16:29.417 11:40:49 -- scripts/common.sh@352 -- # local d=1 00:16:29.417 11:40:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:29.417 11:40:49 -- scripts/common.sh@354 -- # echo 1 00:16:29.417 11:40:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:29.417 11:40:49 -- scripts/common.sh@365 -- # decimal 2 00:16:29.417 11:40:49 -- scripts/common.sh@352 -- # local d=2 00:16:29.417 11:40:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:29.417 11:40:49 -- scripts/common.sh@354 -- # echo 2 00:16:29.417 11:40:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:29.417 11:40:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:29.417 11:40:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:29.417 11:40:49 -- scripts/common.sh@367 -- # return 0 00:16:29.417 11:40:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:29.417 11:40:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:29.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.417 --rc genhtml_branch_coverage=1 00:16:29.417 --rc genhtml_function_coverage=1 00:16:29.417 --rc genhtml_legend=1 00:16:29.417 --rc geninfo_all_blocks=1 00:16:29.417 --rc geninfo_unexecuted_blocks=1 00:16:29.417 00:16:29.417 ' 00:16:29.417 11:40:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:29.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.417 --rc genhtml_branch_coverage=1 00:16:29.417 --rc genhtml_function_coverage=1 00:16:29.417 --rc genhtml_legend=1 00:16:29.417 --rc geninfo_all_blocks=1 00:16:29.417 --rc geninfo_unexecuted_blocks=1 00:16:29.417 00:16:29.417 ' 00:16:29.418 11:40:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:29.418 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.418 --rc genhtml_branch_coverage=1 00:16:29.418 --rc genhtml_function_coverage=1 00:16:29.418 --rc genhtml_legend=1 00:16:29.418 --rc geninfo_all_blocks=1 00:16:29.418 --rc geninfo_unexecuted_blocks=1 00:16:29.418 00:16:29.418 ' 00:16:29.418 11:40:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:29.418 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.418 --rc genhtml_branch_coverage=1 00:16:29.418 --rc genhtml_function_coverage=1 00:16:29.418 --rc genhtml_legend=1 00:16:29.418 --rc geninfo_all_blocks=1 00:16:29.418 --rc geninfo_unexecuted_blocks=1 00:16:29.418 00:16:29.418 ' 00:16:29.418 11:40:49 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:29.418 11:40:49 -- nvmf/common.sh@7 -- # uname -s 00:16:29.418 11:40:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:29.418 11:40:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:29.418 11:40:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:29.418 11:40:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:29.418 11:40:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:29.418 11:40:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:29.418 11:40:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:29.418 11:40:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:29.418 11:40:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:29.418 11:40:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:29.418 11:40:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:29.418 11:40:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:29.418 11:40:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:29.418 11:40:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:29.418 11:40:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:29.418 11:40:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:29.418 11:40:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:29.418 11:40:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:29.418 11:40:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:29.418 11:40:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.418 11:40:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.418 11:40:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.418 11:40:49 -- paths/export.sh@5 -- # export PATH 00:16:29.418 11:40:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.418 11:40:49 -- nvmf/common.sh@46 -- # : 0 00:16:29.418 11:40:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:29.418 11:40:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:29.418 11:40:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:29.418 11:40:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:29.418 11:40:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:29.418 11:40:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:29.418 11:40:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:29.418 11:40:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:29.418 11:40:49 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:29.418 11:40:49 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:29.418 11:40:49 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:29.418 11:40:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:29.418 11:40:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:29.418 11:40:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:29.418 11:40:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:29.418 11:40:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:29.418 11:40:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:29.418 11:40:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:29.418 11:40:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:29.418 11:40:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:29.418 11:40:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:29.418 11:40:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:29.418 11:40:49 -- common/autotest_common.sh@10 -- # set +x 00:16:31.323 11:40:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:31.323 11:40:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:31.323 11:40:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:31.323 11:40:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:31.323 11:40:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:31.323 11:40:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:31.323 11:40:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:31.323 11:40:51 -- nvmf/common.sh@294 -- # net_devs=() 00:16:31.323 11:40:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:31.323 11:40:51 -- nvmf/common.sh@295 -- # e810=() 00:16:31.323 11:40:51 -- nvmf/common.sh@295 -- # local -ga e810 00:16:31.323 11:40:51 -- nvmf/common.sh@296 -- # x722=() 00:16:31.323 11:40:51 -- nvmf/common.sh@296 -- # local -ga x722 00:16:31.323 11:40:51 -- nvmf/common.sh@297 -- # mlx=() 00:16:31.323 11:40:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:31.323 11:40:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:31.323 11:40:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:31.323 11:40:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:31.323 11:40:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:31.323 11:40:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:31.323 11:40:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:31.323 11:40:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:31.323 11:40:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:31.323 11:40:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:31.323 11:40:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:31.323 11:40:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:31.323 11:40:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:31.323 11:40:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:31.323 11:40:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:31.323 11:40:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:31.323 11:40:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:31.323 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:31.323 11:40:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:31.323 11:40:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:31.323 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:31.323 11:40:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:31.323 11:40:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:31.323 11:40:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:31.323 11:40:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:31.323 11:40:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:31.323 11:40:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:31.323 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:31.323 11:40:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:31.323 11:40:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:31.323 11:40:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:31.323 11:40:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:31.323 11:40:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:31.323 11:40:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:31.323 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:31.323 11:40:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:31.323 11:40:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:31.323 11:40:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:31.323 11:40:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:31.323 11:40:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:31.323 11:40:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:31.323 11:40:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:31.323 11:40:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:31.323 11:40:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:31.323 11:40:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:31.323 11:40:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:31.323 11:40:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:31.323 11:40:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:31.323 11:40:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:31.323 11:40:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:31.323 11:40:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:31.323 11:40:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:31.323 11:40:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:31.323 11:40:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:31.323 11:40:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:31.323 11:40:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:31.323 11:40:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:31.323 11:40:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:31.323 11:40:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:31.323 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:31.323 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.307 ms 00:16:31.323 00:16:31.323 --- 10.0.0.2 ping statistics --- 00:16:31.323 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:31.323 rtt min/avg/max/mdev = 0.307/0.307/0.307/0.000 ms 00:16:31.323 11:40:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:31.323 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:31.323 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.134 ms 00:16:31.323 00:16:31.323 --- 10.0.0.1 ping statistics --- 00:16:31.323 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:31.323 rtt min/avg/max/mdev = 0.134/0.134/0.134/0.000 ms 00:16:31.323 11:40:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:31.323 11:40:51 -- nvmf/common.sh@410 -- # return 0 00:16:31.323 11:40:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:31.323 11:40:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:31.323 11:40:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:31.323 11:40:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:31.323 11:40:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:31.323 11:40:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:31.323 11:40:51 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:31.323 11:40:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:31.323 11:40:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:31.323 11:40:51 -- common/autotest_common.sh@10 -- # set +x 00:16:31.323 11:40:51 -- nvmf/common.sh@469 -- # nvmfpid=3817348 00:16:31.323 11:40:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:31.323 11:40:51 -- nvmf/common.sh@470 -- # waitforlisten 3817348 00:16:31.323 11:40:51 -- common/autotest_common.sh@829 -- # '[' -z 3817348 ']' 00:16:31.323 11:40:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:31.323 11:40:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:31.323 11:40:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:31.323 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:31.323 11:40:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:31.323 11:40:51 -- common/autotest_common.sh@10 -- # set +x 00:16:31.583 [2024-11-28 11:40:51.406012] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:31.583 [2024-11-28 11:40:51.406101] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:31.583 EAL: No free 2048 kB hugepages reported on node 1 00:16:31.583 [2024-11-28 11:40:51.486122] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:31.583 [2024-11-28 11:40:51.602407] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:31.583 [2024-11-28 11:40:51.602597] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:31.583 [2024-11-28 11:40:51.602616] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:31.583 [2024-11-28 11:40:51.602629] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:31.583 [2024-11-28 11:40:51.602682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:31.583 [2024-11-28 11:40:51.602710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:31.583 [2024-11-28 11:40:51.602770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:31.583 [2024-11-28 11:40:51.602784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:32.520 11:40:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:32.520 11:40:52 -- common/autotest_common.sh@862 -- # return 0 00:16:32.520 11:40:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:32.520 11:40:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:32.520 11:40:52 -- common/autotest_common.sh@10 -- # set +x 00:16:32.520 11:40:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:32.520 11:40:52 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:32.520 11:40:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:32.520 11:40:52 -- common/autotest_common.sh@10 -- # set +x 00:16:32.520 [2024-11-28 11:40:52.446169] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:32.520 11:40:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:32.520 11:40:52 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:32.520 11:40:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:32.520 11:40:52 -- common/autotest_common.sh@10 -- # set +x 00:16:32.520 Malloc0 00:16:32.520 11:40:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:32.520 11:40:52 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:32.520 11:40:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:32.520 11:40:52 -- common/autotest_common.sh@10 -- # set +x 00:16:32.520 11:40:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:32.520 11:40:52 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:32.520 11:40:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:32.520 11:40:52 -- common/autotest_common.sh@10 -- # set +x 00:16:32.520 11:40:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:32.520 11:40:52 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:32.520 11:40:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:32.520 11:40:52 -- common/autotest_common.sh@10 -- # set +x 00:16:32.520 [2024-11-28 11:40:52.497554] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:32.520 11:40:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:32.520 11:40:52 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:16:32.520 11:40:52 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:32.520 11:40:52 -- nvmf/common.sh@520 -- # config=() 00:16:32.520 11:40:52 -- nvmf/common.sh@520 -- # local subsystem config 00:16:32.520 11:40:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:32.520 11:40:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:32.520 { 00:16:32.520 "params": { 00:16:32.520 "name": "Nvme$subsystem", 00:16:32.520 "trtype": "$TEST_TRANSPORT", 00:16:32.520 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:32.520 "adrfam": "ipv4", 00:16:32.520 "trsvcid": "$NVMF_PORT", 00:16:32.520 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:32.520 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:32.520 "hdgst": ${hdgst:-false}, 00:16:32.520 "ddgst": ${ddgst:-false} 00:16:32.520 }, 00:16:32.520 "method": "bdev_nvme_attach_controller" 00:16:32.520 } 00:16:32.520 EOF 00:16:32.520 )") 00:16:32.520 11:40:52 -- nvmf/common.sh@542 -- # cat 00:16:32.520 11:40:52 -- nvmf/common.sh@544 -- # jq . 00:16:32.520 11:40:52 -- nvmf/common.sh@545 -- # IFS=, 00:16:32.520 11:40:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:32.520 "params": { 00:16:32.520 "name": "Nvme1", 00:16:32.520 "trtype": "tcp", 00:16:32.520 "traddr": "10.0.0.2", 00:16:32.520 "adrfam": "ipv4", 00:16:32.520 "trsvcid": "4420", 00:16:32.520 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:32.520 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:32.520 "hdgst": false, 00:16:32.520 "ddgst": false 00:16:32.520 }, 00:16:32.520 "method": "bdev_nvme_attach_controller" 00:16:32.520 }' 00:16:32.520 [2024-11-28 11:40:52.536313] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:32.520 [2024-11-28 11:40:52.536386] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3817508 ] 00:16:32.520 EAL: No free 2048 kB hugepages reported on node 1 00:16:32.779 [2024-11-28 11:40:52.597902] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:32.779 [2024-11-28 11:40:52.708500] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:32.779 [2024-11-28 11:40:52.708552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:32.779 [2024-11-28 11:40:52.708556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:33.038 [2024-11-28 11:40:53.000023] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:33.038 [2024-11-28 11:40:53.000081] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:33.038 I/O targets: 00:16:33.038 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:33.038 00:16:33.038 00:16:33.038 CUnit - A unit testing framework for C - Version 2.1-3 00:16:33.038 http://cunit.sourceforge.net/ 00:16:33.038 00:16:33.038 00:16:33.038 Suite: bdevio tests on: Nvme1n1 00:16:33.038 Test: blockdev write read block ...passed 00:16:33.038 Test: blockdev write zeroes read block ...passed 00:16:33.298 Test: blockdev write zeroes read no split ...passed 00:16:33.298 Test: blockdev write zeroes read split ...passed 00:16:33.298 Test: blockdev write zeroes read split partial ...passed 00:16:33.298 Test: blockdev reset ...[2024-11-28 11:40:53.119855] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:33.298 [2024-11-28 11:40:53.119965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x174cf20 (9): Bad file descriptor 00:16:33.298 [2024-11-28 11:40:53.229784] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:33.298 passed 00:16:33.298 Test: blockdev write read 8 blocks ...passed 00:16:33.298 Test: blockdev write read size > 128k ...passed 00:16:33.298 Test: blockdev write read invalid size ...passed 00:16:33.559 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:33.559 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:33.559 Test: blockdev write read max offset ...passed 00:16:33.559 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:33.559 Test: blockdev writev readv 8 blocks ...passed 00:16:33.559 Test: blockdev writev readv 30 x 1block ...passed 00:16:33.559 Test: blockdev writev readv block ...passed 00:16:33.559 Test: blockdev writev readv size > 128k ...passed 00:16:33.559 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:33.559 Test: blockdev comparev and writev ...[2024-11-28 11:40:53.484954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:33.559 [2024-11-28 11:40:53.484999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:33.559 [2024-11-28 11:40:53.485025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:33.559 [2024-11-28 11:40:53.485041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:33.559 [2024-11-28 11:40:53.485421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:33.559 [2024-11-28 11:40:53.485446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:33.559 [2024-11-28 11:40:53.485467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:33.559 [2024-11-28 11:40:53.485483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:33.559 [2024-11-28 11:40:53.485856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:33.559 [2024-11-28 11:40:53.485881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:33.559 [2024-11-28 11:40:53.485902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:33.559 [2024-11-28 11:40:53.485917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:33.559 [2024-11-28 11:40:53.486301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:33.559 [2024-11-28 11:40:53.486325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:33.559 [2024-11-28 11:40:53.486346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:33.559 [2024-11-28 11:40:53.486361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:33.559 passed 00:16:33.559 Test: blockdev nvme passthru rw ...passed 00:16:33.559 Test: blockdev nvme passthru vendor specific ...[2024-11-28 11:40:53.569840] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:33.559 [2024-11-28 11:40:53.569868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:33.559 [2024-11-28 11:40:53.570039] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:33.559 [2024-11-28 11:40:53.570061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:33.559 [2024-11-28 11:40:53.570211] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:33.559 [2024-11-28 11:40:53.570233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:33.559 [2024-11-28 11:40:53.570388] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:33.559 [2024-11-28 11:40:53.570409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:33.559 passed 00:16:33.559 Test: blockdev nvme admin passthru ...passed 00:16:33.818 Test: blockdev copy ...passed 00:16:33.818 00:16:33.818 Run Summary: Type Total Ran Passed Failed Inactive 00:16:33.818 suites 1 1 n/a 0 0 00:16:33.818 tests 23 23 23 0 0 00:16:33.818 asserts 152 152 152 0 n/a 00:16:33.818 00:16:33.818 Elapsed time = 1.243 seconds 00:16:33.818 11:40:53 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:33.818 11:40:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.818 11:40:53 -- common/autotest_common.sh@10 -- # set +x 00:16:33.818 11:40:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.818 11:40:53 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:33.818 11:40:53 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:33.818 11:40:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:33.818 11:40:53 -- nvmf/common.sh@116 -- # sync 00:16:33.818 11:40:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:33.818 11:40:53 -- nvmf/common.sh@119 -- # set +e 00:16:33.818 11:40:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:33.818 11:40:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:33.818 rmmod nvme_tcp 00:16:34.077 rmmod nvme_fabrics 00:16:34.077 rmmod nvme_keyring 00:16:34.077 11:40:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:34.077 11:40:53 -- nvmf/common.sh@123 -- # set -e 00:16:34.077 11:40:53 -- nvmf/common.sh@124 -- # return 0 00:16:34.077 11:40:53 -- nvmf/common.sh@477 -- # '[' -n 3817348 ']' 00:16:34.077 11:40:53 -- nvmf/common.sh@478 -- # killprocess 3817348 00:16:34.077 11:40:53 -- common/autotest_common.sh@936 -- # '[' -z 3817348 ']' 00:16:34.077 11:40:53 -- common/autotest_common.sh@940 -- # kill -0 3817348 00:16:34.077 11:40:53 -- common/autotest_common.sh@941 -- # uname 00:16:34.077 11:40:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:34.077 11:40:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3817348 00:16:34.077 11:40:53 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:34.077 11:40:53 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:34.077 11:40:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3817348' 00:16:34.077 killing process with pid 3817348 00:16:34.077 11:40:53 -- common/autotest_common.sh@955 -- # kill 3817348 00:16:34.077 11:40:53 -- common/autotest_common.sh@960 -- # wait 3817348 00:16:34.337 11:40:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:34.337 11:40:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:34.337 11:40:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:34.337 11:40:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:34.337 11:40:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:34.337 11:40:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:34.337 11:40:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:34.337 11:40:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:36.239 11:40:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:36.498 00:16:36.498 real 0m7.341s 00:16:36.498 user 0m14.039s 00:16:36.498 sys 0m2.164s 00:16:36.498 11:40:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:36.498 11:40:56 -- common/autotest_common.sh@10 -- # set +x 00:16:36.498 ************************************ 00:16:36.498 END TEST nvmf_bdevio 00:16:36.498 ************************************ 00:16:36.498 11:40:56 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:16:36.498 11:40:56 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:36.498 11:40:56 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:16:36.498 11:40:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:36.498 11:40:56 -- common/autotest_common.sh@10 -- # set +x 00:16:36.498 ************************************ 00:16:36.498 START TEST nvmf_bdevio_no_huge 00:16:36.498 ************************************ 00:16:36.498 11:40:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:36.498 * Looking for test storage... 00:16:36.498 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:36.498 11:40:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:36.498 11:40:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:36.498 11:40:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:36.498 11:40:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:36.498 11:40:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:36.498 11:40:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:36.498 11:40:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:36.498 11:40:56 -- scripts/common.sh@335 -- # IFS=.-: 00:16:36.498 11:40:56 -- scripts/common.sh@335 -- # read -ra ver1 00:16:36.498 11:40:56 -- scripts/common.sh@336 -- # IFS=.-: 00:16:36.498 11:40:56 -- scripts/common.sh@336 -- # read -ra ver2 00:16:36.498 11:40:56 -- scripts/common.sh@337 -- # local 'op=<' 00:16:36.498 11:40:56 -- scripts/common.sh@339 -- # ver1_l=2 00:16:36.498 11:40:56 -- scripts/common.sh@340 -- # ver2_l=1 00:16:36.498 11:40:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:36.498 11:40:56 -- scripts/common.sh@343 -- # case "$op" in 00:16:36.498 11:40:56 -- scripts/common.sh@344 -- # : 1 00:16:36.498 11:40:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:36.498 11:40:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:36.498 11:40:56 -- scripts/common.sh@364 -- # decimal 1 00:16:36.498 11:40:56 -- scripts/common.sh@352 -- # local d=1 00:16:36.498 11:40:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:36.498 11:40:56 -- scripts/common.sh@354 -- # echo 1 00:16:36.498 11:40:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:36.498 11:40:56 -- scripts/common.sh@365 -- # decimal 2 00:16:36.498 11:40:56 -- scripts/common.sh@352 -- # local d=2 00:16:36.498 11:40:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:36.498 11:40:56 -- scripts/common.sh@354 -- # echo 2 00:16:36.498 11:40:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:36.498 11:40:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:36.498 11:40:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:36.499 11:40:56 -- scripts/common.sh@367 -- # return 0 00:16:36.499 11:40:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:36.499 11:40:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:36.499 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.499 --rc genhtml_branch_coverage=1 00:16:36.499 --rc genhtml_function_coverage=1 00:16:36.499 --rc genhtml_legend=1 00:16:36.499 --rc geninfo_all_blocks=1 00:16:36.499 --rc geninfo_unexecuted_blocks=1 00:16:36.499 00:16:36.499 ' 00:16:36.499 11:40:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:36.499 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.499 --rc genhtml_branch_coverage=1 00:16:36.499 --rc genhtml_function_coverage=1 00:16:36.499 --rc genhtml_legend=1 00:16:36.499 --rc geninfo_all_blocks=1 00:16:36.499 --rc geninfo_unexecuted_blocks=1 00:16:36.499 00:16:36.499 ' 00:16:36.499 11:40:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:36.499 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.499 --rc genhtml_branch_coverage=1 00:16:36.499 --rc genhtml_function_coverage=1 00:16:36.499 --rc genhtml_legend=1 00:16:36.499 --rc geninfo_all_blocks=1 00:16:36.499 --rc geninfo_unexecuted_blocks=1 00:16:36.499 00:16:36.499 ' 00:16:36.499 11:40:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:36.499 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.499 --rc genhtml_branch_coverage=1 00:16:36.499 --rc genhtml_function_coverage=1 00:16:36.499 --rc genhtml_legend=1 00:16:36.499 --rc geninfo_all_blocks=1 00:16:36.499 --rc geninfo_unexecuted_blocks=1 00:16:36.499 00:16:36.499 ' 00:16:36.499 11:40:56 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:36.499 11:40:56 -- nvmf/common.sh@7 -- # uname -s 00:16:36.499 11:40:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:36.499 11:40:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:36.499 11:40:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:36.499 11:40:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:36.499 11:40:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:36.499 11:40:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:36.499 11:40:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:36.499 11:40:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:36.499 11:40:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:36.499 11:40:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:36.499 11:40:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:36.499 11:40:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:36.499 11:40:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:36.499 11:40:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:36.499 11:40:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:36.499 11:40:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:36.499 11:40:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:36.499 11:40:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:36.499 11:40:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:36.499 11:40:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.499 11:40:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.499 11:40:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.499 11:40:56 -- paths/export.sh@5 -- # export PATH 00:16:36.499 11:40:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.499 11:40:56 -- nvmf/common.sh@46 -- # : 0 00:16:36.499 11:40:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:36.499 11:40:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:36.499 11:40:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:36.499 11:40:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:36.499 11:40:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:36.499 11:40:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:36.499 11:40:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:36.499 11:40:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:36.499 11:40:56 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:36.499 11:40:56 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:36.499 11:40:56 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:36.499 11:40:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:36.499 11:40:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:36.499 11:40:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:36.499 11:40:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:36.499 11:40:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:36.499 11:40:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:36.499 11:40:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:36.499 11:40:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:36.499 11:40:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:36.499 11:40:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:36.499 11:40:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:36.499 11:40:56 -- common/autotest_common.sh@10 -- # set +x 00:16:38.408 11:40:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:38.408 11:40:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:38.408 11:40:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:38.408 11:40:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:38.408 11:40:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:38.408 11:40:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:38.408 11:40:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:38.408 11:40:58 -- nvmf/common.sh@294 -- # net_devs=() 00:16:38.408 11:40:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:38.408 11:40:58 -- nvmf/common.sh@295 -- # e810=() 00:16:38.408 11:40:58 -- nvmf/common.sh@295 -- # local -ga e810 00:16:38.408 11:40:58 -- nvmf/common.sh@296 -- # x722=() 00:16:38.408 11:40:58 -- nvmf/common.sh@296 -- # local -ga x722 00:16:38.408 11:40:58 -- nvmf/common.sh@297 -- # mlx=() 00:16:38.408 11:40:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:38.408 11:40:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:38.408 11:40:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:38.408 11:40:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:38.408 11:40:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:38.408 11:40:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:38.408 11:40:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:38.408 11:40:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:38.408 11:40:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:38.408 11:40:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:38.408 11:40:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:38.408 11:40:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:38.408 11:40:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:38.408 11:40:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:38.408 11:40:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:38.408 11:40:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:38.408 11:40:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:38.408 11:40:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:38.408 11:40:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:38.408 11:40:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:38.408 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:38.408 11:40:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:38.408 11:40:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:38.408 11:40:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:38.408 11:40:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:38.408 11:40:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:38.408 11:40:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:38.408 11:40:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:38.408 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:38.408 11:40:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:38.409 11:40:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:38.409 11:40:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:38.409 11:40:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:38.409 11:40:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:38.409 11:40:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:38.409 11:40:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:38.409 11:40:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:38.409 11:40:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:38.409 11:40:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:38.409 11:40:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:38.409 11:40:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:38.409 11:40:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:38.409 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:38.409 11:40:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:38.409 11:40:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:38.409 11:40:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:38.409 11:40:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:38.409 11:40:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:38.409 11:40:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:38.409 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:38.409 11:40:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:38.409 11:40:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:38.409 11:40:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:38.409 11:40:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:38.409 11:40:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:38.409 11:40:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:38.409 11:40:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:38.409 11:40:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:38.409 11:40:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:38.409 11:40:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:38.409 11:40:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:38.409 11:40:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:38.409 11:40:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:38.409 11:40:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:38.409 11:40:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:38.409 11:40:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:38.409 11:40:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:38.409 11:40:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:38.409 11:40:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:38.670 11:40:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:38.670 11:40:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:38.670 11:40:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:38.670 11:40:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:38.670 11:40:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:38.670 11:40:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:38.670 11:40:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:38.670 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:38.670 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:16:38.670 00:16:38.670 --- 10.0.0.2 ping statistics --- 00:16:38.670 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:38.670 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:16:38.670 11:40:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:38.670 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:38.670 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:16:38.670 00:16:38.670 --- 10.0.0.1 ping statistics --- 00:16:38.670 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:38.670 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:16:38.670 11:40:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:38.670 11:40:58 -- nvmf/common.sh@410 -- # return 0 00:16:38.670 11:40:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:38.670 11:40:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:38.670 11:40:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:38.670 11:40:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:38.670 11:40:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:38.670 11:40:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:38.670 11:40:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:38.670 11:40:58 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:38.670 11:40:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:38.670 11:40:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:38.670 11:40:58 -- common/autotest_common.sh@10 -- # set +x 00:16:38.670 11:40:58 -- nvmf/common.sh@469 -- # nvmfpid=3819723 00:16:38.670 11:40:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:16:38.670 11:40:58 -- nvmf/common.sh@470 -- # waitforlisten 3819723 00:16:38.670 11:40:58 -- common/autotest_common.sh@829 -- # '[' -z 3819723 ']' 00:16:38.670 11:40:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:38.670 11:40:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:38.670 11:40:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:38.670 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:38.670 11:40:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:38.670 11:40:58 -- common/autotest_common.sh@10 -- # set +x 00:16:38.670 [2024-11-28 11:40:58.614127] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:38.670 [2024-11-28 11:40:58.614198] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:16:38.670 [2024-11-28 11:40:58.683117] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:38.931 [2024-11-28 11:40:58.793445] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:38.931 [2024-11-28 11:40:58.793617] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:38.931 [2024-11-28 11:40:58.793641] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:38.931 [2024-11-28 11:40:58.793655] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:38.931 [2024-11-28 11:40:58.793749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:38.931 [2024-11-28 11:40:58.793838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:38.931 [2024-11-28 11:40:58.793840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:38.931 [2024-11-28 11:40:58.793785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:39.961 11:40:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:39.961 11:40:59 -- common/autotest_common.sh@862 -- # return 0 00:16:39.961 11:40:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:39.961 11:40:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:39.961 11:40:59 -- common/autotest_common.sh@10 -- # set +x 00:16:39.961 11:40:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:39.961 11:40:59 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:39.961 11:40:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.961 11:40:59 -- common/autotest_common.sh@10 -- # set +x 00:16:39.961 [2024-11-28 11:40:59.666749] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:39.961 11:40:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.961 11:40:59 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:39.961 11:40:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.961 11:40:59 -- common/autotest_common.sh@10 -- # set +x 00:16:39.961 Malloc0 00:16:39.961 11:40:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.961 11:40:59 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:39.961 11:40:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.961 11:40:59 -- common/autotest_common.sh@10 -- # set +x 00:16:39.961 11:40:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.961 11:40:59 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:39.961 11:40:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.961 11:40:59 -- common/autotest_common.sh@10 -- # set +x 00:16:39.961 11:40:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.961 11:40:59 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:39.961 11:40:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.961 11:40:59 -- common/autotest_common.sh@10 -- # set +x 00:16:39.961 [2024-11-28 11:40:59.704728] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:39.961 11:40:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.961 11:40:59 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:16:39.961 11:40:59 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:39.961 11:40:59 -- nvmf/common.sh@520 -- # config=() 00:16:39.961 11:40:59 -- nvmf/common.sh@520 -- # local subsystem config 00:16:39.961 11:40:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:39.961 11:40:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:39.961 { 00:16:39.961 "params": { 00:16:39.961 "name": "Nvme$subsystem", 00:16:39.961 "trtype": "$TEST_TRANSPORT", 00:16:39.961 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:39.961 "adrfam": "ipv4", 00:16:39.961 "trsvcid": "$NVMF_PORT", 00:16:39.961 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:39.961 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:39.961 "hdgst": ${hdgst:-false}, 00:16:39.961 "ddgst": ${ddgst:-false} 00:16:39.961 }, 00:16:39.961 "method": "bdev_nvme_attach_controller" 00:16:39.961 } 00:16:39.961 EOF 00:16:39.961 )") 00:16:39.961 11:40:59 -- nvmf/common.sh@542 -- # cat 00:16:39.961 11:40:59 -- nvmf/common.sh@544 -- # jq . 00:16:39.961 11:40:59 -- nvmf/common.sh@545 -- # IFS=, 00:16:39.961 11:40:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:39.961 "params": { 00:16:39.961 "name": "Nvme1", 00:16:39.961 "trtype": "tcp", 00:16:39.961 "traddr": "10.0.0.2", 00:16:39.961 "adrfam": "ipv4", 00:16:39.961 "trsvcid": "4420", 00:16:39.961 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:39.961 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:39.961 "hdgst": false, 00:16:39.961 "ddgst": false 00:16:39.961 }, 00:16:39.961 "method": "bdev_nvme_attach_controller" 00:16:39.961 }' 00:16:39.961 [2024-11-28 11:40:59.746260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:39.961 [2024-11-28 11:40:59.746338] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid3819877 ] 00:16:39.961 [2024-11-28 11:40:59.810751] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:39.961 [2024-11-28 11:40:59.926638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:39.961 [2024-11-28 11:40:59.926691] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:39.961 [2024-11-28 11:40:59.926694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:40.238 [2024-11-28 11:41:00.121264] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:40.238 [2024-11-28 11:41:00.121316] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:40.238 I/O targets: 00:16:40.238 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:40.238 00:16:40.238 00:16:40.238 CUnit - A unit testing framework for C - Version 2.1-3 00:16:40.239 http://cunit.sourceforge.net/ 00:16:40.239 00:16:40.239 00:16:40.239 Suite: bdevio tests on: Nvme1n1 00:16:40.239 Test: blockdev write read block ...passed 00:16:40.239 Test: blockdev write zeroes read block ...passed 00:16:40.239 Test: blockdev write zeroes read no split ...passed 00:16:40.239 Test: blockdev write zeroes read split ...passed 00:16:40.239 Test: blockdev write zeroes read split partial ...passed 00:16:40.239 Test: blockdev reset ...[2024-11-28 11:41:00.248224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:40.239 [2024-11-28 11:41:00.248350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a6c7d0 (9): Bad file descriptor 00:16:40.239 [2024-11-28 11:41:00.269022] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:40.239 passed 00:16:40.239 Test: blockdev write read 8 blocks ...passed 00:16:40.239 Test: blockdev write read size > 128k ...passed 00:16:40.239 Test: blockdev write read invalid size ...passed 00:16:40.497 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:40.497 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:40.497 Test: blockdev write read max offset ...passed 00:16:40.497 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:40.497 Test: blockdev writev readv 8 blocks ...passed 00:16:40.497 Test: blockdev writev readv 30 x 1block ...passed 00:16:40.497 Test: blockdev writev readv block ...passed 00:16:40.497 Test: blockdev writev readv size > 128k ...passed 00:16:40.497 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:40.497 Test: blockdev comparev and writev ...[2024-11-28 11:41:00.522240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:40.497 [2024-11-28 11:41:00.522277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:40.497 [2024-11-28 11:41:00.522301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:40.497 [2024-11-28 11:41:00.522319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:40.497 [2024-11-28 11:41:00.522662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:40.497 [2024-11-28 11:41:00.522687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:40.497 [2024-11-28 11:41:00.522708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:40.497 [2024-11-28 11:41:00.522723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:40.497 [2024-11-28 11:41:00.523059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:40.497 [2024-11-28 11:41:00.523082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:40.497 [2024-11-28 11:41:00.523110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:40.497 [2024-11-28 11:41:00.523126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:40.497 [2024-11-28 11:41:00.523492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:40.497 [2024-11-28 11:41:00.523516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:40.497 [2024-11-28 11:41:00.523546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:40.497 [2024-11-28 11:41:00.523562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:40.755 passed 00:16:40.755 Test: blockdev nvme passthru rw ...passed 00:16:40.755 Test: blockdev nvme passthru vendor specific ...[2024-11-28 11:41:00.606834] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:40.755 [2024-11-28 11:41:00.606863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:40.755 [2024-11-28 11:41:00.607023] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:40.755 [2024-11-28 11:41:00.607046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:40.755 [2024-11-28 11:41:00.607207] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:40.755 [2024-11-28 11:41:00.607229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:40.756 [2024-11-28 11:41:00.607393] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:40.756 [2024-11-28 11:41:00.607415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:40.756 passed 00:16:40.756 Test: blockdev nvme admin passthru ...passed 00:16:40.756 Test: blockdev copy ...passed 00:16:40.756 00:16:40.756 Run Summary: Type Total Ran Passed Failed Inactive 00:16:40.756 suites 1 1 n/a 0 0 00:16:40.756 tests 23 23 23 0 0 00:16:40.756 asserts 152 152 152 0 n/a 00:16:40.756 00:16:40.756 Elapsed time = 1.075 seconds 00:16:41.014 11:41:01 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:41.014 11:41:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:41.014 11:41:01 -- common/autotest_common.sh@10 -- # set +x 00:16:41.014 11:41:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:41.014 11:41:01 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:41.014 11:41:01 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:41.014 11:41:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:41.014 11:41:01 -- nvmf/common.sh@116 -- # sync 00:16:41.014 11:41:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:41.014 11:41:01 -- nvmf/common.sh@119 -- # set +e 00:16:41.014 11:41:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:41.014 11:41:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:41.014 rmmod nvme_tcp 00:16:41.014 rmmod nvme_fabrics 00:16:41.014 rmmod nvme_keyring 00:16:41.274 11:41:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:41.274 11:41:01 -- nvmf/common.sh@123 -- # set -e 00:16:41.274 11:41:01 -- nvmf/common.sh@124 -- # return 0 00:16:41.274 11:41:01 -- nvmf/common.sh@477 -- # '[' -n 3819723 ']' 00:16:41.274 11:41:01 -- nvmf/common.sh@478 -- # killprocess 3819723 00:16:41.274 11:41:01 -- common/autotest_common.sh@936 -- # '[' -z 3819723 ']' 00:16:41.274 11:41:01 -- common/autotest_common.sh@940 -- # kill -0 3819723 00:16:41.274 11:41:01 -- common/autotest_common.sh@941 -- # uname 00:16:41.274 11:41:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:41.274 11:41:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3819723 00:16:41.274 11:41:01 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:41.274 11:41:01 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:41.274 11:41:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3819723' 00:16:41.274 killing process with pid 3819723 00:16:41.274 11:41:01 -- common/autotest_common.sh@955 -- # kill 3819723 00:16:41.274 11:41:01 -- common/autotest_common.sh@960 -- # wait 3819723 00:16:41.533 11:41:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:41.533 11:41:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:41.533 11:41:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:41.533 11:41:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:41.533 11:41:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:41.533 11:41:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:41.533 11:41:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:41.533 11:41:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:44.075 11:41:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:44.075 00:16:44.075 real 0m7.291s 00:16:44.075 user 0m13.721s 00:16:44.075 sys 0m2.544s 00:16:44.075 11:41:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:44.075 11:41:03 -- common/autotest_common.sh@10 -- # set +x 00:16:44.075 ************************************ 00:16:44.075 END TEST nvmf_bdevio_no_huge 00:16:44.075 ************************************ 00:16:44.075 11:41:03 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:16:44.075 11:41:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:44.075 11:41:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:44.075 11:41:03 -- common/autotest_common.sh@10 -- # set +x 00:16:44.075 ************************************ 00:16:44.075 START TEST nvmf_tls 00:16:44.075 ************************************ 00:16:44.075 11:41:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:16:44.075 * Looking for test storage... 00:16:44.075 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:44.075 11:41:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:44.075 11:41:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:44.075 11:41:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:44.075 11:41:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:44.075 11:41:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:44.075 11:41:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:44.075 11:41:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:44.075 11:41:03 -- scripts/common.sh@335 -- # IFS=.-: 00:16:44.075 11:41:03 -- scripts/common.sh@335 -- # read -ra ver1 00:16:44.075 11:41:03 -- scripts/common.sh@336 -- # IFS=.-: 00:16:44.075 11:41:03 -- scripts/common.sh@336 -- # read -ra ver2 00:16:44.075 11:41:03 -- scripts/common.sh@337 -- # local 'op=<' 00:16:44.075 11:41:03 -- scripts/common.sh@339 -- # ver1_l=2 00:16:44.075 11:41:03 -- scripts/common.sh@340 -- # ver2_l=1 00:16:44.075 11:41:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:44.075 11:41:03 -- scripts/common.sh@343 -- # case "$op" in 00:16:44.075 11:41:03 -- scripts/common.sh@344 -- # : 1 00:16:44.075 11:41:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:44.075 11:41:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:44.075 11:41:03 -- scripts/common.sh@364 -- # decimal 1 00:16:44.075 11:41:03 -- scripts/common.sh@352 -- # local d=1 00:16:44.075 11:41:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:44.075 11:41:03 -- scripts/common.sh@354 -- # echo 1 00:16:44.075 11:41:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:44.075 11:41:03 -- scripts/common.sh@365 -- # decimal 2 00:16:44.075 11:41:03 -- scripts/common.sh@352 -- # local d=2 00:16:44.075 11:41:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:44.075 11:41:03 -- scripts/common.sh@354 -- # echo 2 00:16:44.075 11:41:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:44.075 11:41:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:44.075 11:41:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:44.075 11:41:03 -- scripts/common.sh@367 -- # return 0 00:16:44.075 11:41:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:44.075 11:41:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:44.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:44.075 --rc genhtml_branch_coverage=1 00:16:44.075 --rc genhtml_function_coverage=1 00:16:44.075 --rc genhtml_legend=1 00:16:44.075 --rc geninfo_all_blocks=1 00:16:44.075 --rc geninfo_unexecuted_blocks=1 00:16:44.075 00:16:44.075 ' 00:16:44.075 11:41:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:44.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:44.075 --rc genhtml_branch_coverage=1 00:16:44.075 --rc genhtml_function_coverage=1 00:16:44.075 --rc genhtml_legend=1 00:16:44.075 --rc geninfo_all_blocks=1 00:16:44.075 --rc geninfo_unexecuted_blocks=1 00:16:44.075 00:16:44.075 ' 00:16:44.075 11:41:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:44.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:44.075 --rc genhtml_branch_coverage=1 00:16:44.075 --rc genhtml_function_coverage=1 00:16:44.075 --rc genhtml_legend=1 00:16:44.075 --rc geninfo_all_blocks=1 00:16:44.075 --rc geninfo_unexecuted_blocks=1 00:16:44.075 00:16:44.075 ' 00:16:44.075 11:41:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:44.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:44.075 --rc genhtml_branch_coverage=1 00:16:44.075 --rc genhtml_function_coverage=1 00:16:44.075 --rc genhtml_legend=1 00:16:44.075 --rc geninfo_all_blocks=1 00:16:44.075 --rc geninfo_unexecuted_blocks=1 00:16:44.075 00:16:44.075 ' 00:16:44.075 11:41:03 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:44.075 11:41:03 -- nvmf/common.sh@7 -- # uname -s 00:16:44.075 11:41:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:44.075 11:41:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:44.075 11:41:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:44.075 11:41:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:44.075 11:41:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:44.075 11:41:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:44.075 11:41:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:44.075 11:41:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:44.075 11:41:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:44.075 11:41:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:44.075 11:41:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:44.075 11:41:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:44.075 11:41:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:44.075 11:41:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:44.075 11:41:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:44.075 11:41:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:44.075 11:41:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:44.075 11:41:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:44.075 11:41:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:44.075 11:41:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.075 11:41:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.075 11:41:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.075 11:41:03 -- paths/export.sh@5 -- # export PATH 00:16:44.076 11:41:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.076 11:41:03 -- nvmf/common.sh@46 -- # : 0 00:16:44.076 11:41:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:44.076 11:41:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:44.076 11:41:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:44.076 11:41:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:44.076 11:41:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:44.076 11:41:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:44.076 11:41:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:44.076 11:41:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:44.076 11:41:03 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:44.076 11:41:03 -- target/tls.sh@71 -- # nvmftestinit 00:16:44.076 11:41:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:44.076 11:41:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:44.076 11:41:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:44.076 11:41:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:44.076 11:41:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:44.076 11:41:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:44.076 11:41:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:44.076 11:41:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:44.076 11:41:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:44.076 11:41:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:44.076 11:41:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:44.076 11:41:03 -- common/autotest_common.sh@10 -- # set +x 00:16:45.985 11:41:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:45.985 11:41:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:45.985 11:41:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:45.985 11:41:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:45.985 11:41:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:45.985 11:41:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:45.985 11:41:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:45.985 11:41:05 -- nvmf/common.sh@294 -- # net_devs=() 00:16:45.985 11:41:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:45.985 11:41:05 -- nvmf/common.sh@295 -- # e810=() 00:16:45.985 11:41:05 -- nvmf/common.sh@295 -- # local -ga e810 00:16:45.985 11:41:05 -- nvmf/common.sh@296 -- # x722=() 00:16:45.985 11:41:05 -- nvmf/common.sh@296 -- # local -ga x722 00:16:45.985 11:41:05 -- nvmf/common.sh@297 -- # mlx=() 00:16:45.985 11:41:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:45.985 11:41:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:45.985 11:41:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:45.985 11:41:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:45.985 11:41:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:45.985 11:41:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:45.985 11:41:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:45.985 11:41:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:45.985 11:41:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:45.985 11:41:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:45.985 11:41:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:45.985 11:41:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:45.985 11:41:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:45.985 11:41:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:45.985 11:41:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:45.985 11:41:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:45.985 11:41:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:45.985 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:45.985 11:41:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:45.985 11:41:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:45.985 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:45.985 11:41:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:45.985 11:41:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:45.985 11:41:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:45.985 11:41:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:45.985 11:41:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:45.985 11:41:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:45.985 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:45.985 11:41:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:45.985 11:41:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:45.985 11:41:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:45.985 11:41:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:45.985 11:41:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:45.985 11:41:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:45.985 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:45.985 11:41:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:45.985 11:41:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:45.985 11:41:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:45.985 11:41:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:45.985 11:41:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:45.985 11:41:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:45.985 11:41:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:45.985 11:41:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:45.985 11:41:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:45.985 11:41:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:45.985 11:41:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:45.985 11:41:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:45.985 11:41:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:45.985 11:41:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:45.985 11:41:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:45.985 11:41:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:45.985 11:41:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:45.985 11:41:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:45.985 11:41:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:45.985 11:41:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:45.985 11:41:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:45.985 11:41:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:45.985 11:41:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:45.985 11:41:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:45.985 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:45.985 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:16:45.985 00:16:45.985 --- 10.0.0.2 ping statistics --- 00:16:45.985 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:45.985 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:16:45.985 11:41:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:45.985 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:45.985 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.157 ms 00:16:45.985 00:16:45.985 --- 10.0.0.1 ping statistics --- 00:16:45.985 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:45.985 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:16:45.985 11:41:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:45.985 11:41:05 -- nvmf/common.sh@410 -- # return 0 00:16:45.985 11:41:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:45.985 11:41:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:45.985 11:41:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:45.985 11:41:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:45.986 11:41:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:45.986 11:41:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:45.986 11:41:05 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:16:45.986 11:41:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:45.986 11:41:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:45.986 11:41:05 -- common/autotest_common.sh@10 -- # set +x 00:16:45.986 11:41:05 -- nvmf/common.sh@469 -- # nvmfpid=3821975 00:16:45.986 11:41:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:16:45.986 11:41:05 -- nvmf/common.sh@470 -- # waitforlisten 3821975 00:16:45.986 11:41:05 -- common/autotest_common.sh@829 -- # '[' -z 3821975 ']' 00:16:45.986 11:41:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:45.986 11:41:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:45.986 11:41:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:45.986 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:45.986 11:41:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:45.986 11:41:05 -- common/autotest_common.sh@10 -- # set +x 00:16:45.986 [2024-11-28 11:41:05.917556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:45.986 [2024-11-28 11:41:05.917657] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:45.986 EAL: No free 2048 kB hugepages reported on node 1 00:16:45.986 [2024-11-28 11:41:05.991039] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:46.246 [2024-11-28 11:41:06.111852] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:46.246 [2024-11-28 11:41:06.112010] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:46.246 [2024-11-28 11:41:06.112028] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:46.246 [2024-11-28 11:41:06.112043] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:46.246 [2024-11-28 11:41:06.112072] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:46.246 11:41:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:46.246 11:41:06 -- common/autotest_common.sh@862 -- # return 0 00:16:46.246 11:41:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:46.246 11:41:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:46.246 11:41:06 -- common/autotest_common.sh@10 -- # set +x 00:16:46.246 11:41:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:46.246 11:41:06 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:16:46.246 11:41:06 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:16:46.504 true 00:16:46.504 11:41:06 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:46.504 11:41:06 -- target/tls.sh@82 -- # jq -r .tls_version 00:16:46.763 11:41:06 -- target/tls.sh@82 -- # version=0 00:16:46.763 11:41:06 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:16:46.763 11:41:06 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:47.023 11:41:06 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:47.023 11:41:06 -- target/tls.sh@90 -- # jq -r .tls_version 00:16:47.282 11:41:07 -- target/tls.sh@90 -- # version=13 00:16:47.282 11:41:07 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:16:47.282 11:41:07 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:16:47.542 11:41:07 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:47.542 11:41:07 -- target/tls.sh@98 -- # jq -r .tls_version 00:16:47.801 11:41:07 -- target/tls.sh@98 -- # version=7 00:16:47.801 11:41:07 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:16:47.801 11:41:07 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:47.801 11:41:07 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:16:48.059 11:41:08 -- target/tls.sh@105 -- # ktls=false 00:16:48.059 11:41:08 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:16:48.059 11:41:08 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:16:48.319 11:41:08 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:48.319 11:41:08 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:16:48.578 11:41:08 -- target/tls.sh@113 -- # ktls=true 00:16:48.578 11:41:08 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:16:48.578 11:41:08 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:16:48.837 11:41:08 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:48.837 11:41:08 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:16:49.095 11:41:09 -- target/tls.sh@121 -- # ktls=false 00:16:49.095 11:41:09 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:16:49.095 11:41:09 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:16:49.095 11:41:09 -- target/tls.sh@49 -- # local key hash crc 00:16:49.095 11:41:09 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:16:49.095 11:41:09 -- target/tls.sh@51 -- # hash=01 00:16:49.095 11:41:09 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:16:49.095 11:41:09 -- target/tls.sh@52 -- # gzip -1 -c 00:16:49.095 11:41:09 -- target/tls.sh@52 -- # tail -c8 00:16:49.095 11:41:09 -- target/tls.sh@52 -- # head -c 4 00:16:49.095 11:41:09 -- target/tls.sh@52 -- # crc='p$H�' 00:16:49.095 11:41:09 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:49.095 11:41:09 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:16:49.095 11:41:09 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:49.095 11:41:09 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:49.095 11:41:09 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:16:49.095 11:41:09 -- target/tls.sh@49 -- # local key hash crc 00:16:49.095 11:41:09 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:16:49.095 11:41:09 -- target/tls.sh@51 -- # hash=01 00:16:49.095 11:41:09 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:16:49.095 11:41:09 -- target/tls.sh@52 -- # gzip -1 -c 00:16:49.095 11:41:09 -- target/tls.sh@52 -- # tail -c8 00:16:49.095 11:41:09 -- target/tls.sh@52 -- # head -c 4 00:16:49.095 11:41:09 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:16:49.095 11:41:09 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:49.095 11:41:09 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:16:49.095 11:41:09 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:49.095 11:41:09 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:49.095 11:41:09 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:49.095 11:41:09 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:49.096 11:41:09 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:49.096 11:41:09 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:49.096 11:41:09 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:49.096 11:41:09 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:49.096 11:41:09 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:49.354 11:41:09 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:16:49.921 11:41:09 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:49.921 11:41:09 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:49.921 11:41:09 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:50.178 [2024-11-28 11:41:10.045835] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:50.178 11:41:10 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:50.436 11:41:10 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:16:50.694 [2024-11-28 11:41:10.543118] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:50.694 [2024-11-28 11:41:10.543355] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:50.694 11:41:10 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:50.952 malloc0 00:16:50.952 11:41:10 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:51.210 11:41:11 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:51.469 11:41:11 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:51.469 EAL: No free 2048 kB hugepages reported on node 1 00:17:01.459 Initializing NVMe Controllers 00:17:01.459 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:01.459 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:01.459 Initialization complete. Launching workers. 00:17:01.459 ======================================================== 00:17:01.459 Latency(us) 00:17:01.459 Device Information : IOPS MiB/s Average min max 00:17:01.459 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7806.51 30.49 8200.94 1289.96 11198.22 00:17:01.459 ======================================================== 00:17:01.459 Total : 7806.51 30.49 8200.94 1289.96 11198.22 00:17:01.459 00:17:01.459 11:41:21 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:01.459 11:41:21 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:01.459 11:41:21 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:01.459 11:41:21 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:01.459 11:41:21 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:01.459 11:41:21 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:01.459 11:41:21 -- target/tls.sh@28 -- # bdevperf_pid=3823942 00:17:01.459 11:41:21 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:01.459 11:41:21 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:01.460 11:41:21 -- target/tls.sh@31 -- # waitforlisten 3823942 /var/tmp/bdevperf.sock 00:17:01.460 11:41:21 -- common/autotest_common.sh@829 -- # '[' -z 3823942 ']' 00:17:01.460 11:41:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:01.460 11:41:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:01.460 11:41:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:01.460 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:01.460 11:41:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:01.460 11:41:21 -- common/autotest_common.sh@10 -- # set +x 00:17:01.718 [2024-11-28 11:41:21.518487] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:01.718 [2024-11-28 11:41:21.518598] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3823942 ] 00:17:01.718 EAL: No free 2048 kB hugepages reported on node 1 00:17:01.718 [2024-11-28 11:41:21.576742] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:01.718 [2024-11-28 11:41:21.688010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:02.654 11:41:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:02.654 11:41:22 -- common/autotest_common.sh@862 -- # return 0 00:17:02.654 11:41:22 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:02.912 [2024-11-28 11:41:22.794646] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:02.912 TLSTESTn1 00:17:02.912 11:41:22 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:03.170 Running I/O for 10 seconds... 00:17:13.157 00:17:13.157 Latency(us) 00:17:13.157 [2024-11-28T10:41:33.213Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:13.157 [2024-11-28T10:41:33.213Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:13.157 Verification LBA range: start 0x0 length 0x2000 00:17:13.157 TLSTESTn1 : 10.02 3537.83 13.82 0.00 0.00 36130.02 4636.07 49516.09 00:17:13.157 [2024-11-28T10:41:33.213Z] =================================================================================================================== 00:17:13.157 [2024-11-28T10:41:33.213Z] Total : 3537.83 13.82 0.00 0.00 36130.02 4636.07 49516.09 00:17:13.157 0 00:17:13.157 11:41:33 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:13.157 11:41:33 -- target/tls.sh@45 -- # killprocess 3823942 00:17:13.157 11:41:33 -- common/autotest_common.sh@936 -- # '[' -z 3823942 ']' 00:17:13.157 11:41:33 -- common/autotest_common.sh@940 -- # kill -0 3823942 00:17:13.157 11:41:33 -- common/autotest_common.sh@941 -- # uname 00:17:13.157 11:41:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:13.157 11:41:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3823942 00:17:13.157 11:41:33 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:13.157 11:41:33 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:13.157 11:41:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3823942' 00:17:13.157 killing process with pid 3823942 00:17:13.157 11:41:33 -- common/autotest_common.sh@955 -- # kill 3823942 00:17:13.157 Received shutdown signal, test time was about 10.000000 seconds 00:17:13.157 00:17:13.157 Latency(us) 00:17:13.157 [2024-11-28T10:41:33.213Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:13.157 [2024-11-28T10:41:33.213Z] =================================================================================================================== 00:17:13.157 [2024-11-28T10:41:33.213Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:13.157 11:41:33 -- common/autotest_common.sh@960 -- # wait 3823942 00:17:13.416 11:41:33 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:13.416 11:41:33 -- common/autotest_common.sh@650 -- # local es=0 00:17:13.416 11:41:33 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:13.416 11:41:33 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:13.416 11:41:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:13.416 11:41:33 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:13.416 11:41:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:13.416 11:41:33 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:13.416 11:41:33 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:13.416 11:41:33 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:13.416 11:41:33 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:13.416 11:41:33 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:13.416 11:41:33 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:13.416 11:41:33 -- target/tls.sh@28 -- # bdevperf_pid=3825312 00:17:13.416 11:41:33 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:13.416 11:41:33 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:13.416 11:41:33 -- target/tls.sh@31 -- # waitforlisten 3825312 /var/tmp/bdevperf.sock 00:17:13.416 11:41:33 -- common/autotest_common.sh@829 -- # '[' -z 3825312 ']' 00:17:13.416 11:41:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:13.416 11:41:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:13.416 11:41:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:13.416 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:13.416 11:41:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:13.416 11:41:33 -- common/autotest_common.sh@10 -- # set +x 00:17:13.416 [2024-11-28 11:41:33.413572] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:13.416 [2024-11-28 11:41:33.413650] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3825312 ] 00:17:13.416 EAL: No free 2048 kB hugepages reported on node 1 00:17:13.416 [2024-11-28 11:41:33.471318] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:13.677 [2024-11-28 11:41:33.576833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:14.612 11:41:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:14.612 11:41:34 -- common/autotest_common.sh@862 -- # return 0 00:17:14.612 11:41:34 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:14.612 [2024-11-28 11:41:34.611264] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:14.612 [2024-11-28 11:41:34.616516] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:14.612 [2024-11-28 11:41:34.617074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd81f0 (107): Transport endpoint is not connected 00:17:14.612 [2024-11-28 11:41:34.618056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd81f0 (9): Bad file descriptor 00:17:14.612 [2024-11-28 11:41:34.619055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:14.612 [2024-11-28 11:41:34.619074] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:14.612 [2024-11-28 11:41:34.619103] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:14.612 request: 00:17:14.612 { 00:17:14.612 "name": "TLSTEST", 00:17:14.612 "trtype": "tcp", 00:17:14.612 "traddr": "10.0.0.2", 00:17:14.612 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:14.612 "adrfam": "ipv4", 00:17:14.612 "trsvcid": "4420", 00:17:14.612 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:14.612 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:14.612 "method": "bdev_nvme_attach_controller", 00:17:14.612 "req_id": 1 00:17:14.612 } 00:17:14.612 Got JSON-RPC error response 00:17:14.612 response: 00:17:14.612 { 00:17:14.612 "code": -32602, 00:17:14.612 "message": "Invalid parameters" 00:17:14.612 } 00:17:14.612 11:41:34 -- target/tls.sh@36 -- # killprocess 3825312 00:17:14.612 11:41:34 -- common/autotest_common.sh@936 -- # '[' -z 3825312 ']' 00:17:14.612 11:41:34 -- common/autotest_common.sh@940 -- # kill -0 3825312 00:17:14.612 11:41:34 -- common/autotest_common.sh@941 -- # uname 00:17:14.612 11:41:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:14.612 11:41:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3825312 00:17:14.872 11:41:34 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:14.872 11:41:34 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:14.872 11:41:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3825312' 00:17:14.872 killing process with pid 3825312 00:17:14.872 11:41:34 -- common/autotest_common.sh@955 -- # kill 3825312 00:17:14.872 Received shutdown signal, test time was about 10.000000 seconds 00:17:14.872 00:17:14.872 Latency(us) 00:17:14.872 [2024-11-28T10:41:34.928Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:14.872 [2024-11-28T10:41:34.928Z] =================================================================================================================== 00:17:14.872 [2024-11-28T10:41:34.928Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:14.872 11:41:34 -- common/autotest_common.sh@960 -- # wait 3825312 00:17:15.133 11:41:34 -- target/tls.sh@37 -- # return 1 00:17:15.133 11:41:34 -- common/autotest_common.sh@653 -- # es=1 00:17:15.133 11:41:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:15.133 11:41:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:15.133 11:41:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:15.133 11:41:34 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:15.133 11:41:34 -- common/autotest_common.sh@650 -- # local es=0 00:17:15.133 11:41:34 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:15.133 11:41:34 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:15.133 11:41:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:15.133 11:41:34 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:15.133 11:41:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:15.133 11:41:34 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:15.133 11:41:34 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:15.133 11:41:34 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:15.133 11:41:34 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:15.133 11:41:34 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:15.133 11:41:34 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:15.133 11:41:34 -- target/tls.sh@28 -- # bdevperf_pid=3825584 00:17:15.133 11:41:34 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:15.133 11:41:34 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:15.133 11:41:34 -- target/tls.sh@31 -- # waitforlisten 3825584 /var/tmp/bdevperf.sock 00:17:15.133 11:41:34 -- common/autotest_common.sh@829 -- # '[' -z 3825584 ']' 00:17:15.133 11:41:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:15.133 11:41:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:15.133 11:41:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:15.133 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:15.133 11:41:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:15.133 11:41:34 -- common/autotest_common.sh@10 -- # set +x 00:17:15.133 [2024-11-28 11:41:34.972939] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:15.133 [2024-11-28 11:41:34.973015] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3825584 ] 00:17:15.133 EAL: No free 2048 kB hugepages reported on node 1 00:17:15.133 [2024-11-28 11:41:35.029233] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:15.133 [2024-11-28 11:41:35.130407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:16.070 11:41:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:16.070 11:41:35 -- common/autotest_common.sh@862 -- # return 0 00:17:16.070 11:41:35 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:16.328 [2024-11-28 11:41:36.156340] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:16.328 [2024-11-28 11:41:36.161539] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:16.328 [2024-11-28 11:41:36.161585] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:16.328 [2024-11-28 11:41:36.161625] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:16.328 [2024-11-28 11:41:36.162123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9281f0 (107): Transport endpoint is not connected 00:17:16.328 [2024-11-28 11:41:36.163109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9281f0 (9): Bad file descriptor 00:17:16.328 [2024-11-28 11:41:36.164109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:16.328 [2024-11-28 11:41:36.164129] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:16.328 [2024-11-28 11:41:36.164158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:16.328 request: 00:17:16.328 { 00:17:16.328 "name": "TLSTEST", 00:17:16.328 "trtype": "tcp", 00:17:16.328 "traddr": "10.0.0.2", 00:17:16.328 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:16.328 "adrfam": "ipv4", 00:17:16.328 "trsvcid": "4420", 00:17:16.328 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:16.328 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:16.328 "method": "bdev_nvme_attach_controller", 00:17:16.328 "req_id": 1 00:17:16.328 } 00:17:16.328 Got JSON-RPC error response 00:17:16.328 response: 00:17:16.328 { 00:17:16.328 "code": -32602, 00:17:16.328 "message": "Invalid parameters" 00:17:16.328 } 00:17:16.328 11:41:36 -- target/tls.sh@36 -- # killprocess 3825584 00:17:16.328 11:41:36 -- common/autotest_common.sh@936 -- # '[' -z 3825584 ']' 00:17:16.328 11:41:36 -- common/autotest_common.sh@940 -- # kill -0 3825584 00:17:16.328 11:41:36 -- common/autotest_common.sh@941 -- # uname 00:17:16.328 11:41:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:16.328 11:41:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3825584 00:17:16.328 11:41:36 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:16.328 11:41:36 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:16.328 11:41:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3825584' 00:17:16.328 killing process with pid 3825584 00:17:16.328 11:41:36 -- common/autotest_common.sh@955 -- # kill 3825584 00:17:16.328 Received shutdown signal, test time was about 10.000000 seconds 00:17:16.328 00:17:16.328 Latency(us) 00:17:16.328 [2024-11-28T10:41:36.384Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:16.328 [2024-11-28T10:41:36.384Z] =================================================================================================================== 00:17:16.328 [2024-11-28T10:41:36.384Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:16.328 11:41:36 -- common/autotest_common.sh@960 -- # wait 3825584 00:17:16.586 11:41:36 -- target/tls.sh@37 -- # return 1 00:17:16.586 11:41:36 -- common/autotest_common.sh@653 -- # es=1 00:17:16.586 11:41:36 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:16.586 11:41:36 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:16.586 11:41:36 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:16.586 11:41:36 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:16.586 11:41:36 -- common/autotest_common.sh@650 -- # local es=0 00:17:16.586 11:41:36 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:16.586 11:41:36 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:16.586 11:41:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:16.586 11:41:36 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:16.587 11:41:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:16.587 11:41:36 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:16.587 11:41:36 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:16.587 11:41:36 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:16.587 11:41:36 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:16.587 11:41:36 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:16.587 11:41:36 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:16.587 11:41:36 -- target/tls.sh@28 -- # bdevperf_pid=3825736 00:17:16.587 11:41:36 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:16.587 11:41:36 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:16.587 11:41:36 -- target/tls.sh@31 -- # waitforlisten 3825736 /var/tmp/bdevperf.sock 00:17:16.587 11:41:36 -- common/autotest_common.sh@829 -- # '[' -z 3825736 ']' 00:17:16.587 11:41:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:16.587 11:41:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:16.587 11:41:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:16.587 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:16.587 11:41:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:16.587 11:41:36 -- common/autotest_common.sh@10 -- # set +x 00:17:16.587 [2024-11-28 11:41:36.518475] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:16.587 [2024-11-28 11:41:36.518598] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3825736 ] 00:17:16.587 EAL: No free 2048 kB hugepages reported on node 1 00:17:16.587 [2024-11-28 11:41:36.578395] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:16.845 [2024-11-28 11:41:36.682176] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:17.783 11:41:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:17.783 11:41:37 -- common/autotest_common.sh@862 -- # return 0 00:17:17.783 11:41:37 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:17.783 [2024-11-28 11:41:37.706877] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:17.783 [2024-11-28 11:41:37.714369] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:17.783 [2024-11-28 11:41:37.714399] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:17.783 [2024-11-28 11:41:37.714451] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:17.783 [2024-11-28 11:41:37.714617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9741f0 (107): Transport endpoint is not connected 00:17:17.783 [2024-11-28 11:41:37.715607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9741f0 (9): Bad file descriptor 00:17:17.783 [2024-11-28 11:41:37.716607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:17.783 [2024-11-28 11:41:37.716627] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:17.783 [2024-11-28 11:41:37.716642] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:17.783 request: 00:17:17.783 { 00:17:17.783 "name": "TLSTEST", 00:17:17.783 "trtype": "tcp", 00:17:17.783 "traddr": "10.0.0.2", 00:17:17.783 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:17.783 "adrfam": "ipv4", 00:17:17.783 "trsvcid": "4420", 00:17:17.783 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:17.783 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:17.783 "method": "bdev_nvme_attach_controller", 00:17:17.783 "req_id": 1 00:17:17.783 } 00:17:17.783 Got JSON-RPC error response 00:17:17.783 response: 00:17:17.783 { 00:17:17.783 "code": -32602, 00:17:17.783 "message": "Invalid parameters" 00:17:17.783 } 00:17:17.783 11:41:37 -- target/tls.sh@36 -- # killprocess 3825736 00:17:17.783 11:41:37 -- common/autotest_common.sh@936 -- # '[' -z 3825736 ']' 00:17:17.783 11:41:37 -- common/autotest_common.sh@940 -- # kill -0 3825736 00:17:17.783 11:41:37 -- common/autotest_common.sh@941 -- # uname 00:17:17.783 11:41:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:17.783 11:41:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3825736 00:17:17.783 11:41:37 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:17.783 11:41:37 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:17.783 11:41:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3825736' 00:17:17.783 killing process with pid 3825736 00:17:17.783 11:41:37 -- common/autotest_common.sh@955 -- # kill 3825736 00:17:17.783 Received shutdown signal, test time was about 10.000000 seconds 00:17:17.783 00:17:17.783 Latency(us) 00:17:17.783 [2024-11-28T10:41:37.839Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:17.783 [2024-11-28T10:41:37.839Z] =================================================================================================================== 00:17:17.783 [2024-11-28T10:41:37.839Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:17.783 11:41:37 -- common/autotest_common.sh@960 -- # wait 3825736 00:17:18.043 11:41:38 -- target/tls.sh@37 -- # return 1 00:17:18.043 11:41:38 -- common/autotest_common.sh@653 -- # es=1 00:17:18.043 11:41:38 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:18.043 11:41:38 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:18.043 11:41:38 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:18.043 11:41:38 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:18.043 11:41:38 -- common/autotest_common.sh@650 -- # local es=0 00:17:18.043 11:41:38 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:18.043 11:41:38 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:18.043 11:41:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:18.043 11:41:38 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:18.043 11:41:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:18.043 11:41:38 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:18.043 11:41:38 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:18.043 11:41:38 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:18.043 11:41:38 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:18.043 11:41:38 -- target/tls.sh@23 -- # psk= 00:17:18.043 11:41:38 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:18.043 11:41:38 -- target/tls.sh@28 -- # bdevperf_pid=3825894 00:17:18.043 11:41:38 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:18.043 11:41:38 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:18.043 11:41:38 -- target/tls.sh@31 -- # waitforlisten 3825894 /var/tmp/bdevperf.sock 00:17:18.043 11:41:38 -- common/autotest_common.sh@829 -- # '[' -z 3825894 ']' 00:17:18.043 11:41:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:18.043 11:41:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:18.043 11:41:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:18.043 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:18.043 11:41:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:18.043 11:41:38 -- common/autotest_common.sh@10 -- # set +x 00:17:18.043 [2024-11-28 11:41:38.077383] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:18.043 [2024-11-28 11:41:38.077474] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3825894 ] 00:17:18.303 EAL: No free 2048 kB hugepages reported on node 1 00:17:18.303 [2024-11-28 11:41:38.139594] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:18.303 [2024-11-28 11:41:38.251007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:19.239 11:41:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:19.239 11:41:39 -- common/autotest_common.sh@862 -- # return 0 00:17:19.239 11:41:39 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:19.497 [2024-11-28 11:41:39.308585] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:19.497 [2024-11-28 11:41:39.310624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22f0050 (9): Bad file descriptor 00:17:19.497 [2024-11-28 11:41:39.311621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:19.497 [2024-11-28 11:41:39.311643] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:19.497 [2024-11-28 11:41:39.311659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:19.497 request: 00:17:19.497 { 00:17:19.497 "name": "TLSTEST", 00:17:19.497 "trtype": "tcp", 00:17:19.497 "traddr": "10.0.0.2", 00:17:19.497 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:19.497 "adrfam": "ipv4", 00:17:19.497 "trsvcid": "4420", 00:17:19.497 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:19.497 "method": "bdev_nvme_attach_controller", 00:17:19.497 "req_id": 1 00:17:19.497 } 00:17:19.497 Got JSON-RPC error response 00:17:19.497 response: 00:17:19.497 { 00:17:19.497 "code": -32602, 00:17:19.497 "message": "Invalid parameters" 00:17:19.497 } 00:17:19.497 11:41:39 -- target/tls.sh@36 -- # killprocess 3825894 00:17:19.497 11:41:39 -- common/autotest_common.sh@936 -- # '[' -z 3825894 ']' 00:17:19.497 11:41:39 -- common/autotest_common.sh@940 -- # kill -0 3825894 00:17:19.497 11:41:39 -- common/autotest_common.sh@941 -- # uname 00:17:19.497 11:41:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:19.497 11:41:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3825894 00:17:19.497 11:41:39 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:19.497 11:41:39 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:19.497 11:41:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3825894' 00:17:19.497 killing process with pid 3825894 00:17:19.497 11:41:39 -- common/autotest_common.sh@955 -- # kill 3825894 00:17:19.497 Received shutdown signal, test time was about 10.000000 seconds 00:17:19.497 00:17:19.497 Latency(us) 00:17:19.497 [2024-11-28T10:41:39.553Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:19.497 [2024-11-28T10:41:39.553Z] =================================================================================================================== 00:17:19.497 [2024-11-28T10:41:39.554Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:19.498 11:41:39 -- common/autotest_common.sh@960 -- # wait 3825894 00:17:19.756 11:41:39 -- target/tls.sh@37 -- # return 1 00:17:19.756 11:41:39 -- common/autotest_common.sh@653 -- # es=1 00:17:19.756 11:41:39 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:19.756 11:41:39 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:19.756 11:41:39 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:19.756 11:41:39 -- target/tls.sh@167 -- # killprocess 3821975 00:17:19.756 11:41:39 -- common/autotest_common.sh@936 -- # '[' -z 3821975 ']' 00:17:19.756 11:41:39 -- common/autotest_common.sh@940 -- # kill -0 3821975 00:17:19.756 11:41:39 -- common/autotest_common.sh@941 -- # uname 00:17:19.756 11:41:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:19.756 11:41:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3821975 00:17:19.756 11:41:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:19.756 11:41:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:19.756 11:41:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3821975' 00:17:19.756 killing process with pid 3821975 00:17:19.756 11:41:39 -- common/autotest_common.sh@955 -- # kill 3821975 00:17:19.756 11:41:39 -- common/autotest_common.sh@960 -- # wait 3821975 00:17:20.016 11:41:39 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:20.016 11:41:39 -- target/tls.sh@49 -- # local key hash crc 00:17:20.016 11:41:39 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:20.016 11:41:39 -- target/tls.sh@51 -- # hash=02 00:17:20.016 11:41:39 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:20.016 11:41:39 -- target/tls.sh@52 -- # gzip -1 -c 00:17:20.016 11:41:39 -- target/tls.sh@52 -- # tail -c8 00:17:20.016 11:41:39 -- target/tls.sh@52 -- # head -c 4 00:17:20.016 11:41:39 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:20.016 11:41:39 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:20.016 11:41:39 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:20.016 11:41:39 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:20.016 11:41:39 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:20.016 11:41:39 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:20.016 11:41:39 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:20.016 11:41:39 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:20.016 11:41:39 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:20.016 11:41:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:20.016 11:41:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:20.016 11:41:39 -- common/autotest_common.sh@10 -- # set +x 00:17:20.016 11:41:39 -- nvmf/common.sh@469 -- # nvmfpid=3826182 00:17:20.016 11:41:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:20.016 11:41:39 -- nvmf/common.sh@470 -- # waitforlisten 3826182 00:17:20.016 11:41:39 -- common/autotest_common.sh@829 -- # '[' -z 3826182 ']' 00:17:20.016 11:41:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:20.016 11:41:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:20.016 11:41:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:20.016 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:20.016 11:41:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:20.016 11:41:39 -- common/autotest_common.sh@10 -- # set +x 00:17:20.016 [2024-11-28 11:41:40.018104] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:20.016 [2024-11-28 11:41:40.018207] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:20.016 EAL: No free 2048 kB hugepages reported on node 1 00:17:20.274 [2024-11-28 11:41:40.096294] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:20.274 [2024-11-28 11:41:40.211884] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:20.274 [2024-11-28 11:41:40.212059] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:20.274 [2024-11-28 11:41:40.212078] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:20.274 [2024-11-28 11:41:40.212092] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:20.274 [2024-11-28 11:41:40.212123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:21.214 11:41:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:21.214 11:41:41 -- common/autotest_common.sh@862 -- # return 0 00:17:21.214 11:41:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:21.214 11:41:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:21.214 11:41:41 -- common/autotest_common.sh@10 -- # set +x 00:17:21.214 11:41:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:21.214 11:41:41 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:21.214 11:41:41 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:21.214 11:41:41 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:21.472 [2024-11-28 11:41:41.338478] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:21.473 11:41:41 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:21.731 11:41:41 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:21.989 [2024-11-28 11:41:41.908029] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:21.989 [2024-11-28 11:41:41.908284] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:21.989 11:41:41 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:22.247 malloc0 00:17:22.248 11:41:42 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:22.506 11:41:42 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:22.764 11:41:42 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:22.764 11:41:42 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:22.764 11:41:42 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:22.764 11:41:42 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:22.764 11:41:42 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:22.764 11:41:42 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:22.764 11:41:42 -- target/tls.sh@28 -- # bdevperf_pid=3826606 00:17:22.764 11:41:42 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:22.764 11:41:42 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:22.764 11:41:42 -- target/tls.sh@31 -- # waitforlisten 3826606 /var/tmp/bdevperf.sock 00:17:22.764 11:41:42 -- common/autotest_common.sh@829 -- # '[' -z 3826606 ']' 00:17:22.764 11:41:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:22.764 11:41:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:22.764 11:41:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:22.764 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:22.764 11:41:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:22.764 11:41:42 -- common/autotest_common.sh@10 -- # set +x 00:17:22.764 [2024-11-28 11:41:42.812134] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:22.764 [2024-11-28 11:41:42.812205] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3826606 ] 00:17:23.024 EAL: No free 2048 kB hugepages reported on node 1 00:17:23.025 [2024-11-28 11:41:42.868785] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:23.025 [2024-11-28 11:41:42.971600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:23.965 11:41:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:23.965 11:41:43 -- common/autotest_common.sh@862 -- # return 0 00:17:23.965 11:41:43 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:23.965 [2024-11-28 11:41:44.004429] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:24.241 TLSTESTn1 00:17:24.241 11:41:44 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:24.241 Running I/O for 10 seconds... 00:17:34.276 00:17:34.276 Latency(us) 00:17:34.276 [2024-11-28T10:41:54.332Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:34.276 [2024-11-28T10:41:54.332Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:34.276 Verification LBA range: start 0x0 length 0x2000 00:17:34.276 TLSTESTn1 : 10.02 2739.12 10.70 0.00 0.00 46651.71 5849.69 52428.80 00:17:34.276 [2024-11-28T10:41:54.332Z] =================================================================================================================== 00:17:34.276 [2024-11-28T10:41:54.332Z] Total : 2739.12 10.70 0.00 0.00 46651.71 5849.69 52428.80 00:17:34.276 0 00:17:34.276 11:41:54 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:34.276 11:41:54 -- target/tls.sh@45 -- # killprocess 3826606 00:17:34.276 11:41:54 -- common/autotest_common.sh@936 -- # '[' -z 3826606 ']' 00:17:34.276 11:41:54 -- common/autotest_common.sh@940 -- # kill -0 3826606 00:17:34.276 11:41:54 -- common/autotest_common.sh@941 -- # uname 00:17:34.276 11:41:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:34.276 11:41:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3826606 00:17:34.276 11:41:54 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:34.276 11:41:54 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:34.276 11:41:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3826606' 00:17:34.276 killing process with pid 3826606 00:17:34.276 11:41:54 -- common/autotest_common.sh@955 -- # kill 3826606 00:17:34.276 Received shutdown signal, test time was about 10.000000 seconds 00:17:34.276 00:17:34.276 Latency(us) 00:17:34.276 [2024-11-28T10:41:54.332Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:34.276 [2024-11-28T10:41:54.332Z] =================================================================================================================== 00:17:34.276 [2024-11-28T10:41:54.332Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:34.276 11:41:54 -- common/autotest_common.sh@960 -- # wait 3826606 00:17:34.534 11:41:54 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:34.534 11:41:54 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:34.534 11:41:54 -- common/autotest_common.sh@650 -- # local es=0 00:17:34.534 11:41:54 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:34.534 11:41:54 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:34.534 11:41:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:34.534 11:41:54 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:34.534 11:41:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:34.534 11:41:54 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:34.534 11:41:54 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:34.534 11:41:54 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:34.534 11:41:54 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:34.534 11:41:54 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:34.534 11:41:54 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:34.534 11:41:54 -- target/tls.sh@28 -- # bdevperf_pid=3827976 00:17:34.534 11:41:54 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:34.534 11:41:54 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:34.534 11:41:54 -- target/tls.sh@31 -- # waitforlisten 3827976 /var/tmp/bdevperf.sock 00:17:34.534 11:41:54 -- common/autotest_common.sh@829 -- # '[' -z 3827976 ']' 00:17:34.534 11:41:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:34.534 11:41:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:34.534 11:41:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:34.534 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:34.534 11:41:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:34.534 11:41:54 -- common/autotest_common.sh@10 -- # set +x 00:17:34.534 [2024-11-28 11:41:54.566328] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:34.534 [2024-11-28 11:41:54.566407] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3827976 ] 00:17:34.793 EAL: No free 2048 kB hugepages reported on node 1 00:17:34.793 [2024-11-28 11:41:54.625232] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:34.793 [2024-11-28 11:41:54.738570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:35.728 11:41:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:35.728 11:41:55 -- common/autotest_common.sh@862 -- # return 0 00:17:35.728 11:41:55 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:35.988 [2024-11-28 11:41:55.878095] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:35.988 [2024-11-28 11:41:55.878173] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:35.988 request: 00:17:35.988 { 00:17:35.988 "name": "TLSTEST", 00:17:35.988 "trtype": "tcp", 00:17:35.988 "traddr": "10.0.0.2", 00:17:35.988 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:35.988 "adrfam": "ipv4", 00:17:35.988 "trsvcid": "4420", 00:17:35.988 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:35.988 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:35.988 "method": "bdev_nvme_attach_controller", 00:17:35.988 "req_id": 1 00:17:35.988 } 00:17:35.988 Got JSON-RPC error response 00:17:35.988 response: 00:17:35.988 { 00:17:35.988 "code": -22, 00:17:35.988 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:35.988 } 00:17:35.988 11:41:55 -- target/tls.sh@36 -- # killprocess 3827976 00:17:35.988 11:41:55 -- common/autotest_common.sh@936 -- # '[' -z 3827976 ']' 00:17:35.988 11:41:55 -- common/autotest_common.sh@940 -- # kill -0 3827976 00:17:35.988 11:41:55 -- common/autotest_common.sh@941 -- # uname 00:17:35.988 11:41:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:35.988 11:41:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3827976 00:17:35.988 11:41:55 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:35.988 11:41:55 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:35.988 11:41:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3827976' 00:17:35.988 killing process with pid 3827976 00:17:35.988 11:41:55 -- common/autotest_common.sh@955 -- # kill 3827976 00:17:35.988 Received shutdown signal, test time was about 10.000000 seconds 00:17:35.988 00:17:35.988 Latency(us) 00:17:35.988 [2024-11-28T10:41:56.044Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:35.988 [2024-11-28T10:41:56.044Z] =================================================================================================================== 00:17:35.988 [2024-11-28T10:41:56.044Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:35.988 11:41:55 -- common/autotest_common.sh@960 -- # wait 3827976 00:17:36.248 11:41:56 -- target/tls.sh@37 -- # return 1 00:17:36.248 11:41:56 -- common/autotest_common.sh@653 -- # es=1 00:17:36.248 11:41:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:36.248 11:41:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:36.248 11:41:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:36.248 11:41:56 -- target/tls.sh@183 -- # killprocess 3826182 00:17:36.248 11:41:56 -- common/autotest_common.sh@936 -- # '[' -z 3826182 ']' 00:17:36.248 11:41:56 -- common/autotest_common.sh@940 -- # kill -0 3826182 00:17:36.248 11:41:56 -- common/autotest_common.sh@941 -- # uname 00:17:36.248 11:41:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:36.248 11:41:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3826182 00:17:36.248 11:41:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:36.248 11:41:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:36.248 11:41:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3826182' 00:17:36.248 killing process with pid 3826182 00:17:36.248 11:41:56 -- common/autotest_common.sh@955 -- # kill 3826182 00:17:36.248 11:41:56 -- common/autotest_common.sh@960 -- # wait 3826182 00:17:36.508 11:41:56 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:17:36.508 11:41:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:36.508 11:41:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:36.508 11:41:56 -- common/autotest_common.sh@10 -- # set +x 00:17:36.508 11:41:56 -- nvmf/common.sh@469 -- # nvmfpid=3828260 00:17:36.508 11:41:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:36.508 11:41:56 -- nvmf/common.sh@470 -- # waitforlisten 3828260 00:17:36.508 11:41:56 -- common/autotest_common.sh@829 -- # '[' -z 3828260 ']' 00:17:36.508 11:41:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:36.508 11:41:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:36.508 11:41:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:36.508 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:36.508 11:41:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:36.508 11:41:56 -- common/autotest_common.sh@10 -- # set +x 00:17:36.768 [2024-11-28 11:41:56.582487] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:36.768 [2024-11-28 11:41:56.582605] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:36.768 EAL: No free 2048 kB hugepages reported on node 1 00:17:36.768 [2024-11-28 11:41:56.647003] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:36.768 [2024-11-28 11:41:56.756435] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:36.768 [2024-11-28 11:41:56.756623] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:36.768 [2024-11-28 11:41:56.756642] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:36.768 [2024-11-28 11:41:56.756654] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:36.768 [2024-11-28 11:41:56.756684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:37.705 11:41:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:37.705 11:41:57 -- common/autotest_common.sh@862 -- # return 0 00:17:37.705 11:41:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:37.705 11:41:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:37.705 11:41:57 -- common/autotest_common.sh@10 -- # set +x 00:17:37.705 11:41:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:37.705 11:41:57 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:37.706 11:41:57 -- common/autotest_common.sh@650 -- # local es=0 00:17:37.706 11:41:57 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:37.706 11:41:57 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:17:37.706 11:41:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:37.706 11:41:57 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:17:37.706 11:41:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:37.706 11:41:57 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:37.706 11:41:57 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:37.706 11:41:57 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:37.966 [2024-11-28 11:41:57.852169] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:37.966 11:41:57 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:38.226 11:41:58 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:38.485 [2024-11-28 11:41:58.361547] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:38.485 [2024-11-28 11:41:58.361815] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:38.485 11:41:58 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:38.744 malloc0 00:17:38.744 11:41:58 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:39.003 11:41:58 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:39.261 [2024-11-28 11:41:59.135883] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:39.261 [2024-11-28 11:41:59.135922] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:17:39.261 [2024-11-28 11:41:59.135957] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:17:39.261 request: 00:17:39.261 { 00:17:39.261 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:39.261 "host": "nqn.2016-06.io.spdk:host1", 00:17:39.261 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:39.261 "method": "nvmf_subsystem_add_host", 00:17:39.261 "req_id": 1 00:17:39.261 } 00:17:39.261 Got JSON-RPC error response 00:17:39.261 response: 00:17:39.261 { 00:17:39.261 "code": -32603, 00:17:39.261 "message": "Internal error" 00:17:39.261 } 00:17:39.261 11:41:59 -- common/autotest_common.sh@653 -- # es=1 00:17:39.261 11:41:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:39.261 11:41:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:39.261 11:41:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:39.261 11:41:59 -- target/tls.sh@189 -- # killprocess 3828260 00:17:39.261 11:41:59 -- common/autotest_common.sh@936 -- # '[' -z 3828260 ']' 00:17:39.261 11:41:59 -- common/autotest_common.sh@940 -- # kill -0 3828260 00:17:39.261 11:41:59 -- common/autotest_common.sh@941 -- # uname 00:17:39.261 11:41:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:39.261 11:41:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3828260 00:17:39.261 11:41:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:39.261 11:41:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:39.261 11:41:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3828260' 00:17:39.261 killing process with pid 3828260 00:17:39.261 11:41:59 -- common/autotest_common.sh@955 -- # kill 3828260 00:17:39.261 11:41:59 -- common/autotest_common.sh@960 -- # wait 3828260 00:17:39.520 11:41:59 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:39.520 11:41:59 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:17:39.520 11:41:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:39.520 11:41:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:39.520 11:41:59 -- common/autotest_common.sh@10 -- # set +x 00:17:39.520 11:41:59 -- nvmf/common.sh@469 -- # nvmfpid=3828577 00:17:39.520 11:41:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:39.520 11:41:59 -- nvmf/common.sh@470 -- # waitforlisten 3828577 00:17:39.520 11:41:59 -- common/autotest_common.sh@829 -- # '[' -z 3828577 ']' 00:17:39.520 11:41:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:39.520 11:41:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:39.520 11:41:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:39.520 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:39.520 11:41:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:39.520 11:41:59 -- common/autotest_common.sh@10 -- # set +x 00:17:39.520 [2024-11-28 11:41:59.515890] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:39.520 [2024-11-28 11:41:59.515985] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:39.520 EAL: No free 2048 kB hugepages reported on node 1 00:17:39.779 [2024-11-28 11:41:59.581485] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:39.779 [2024-11-28 11:41:59.688576] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:39.779 [2024-11-28 11:41:59.688729] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:39.779 [2024-11-28 11:41:59.688746] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:39.779 [2024-11-28 11:41:59.688758] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:39.780 [2024-11-28 11:41:59.688785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:40.717 11:42:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:40.718 11:42:00 -- common/autotest_common.sh@862 -- # return 0 00:17:40.718 11:42:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:40.718 11:42:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:40.718 11:42:00 -- common/autotest_common.sh@10 -- # set +x 00:17:40.718 11:42:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:40.718 11:42:00 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:40.718 11:42:00 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:40.718 11:42:00 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:40.718 [2024-11-28 11:42:00.770265] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:40.976 11:42:00 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:41.235 11:42:01 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:41.235 [2024-11-28 11:42:01.287677] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:41.235 [2024-11-28 11:42:01.287996] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:41.493 11:42:01 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:41.751 malloc0 00:17:41.751 11:42:01 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:42.010 11:42:01 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:42.268 11:42:02 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:42.268 11:42:02 -- target/tls.sh@197 -- # bdevperf_pid=3829114 00:17:42.268 11:42:02 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:42.268 11:42:02 -- target/tls.sh@200 -- # waitforlisten 3829114 /var/tmp/bdevperf.sock 00:17:42.268 11:42:02 -- common/autotest_common.sh@829 -- # '[' -z 3829114 ']' 00:17:42.268 11:42:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:42.268 11:42:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:42.268 11:42:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:42.268 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:42.268 11:42:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:42.268 11:42:02 -- common/autotest_common.sh@10 -- # set +x 00:17:42.268 [2024-11-28 11:42:02.106185] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:42.268 [2024-11-28 11:42:02.106267] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3829114 ] 00:17:42.268 EAL: No free 2048 kB hugepages reported on node 1 00:17:42.268 [2024-11-28 11:42:02.162697] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:42.268 [2024-11-28 11:42:02.265625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:43.206 11:42:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:43.206 11:42:03 -- common/autotest_common.sh@862 -- # return 0 00:17:43.206 11:42:03 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:43.464 [2024-11-28 11:42:03.319950] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:43.464 TLSTESTn1 00:17:43.464 11:42:03 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:17:43.722 11:42:03 -- target/tls.sh@205 -- # tgtconf='{ 00:17:43.722 "subsystems": [ 00:17:43.722 { 00:17:43.722 "subsystem": "iobuf", 00:17:43.722 "config": [ 00:17:43.722 { 00:17:43.722 "method": "iobuf_set_options", 00:17:43.722 "params": { 00:17:43.722 "small_pool_count": 8192, 00:17:43.722 "large_pool_count": 1024, 00:17:43.722 "small_bufsize": 8192, 00:17:43.722 "large_bufsize": 135168 00:17:43.722 } 00:17:43.722 } 00:17:43.722 ] 00:17:43.722 }, 00:17:43.722 { 00:17:43.722 "subsystem": "sock", 00:17:43.722 "config": [ 00:17:43.722 { 00:17:43.722 "method": "sock_impl_set_options", 00:17:43.722 "params": { 00:17:43.722 "impl_name": "posix", 00:17:43.722 "recv_buf_size": 2097152, 00:17:43.722 "send_buf_size": 2097152, 00:17:43.722 "enable_recv_pipe": true, 00:17:43.722 "enable_quickack": false, 00:17:43.722 "enable_placement_id": 0, 00:17:43.722 "enable_zerocopy_send_server": true, 00:17:43.722 "enable_zerocopy_send_client": false, 00:17:43.722 "zerocopy_threshold": 0, 00:17:43.722 "tls_version": 0, 00:17:43.722 "enable_ktls": false 00:17:43.722 } 00:17:43.722 }, 00:17:43.722 { 00:17:43.722 "method": "sock_impl_set_options", 00:17:43.722 "params": { 00:17:43.722 "impl_name": "ssl", 00:17:43.722 "recv_buf_size": 4096, 00:17:43.722 "send_buf_size": 4096, 00:17:43.722 "enable_recv_pipe": true, 00:17:43.722 "enable_quickack": false, 00:17:43.722 "enable_placement_id": 0, 00:17:43.722 "enable_zerocopy_send_server": true, 00:17:43.722 "enable_zerocopy_send_client": false, 00:17:43.722 "zerocopy_threshold": 0, 00:17:43.722 "tls_version": 0, 00:17:43.722 "enable_ktls": false 00:17:43.722 } 00:17:43.722 } 00:17:43.722 ] 00:17:43.722 }, 00:17:43.722 { 00:17:43.722 "subsystem": "vmd", 00:17:43.722 "config": [] 00:17:43.722 }, 00:17:43.722 { 00:17:43.722 "subsystem": "accel", 00:17:43.722 "config": [ 00:17:43.722 { 00:17:43.722 "method": "accel_set_options", 00:17:43.722 "params": { 00:17:43.722 "small_cache_size": 128, 00:17:43.722 "large_cache_size": 16, 00:17:43.722 "task_count": 2048, 00:17:43.722 "sequence_count": 2048, 00:17:43.722 "buf_count": 2048 00:17:43.722 } 00:17:43.722 } 00:17:43.722 ] 00:17:43.722 }, 00:17:43.722 { 00:17:43.722 "subsystem": "bdev", 00:17:43.722 "config": [ 00:17:43.722 { 00:17:43.722 "method": "bdev_set_options", 00:17:43.723 "params": { 00:17:43.723 "bdev_io_pool_size": 65535, 00:17:43.723 "bdev_io_cache_size": 256, 00:17:43.723 "bdev_auto_examine": true, 00:17:43.723 "iobuf_small_cache_size": 128, 00:17:43.723 "iobuf_large_cache_size": 16 00:17:43.723 } 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "method": "bdev_raid_set_options", 00:17:43.723 "params": { 00:17:43.723 "process_window_size_kb": 1024 00:17:43.723 } 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "method": "bdev_iscsi_set_options", 00:17:43.723 "params": { 00:17:43.723 "timeout_sec": 30 00:17:43.723 } 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "method": "bdev_nvme_set_options", 00:17:43.723 "params": { 00:17:43.723 "action_on_timeout": "none", 00:17:43.723 "timeout_us": 0, 00:17:43.723 "timeout_admin_us": 0, 00:17:43.723 "keep_alive_timeout_ms": 10000, 00:17:43.723 "transport_retry_count": 4, 00:17:43.723 "arbitration_burst": 0, 00:17:43.723 "low_priority_weight": 0, 00:17:43.723 "medium_priority_weight": 0, 00:17:43.723 "high_priority_weight": 0, 00:17:43.723 "nvme_adminq_poll_period_us": 10000, 00:17:43.723 "nvme_ioq_poll_period_us": 0, 00:17:43.723 "io_queue_requests": 0, 00:17:43.723 "delay_cmd_submit": true, 00:17:43.723 "bdev_retry_count": 3, 00:17:43.723 "transport_ack_timeout": 0, 00:17:43.723 "ctrlr_loss_timeout_sec": 0, 00:17:43.723 "reconnect_delay_sec": 0, 00:17:43.723 "fast_io_fail_timeout_sec": 0, 00:17:43.723 "generate_uuids": false, 00:17:43.723 "transport_tos": 0, 00:17:43.723 "io_path_stat": false, 00:17:43.723 "allow_accel_sequence": false 00:17:43.723 } 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "method": "bdev_nvme_set_hotplug", 00:17:43.723 "params": { 00:17:43.723 "period_us": 100000, 00:17:43.723 "enable": false 00:17:43.723 } 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "method": "bdev_malloc_create", 00:17:43.723 "params": { 00:17:43.723 "name": "malloc0", 00:17:43.723 "num_blocks": 8192, 00:17:43.723 "block_size": 4096, 00:17:43.723 "physical_block_size": 4096, 00:17:43.723 "uuid": "5e44fd9f-f20e-4781-b815-0902b6fefc7c", 00:17:43.723 "optimal_io_boundary": 0 00:17:43.723 } 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "method": "bdev_wait_for_examine" 00:17:43.723 } 00:17:43.723 ] 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "subsystem": "nbd", 00:17:43.723 "config": [] 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "subsystem": "scheduler", 00:17:43.723 "config": [ 00:17:43.723 { 00:17:43.723 "method": "framework_set_scheduler", 00:17:43.723 "params": { 00:17:43.723 "name": "static" 00:17:43.723 } 00:17:43.723 } 00:17:43.723 ] 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "subsystem": "nvmf", 00:17:43.723 "config": [ 00:17:43.723 { 00:17:43.723 "method": "nvmf_set_config", 00:17:43.723 "params": { 00:17:43.723 "discovery_filter": "match_any", 00:17:43.723 "admin_cmd_passthru": { 00:17:43.723 "identify_ctrlr": false 00:17:43.723 } 00:17:43.723 } 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "method": "nvmf_set_max_subsystems", 00:17:43.723 "params": { 00:17:43.723 "max_subsystems": 1024 00:17:43.723 } 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "method": "nvmf_set_crdt", 00:17:43.723 "params": { 00:17:43.723 "crdt1": 0, 00:17:43.723 "crdt2": 0, 00:17:43.723 "crdt3": 0 00:17:43.723 } 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "method": "nvmf_create_transport", 00:17:43.723 "params": { 00:17:43.723 "trtype": "TCP", 00:17:43.723 "max_queue_depth": 128, 00:17:43.723 "max_io_qpairs_per_ctrlr": 127, 00:17:43.723 "in_capsule_data_size": 4096, 00:17:43.723 "max_io_size": 131072, 00:17:43.723 "io_unit_size": 131072, 00:17:43.723 "max_aq_depth": 128, 00:17:43.723 "num_shared_buffers": 511, 00:17:43.723 "buf_cache_size": 4294967295, 00:17:43.723 "dif_insert_or_strip": false, 00:17:43.723 "zcopy": false, 00:17:43.723 "c2h_success": false, 00:17:43.723 "sock_priority": 0, 00:17:43.723 "abort_timeout_sec": 1 00:17:43.723 } 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "method": "nvmf_create_subsystem", 00:17:43.723 "params": { 00:17:43.723 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:43.723 "allow_any_host": false, 00:17:43.723 "serial_number": "SPDK00000000000001", 00:17:43.723 "model_number": "SPDK bdev Controller", 00:17:43.723 "max_namespaces": 10, 00:17:43.723 "min_cntlid": 1, 00:17:43.723 "max_cntlid": 65519, 00:17:43.723 "ana_reporting": false 00:17:43.723 } 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "method": "nvmf_subsystem_add_host", 00:17:43.723 "params": { 00:17:43.723 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:43.723 "host": "nqn.2016-06.io.spdk:host1", 00:17:43.723 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:43.723 } 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "method": "nvmf_subsystem_add_ns", 00:17:43.723 "params": { 00:17:43.723 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:43.723 "namespace": { 00:17:43.723 "nsid": 1, 00:17:43.723 "bdev_name": "malloc0", 00:17:43.723 "nguid": "5E44FD9FF20E4781B8150902B6FEFC7C", 00:17:43.723 "uuid": "5e44fd9f-f20e-4781-b815-0902b6fefc7c" 00:17:43.723 } 00:17:43.723 } 00:17:43.723 }, 00:17:43.723 { 00:17:43.723 "method": "nvmf_subsystem_add_listener", 00:17:43.723 "params": { 00:17:43.723 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:43.723 "listen_address": { 00:17:43.723 "trtype": "TCP", 00:17:43.723 "adrfam": "IPv4", 00:17:43.723 "traddr": "10.0.0.2", 00:17:43.723 "trsvcid": "4420" 00:17:43.723 }, 00:17:43.723 "secure_channel": true 00:17:43.723 } 00:17:43.723 } 00:17:43.723 ] 00:17:43.723 } 00:17:43.723 ] 00:17:43.723 }' 00:17:43.723 11:42:03 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:17:44.292 11:42:04 -- target/tls.sh@206 -- # bdevperfconf='{ 00:17:44.292 "subsystems": [ 00:17:44.292 { 00:17:44.292 "subsystem": "iobuf", 00:17:44.292 "config": [ 00:17:44.292 { 00:17:44.292 "method": "iobuf_set_options", 00:17:44.292 "params": { 00:17:44.292 "small_pool_count": 8192, 00:17:44.292 "large_pool_count": 1024, 00:17:44.292 "small_bufsize": 8192, 00:17:44.292 "large_bufsize": 135168 00:17:44.292 } 00:17:44.292 } 00:17:44.292 ] 00:17:44.292 }, 00:17:44.292 { 00:17:44.292 "subsystem": "sock", 00:17:44.292 "config": [ 00:17:44.292 { 00:17:44.292 "method": "sock_impl_set_options", 00:17:44.292 "params": { 00:17:44.292 "impl_name": "posix", 00:17:44.292 "recv_buf_size": 2097152, 00:17:44.292 "send_buf_size": 2097152, 00:17:44.292 "enable_recv_pipe": true, 00:17:44.292 "enable_quickack": false, 00:17:44.292 "enable_placement_id": 0, 00:17:44.292 "enable_zerocopy_send_server": true, 00:17:44.292 "enable_zerocopy_send_client": false, 00:17:44.292 "zerocopy_threshold": 0, 00:17:44.292 "tls_version": 0, 00:17:44.292 "enable_ktls": false 00:17:44.292 } 00:17:44.292 }, 00:17:44.292 { 00:17:44.292 "method": "sock_impl_set_options", 00:17:44.292 "params": { 00:17:44.292 "impl_name": "ssl", 00:17:44.292 "recv_buf_size": 4096, 00:17:44.292 "send_buf_size": 4096, 00:17:44.292 "enable_recv_pipe": true, 00:17:44.292 "enable_quickack": false, 00:17:44.292 "enable_placement_id": 0, 00:17:44.292 "enable_zerocopy_send_server": true, 00:17:44.292 "enable_zerocopy_send_client": false, 00:17:44.292 "zerocopy_threshold": 0, 00:17:44.292 "tls_version": 0, 00:17:44.292 "enable_ktls": false 00:17:44.292 } 00:17:44.292 } 00:17:44.292 ] 00:17:44.292 }, 00:17:44.292 { 00:17:44.292 "subsystem": "vmd", 00:17:44.292 "config": [] 00:17:44.292 }, 00:17:44.292 { 00:17:44.292 "subsystem": "accel", 00:17:44.292 "config": [ 00:17:44.292 { 00:17:44.292 "method": "accel_set_options", 00:17:44.292 "params": { 00:17:44.292 "small_cache_size": 128, 00:17:44.292 "large_cache_size": 16, 00:17:44.292 "task_count": 2048, 00:17:44.292 "sequence_count": 2048, 00:17:44.292 "buf_count": 2048 00:17:44.292 } 00:17:44.292 } 00:17:44.292 ] 00:17:44.292 }, 00:17:44.292 { 00:17:44.292 "subsystem": "bdev", 00:17:44.292 "config": [ 00:17:44.292 { 00:17:44.292 "method": "bdev_set_options", 00:17:44.292 "params": { 00:17:44.292 "bdev_io_pool_size": 65535, 00:17:44.292 "bdev_io_cache_size": 256, 00:17:44.292 "bdev_auto_examine": true, 00:17:44.292 "iobuf_small_cache_size": 128, 00:17:44.292 "iobuf_large_cache_size": 16 00:17:44.292 } 00:17:44.292 }, 00:17:44.292 { 00:17:44.292 "method": "bdev_raid_set_options", 00:17:44.292 "params": { 00:17:44.292 "process_window_size_kb": 1024 00:17:44.292 } 00:17:44.292 }, 00:17:44.292 { 00:17:44.292 "method": "bdev_iscsi_set_options", 00:17:44.292 "params": { 00:17:44.292 "timeout_sec": 30 00:17:44.292 } 00:17:44.292 }, 00:17:44.292 { 00:17:44.292 "method": "bdev_nvme_set_options", 00:17:44.292 "params": { 00:17:44.292 "action_on_timeout": "none", 00:17:44.292 "timeout_us": 0, 00:17:44.292 "timeout_admin_us": 0, 00:17:44.292 "keep_alive_timeout_ms": 10000, 00:17:44.292 "transport_retry_count": 4, 00:17:44.292 "arbitration_burst": 0, 00:17:44.292 "low_priority_weight": 0, 00:17:44.292 "medium_priority_weight": 0, 00:17:44.292 "high_priority_weight": 0, 00:17:44.292 "nvme_adminq_poll_period_us": 10000, 00:17:44.292 "nvme_ioq_poll_period_us": 0, 00:17:44.292 "io_queue_requests": 512, 00:17:44.292 "delay_cmd_submit": true, 00:17:44.292 "bdev_retry_count": 3, 00:17:44.292 "transport_ack_timeout": 0, 00:17:44.292 "ctrlr_loss_timeout_sec": 0, 00:17:44.292 "reconnect_delay_sec": 0, 00:17:44.292 "fast_io_fail_timeout_sec": 0, 00:17:44.292 "generate_uuids": false, 00:17:44.292 "transport_tos": 0, 00:17:44.292 "io_path_stat": false, 00:17:44.292 "allow_accel_sequence": false 00:17:44.292 } 00:17:44.292 }, 00:17:44.292 { 00:17:44.292 "method": "bdev_nvme_attach_controller", 00:17:44.292 "params": { 00:17:44.292 "name": "TLSTEST", 00:17:44.292 "trtype": "TCP", 00:17:44.292 "adrfam": "IPv4", 00:17:44.292 "traddr": "10.0.0.2", 00:17:44.292 "trsvcid": "4420", 00:17:44.292 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:44.292 "prchk_reftag": false, 00:17:44.292 "prchk_guard": false, 00:17:44.292 "ctrlr_loss_timeout_sec": 0, 00:17:44.292 "reconnect_delay_sec": 0, 00:17:44.292 "fast_io_fail_timeout_sec": 0, 00:17:44.292 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:44.292 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:44.292 "hdgst": false, 00:17:44.292 "ddgst": false 00:17:44.292 } 00:17:44.292 }, 00:17:44.292 { 00:17:44.292 "method": "bdev_nvme_set_hotplug", 00:17:44.292 "params": { 00:17:44.292 "period_us": 100000, 00:17:44.292 "enable": false 00:17:44.292 } 00:17:44.292 }, 00:17:44.292 { 00:17:44.292 "method": "bdev_wait_for_examine" 00:17:44.292 } 00:17:44.292 ] 00:17:44.292 }, 00:17:44.292 { 00:17:44.292 "subsystem": "nbd", 00:17:44.292 "config": [] 00:17:44.292 } 00:17:44.292 ] 00:17:44.292 }' 00:17:44.292 11:42:04 -- target/tls.sh@208 -- # killprocess 3829114 00:17:44.292 11:42:04 -- common/autotest_common.sh@936 -- # '[' -z 3829114 ']' 00:17:44.292 11:42:04 -- common/autotest_common.sh@940 -- # kill -0 3829114 00:17:44.292 11:42:04 -- common/autotest_common.sh@941 -- # uname 00:17:44.292 11:42:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:44.292 11:42:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3829114 00:17:44.292 11:42:04 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:44.293 11:42:04 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:44.293 11:42:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3829114' 00:17:44.293 killing process with pid 3829114 00:17:44.293 11:42:04 -- common/autotest_common.sh@955 -- # kill 3829114 00:17:44.293 Received shutdown signal, test time was about 10.000000 seconds 00:17:44.293 00:17:44.293 Latency(us) 00:17:44.293 [2024-11-28T10:42:04.349Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:44.293 [2024-11-28T10:42:04.349Z] =================================================================================================================== 00:17:44.293 [2024-11-28T10:42:04.349Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:44.293 11:42:04 -- common/autotest_common.sh@960 -- # wait 3829114 00:17:44.551 11:42:04 -- target/tls.sh@209 -- # killprocess 3828577 00:17:44.551 11:42:04 -- common/autotest_common.sh@936 -- # '[' -z 3828577 ']' 00:17:44.551 11:42:04 -- common/autotest_common.sh@940 -- # kill -0 3828577 00:17:44.551 11:42:04 -- common/autotest_common.sh@941 -- # uname 00:17:44.551 11:42:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:44.551 11:42:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3828577 00:17:44.551 11:42:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:44.551 11:42:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:44.551 11:42:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3828577' 00:17:44.551 killing process with pid 3828577 00:17:44.551 11:42:04 -- common/autotest_common.sh@955 -- # kill 3828577 00:17:44.551 11:42:04 -- common/autotest_common.sh@960 -- # wait 3828577 00:17:44.810 11:42:04 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:17:44.810 11:42:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:44.810 11:42:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:44.810 11:42:04 -- target/tls.sh@212 -- # echo '{ 00:17:44.810 "subsystems": [ 00:17:44.810 { 00:17:44.810 "subsystem": "iobuf", 00:17:44.810 "config": [ 00:17:44.810 { 00:17:44.810 "method": "iobuf_set_options", 00:17:44.810 "params": { 00:17:44.810 "small_pool_count": 8192, 00:17:44.810 "large_pool_count": 1024, 00:17:44.810 "small_bufsize": 8192, 00:17:44.810 "large_bufsize": 135168 00:17:44.810 } 00:17:44.810 } 00:17:44.810 ] 00:17:44.810 }, 00:17:44.810 { 00:17:44.810 "subsystem": "sock", 00:17:44.810 "config": [ 00:17:44.810 { 00:17:44.810 "method": "sock_impl_set_options", 00:17:44.810 "params": { 00:17:44.810 "impl_name": "posix", 00:17:44.810 "recv_buf_size": 2097152, 00:17:44.810 "send_buf_size": 2097152, 00:17:44.810 "enable_recv_pipe": true, 00:17:44.810 "enable_quickack": false, 00:17:44.810 "enable_placement_id": 0, 00:17:44.810 "enable_zerocopy_send_server": true, 00:17:44.810 "enable_zerocopy_send_client": false, 00:17:44.810 "zerocopy_threshold": 0, 00:17:44.810 "tls_version": 0, 00:17:44.810 "enable_ktls": false 00:17:44.810 } 00:17:44.810 }, 00:17:44.810 { 00:17:44.810 "method": "sock_impl_set_options", 00:17:44.810 "params": { 00:17:44.810 "impl_name": "ssl", 00:17:44.810 "recv_buf_size": 4096, 00:17:44.810 "send_buf_size": 4096, 00:17:44.810 "enable_recv_pipe": true, 00:17:44.810 "enable_quickack": false, 00:17:44.810 "enable_placement_id": 0, 00:17:44.810 "enable_zerocopy_send_server": true, 00:17:44.810 "enable_zerocopy_send_client": false, 00:17:44.810 "zerocopy_threshold": 0, 00:17:44.810 "tls_version": 0, 00:17:44.810 "enable_ktls": false 00:17:44.810 } 00:17:44.810 } 00:17:44.810 ] 00:17:44.810 }, 00:17:44.810 { 00:17:44.810 "subsystem": "vmd", 00:17:44.810 "config": [] 00:17:44.810 }, 00:17:44.810 { 00:17:44.810 "subsystem": "accel", 00:17:44.810 "config": [ 00:17:44.810 { 00:17:44.810 "method": "accel_set_options", 00:17:44.810 "params": { 00:17:44.810 "small_cache_size": 128, 00:17:44.810 "large_cache_size": 16, 00:17:44.810 "task_count": 2048, 00:17:44.810 "sequence_count": 2048, 00:17:44.810 "buf_count": 2048 00:17:44.810 } 00:17:44.810 } 00:17:44.810 ] 00:17:44.810 }, 00:17:44.810 { 00:17:44.810 "subsystem": "bdev", 00:17:44.810 "config": [ 00:17:44.810 { 00:17:44.810 "method": "bdev_set_options", 00:17:44.810 "params": { 00:17:44.810 "bdev_io_pool_size": 65535, 00:17:44.810 "bdev_io_cache_size": 256, 00:17:44.810 "bdev_auto_examine": true, 00:17:44.811 "iobuf_small_cache_size": 128, 00:17:44.811 "iobuf_large_cache_size": 16 00:17:44.811 } 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "method": "bdev_raid_set_options", 00:17:44.811 "params": { 00:17:44.811 "process_window_size_kb": 1024 00:17:44.811 } 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "method": "bdev_iscsi_set_options", 00:17:44.811 "params": { 00:17:44.811 "timeout_sec": 30 00:17:44.811 } 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "method": "bdev_nvme_set_options", 00:17:44.811 "params": { 00:17:44.811 "action_on_timeout": "none", 00:17:44.811 "timeout_us": 0, 00:17:44.811 "timeout_admin_us": 0, 00:17:44.811 "keep_alive_timeout_ms": 10000, 00:17:44.811 "transport_retry_count": 4, 00:17:44.811 "arbitration_burst": 0, 00:17:44.811 "low_priority_weight": 0, 00:17:44.811 "medium_priority_weight": 0, 00:17:44.811 "high_priority_weight": 0, 00:17:44.811 "nvme_adminq_poll_period_us": 10000, 00:17:44.811 "nvme_ioq_poll_period_us": 0, 00:17:44.811 "io_queue_requests": 0, 00:17:44.811 "delay_cmd_submit": true, 00:17:44.811 "bdev_retry_count": 3, 00:17:44.811 "transport_ack_timeout": 0, 00:17:44.811 "ctrlr_loss_timeout_sec": 0, 00:17:44.811 "reconnect_delay_sec": 0, 00:17:44.811 "fast_io_fail_timeout_sec": 0, 00:17:44.811 "generate_uuids": false, 00:17:44.811 "transport_tos": 0, 00:17:44.811 "io_path_stat": false, 00:17:44.811 "allow_accel_sequence": false 00:17:44.811 } 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "method": "bdev_nvme_set_hotplug", 00:17:44.811 "params": { 00:17:44.811 "period_us": 100000, 00:17:44.811 "enable": false 00:17:44.811 } 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "method": "bdev_malloc_create", 00:17:44.811 "params": { 00:17:44.811 "name": "malloc0", 00:17:44.811 "num_blocks": 8192, 00:17:44.811 "block_size": 4096, 00:17:44.811 "physical_block_size": 4096, 00:17:44.811 "uuid": "5e44fd9f-f20e-4781-b815-0902b6fefc7c", 00:17:44.811 "optimal_io_boundary": 0 00:17:44.811 } 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "method": "bdev_wait_for_examine" 00:17:44.811 } 00:17:44.811 ] 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "subsystem": "nbd", 00:17:44.811 "config": [] 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "subsystem": "scheduler", 00:17:44.811 "config": [ 00:17:44.811 { 00:17:44.811 "method": "framework_set_scheduler", 00:17:44.811 "params": { 00:17:44.811 "name": "static" 00:17:44.811 } 00:17:44.811 } 00:17:44.811 ] 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "subsystem": "nvmf", 00:17:44.811 "config": [ 00:17:44.811 { 00:17:44.811 "method": "nvmf_set_config", 00:17:44.811 "params": { 00:17:44.811 "discovery_filter": "match_any", 00:17:44.811 "admin_cmd_passthru": { 00:17:44.811 "identify_ctrlr": false 00:17:44.811 } 00:17:44.811 } 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "method": "nvmf_set_max_subsystems", 00:17:44.811 "params": { 00:17:44.811 "max_subsystems": 1024 00:17:44.811 } 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "method": "nvmf_set_crdt", 00:17:44.811 "params": { 00:17:44.811 "crdt1": 0, 00:17:44.811 "crdt2": 0, 00:17:44.811 "crdt3": 0 00:17:44.811 } 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "method": "nvmf_create_transport", 00:17:44.811 "params": { 00:17:44.811 "trtype": "TCP", 00:17:44.811 "max_queue_depth": 128, 00:17:44.811 "max_io_qpairs_per_ctrlr": 127, 00:17:44.811 "in_capsule_data_size": 4096, 00:17:44.811 "max_io_size": 131072, 00:17:44.811 "io_unit_size": 131072, 00:17:44.811 "max_aq_depth": 128, 00:17:44.811 "num_shared_buffers": 511, 00:17:44.811 "buf_cache_size": 4294967295, 00:17:44.811 "dif_insert_or_strip": false, 00:17:44.811 "zcopy": false, 00:17:44.811 "c2h_success": false, 00:17:44.811 "sock_priority": 0, 00:17:44.811 "abort_timeout_sec": 1 00:17:44.811 } 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "method": "nvmf_create_subsystem", 00:17:44.811 "params": { 00:17:44.811 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:44.811 "allow_any_host": false, 00:17:44.811 "serial_number": "SPDK00000000000001", 00:17:44.811 "model_number": "SPDK bdev Controller", 00:17:44.811 "max_namespaces": 10, 00:17:44.811 "min_cntlid": 1, 00:17:44.811 "max_cntlid": 65519, 00:17:44.811 "ana_reporting": false 00:17:44.811 } 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "method": "nvmf_subsystem_add_host", 00:17:44.811 "params": { 00:17:44.811 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:44.811 "host": "nqn.2016-06.io.spdk:host1", 00:17:44.811 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:44.811 } 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "method": "nvmf_subsystem_add_ns", 00:17:44.811 "params": { 00:17:44.811 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:44.811 "namespace": { 00:17:44.811 "nsid": 1, 00:17:44.811 "bdev_name": "malloc0", 00:17:44.811 "nguid": "5E44FD9FF20E4781B8150902B6FEFC7C", 00:17:44.811 "uuid": "5e44fd9f-f20e-4781-b815-0902b6fefc7c" 00:17:44.811 } 00:17:44.811 } 00:17:44.811 }, 00:17:44.811 { 00:17:44.811 "method": "nvmf_subsystem_add_listener", 00:17:44.811 "params": { 00:17:44.811 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:44.811 "listen_address": { 00:17:44.811 "trtype": "TCP", 00:17:44.811 "adrfam": "IPv4", 00:17:44.811 "traddr": "10.0.0.2", 00:17:44.811 "trsvcid": "4420" 00:17:44.811 }, 00:17:44.811 "secure_channel": true 00:17:44.811 } 00:17:44.811 } 00:17:44.811 ] 00:17:44.811 } 00:17:44.811 ] 00:17:44.811 }' 00:17:44.811 11:42:04 -- common/autotest_common.sh@10 -- # set +x 00:17:44.811 11:42:04 -- nvmf/common.sh@469 -- # nvmfpid=3829403 00:17:44.811 11:42:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:17:44.811 11:42:04 -- nvmf/common.sh@470 -- # waitforlisten 3829403 00:17:44.811 11:42:04 -- common/autotest_common.sh@829 -- # '[' -z 3829403 ']' 00:17:44.811 11:42:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:44.811 11:42:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:44.811 11:42:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:44.811 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:44.811 11:42:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:44.811 11:42:04 -- common/autotest_common.sh@10 -- # set +x 00:17:44.811 [2024-11-28 11:42:04.772297] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:44.811 [2024-11-28 11:42:04.772390] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:44.811 EAL: No free 2048 kB hugepages reported on node 1 00:17:44.811 [2024-11-28 11:42:04.840979] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:45.071 [2024-11-28 11:42:04.953680] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:45.071 [2024-11-28 11:42:04.953846] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:45.071 [2024-11-28 11:42:04.953866] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:45.071 [2024-11-28 11:42:04.953880] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:45.071 [2024-11-28 11:42:04.953911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:45.337 [2024-11-28 11:42:05.185852] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:45.337 [2024-11-28 11:42:05.217883] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:45.337 [2024-11-28 11:42:05.218155] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:45.909 11:42:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:45.909 11:42:05 -- common/autotest_common.sh@862 -- # return 0 00:17:45.909 11:42:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:45.909 11:42:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:45.909 11:42:05 -- common/autotest_common.sh@10 -- # set +x 00:17:45.909 11:42:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:45.910 11:42:05 -- target/tls.sh@216 -- # bdevperf_pid=3829559 00:17:45.910 11:42:05 -- target/tls.sh@217 -- # waitforlisten 3829559 /var/tmp/bdevperf.sock 00:17:45.910 11:42:05 -- common/autotest_common.sh@829 -- # '[' -z 3829559 ']' 00:17:45.910 11:42:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:45.910 11:42:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:45.910 11:42:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:45.910 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:45.910 11:42:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:45.910 11:42:05 -- common/autotest_common.sh@10 -- # set +x 00:17:45.910 11:42:05 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:17:45.910 11:42:05 -- target/tls.sh@213 -- # echo '{ 00:17:45.910 "subsystems": [ 00:17:45.910 { 00:17:45.910 "subsystem": "iobuf", 00:17:45.910 "config": [ 00:17:45.910 { 00:17:45.910 "method": "iobuf_set_options", 00:17:45.910 "params": { 00:17:45.910 "small_pool_count": 8192, 00:17:45.910 "large_pool_count": 1024, 00:17:45.910 "small_bufsize": 8192, 00:17:45.910 "large_bufsize": 135168 00:17:45.910 } 00:17:45.910 } 00:17:45.910 ] 00:17:45.910 }, 00:17:45.910 { 00:17:45.910 "subsystem": "sock", 00:17:45.910 "config": [ 00:17:45.910 { 00:17:45.910 "method": "sock_impl_set_options", 00:17:45.910 "params": { 00:17:45.910 "impl_name": "posix", 00:17:45.910 "recv_buf_size": 2097152, 00:17:45.910 "send_buf_size": 2097152, 00:17:45.910 "enable_recv_pipe": true, 00:17:45.910 "enable_quickack": false, 00:17:45.910 "enable_placement_id": 0, 00:17:45.910 "enable_zerocopy_send_server": true, 00:17:45.910 "enable_zerocopy_send_client": false, 00:17:45.910 "zerocopy_threshold": 0, 00:17:45.910 "tls_version": 0, 00:17:45.910 "enable_ktls": false 00:17:45.910 } 00:17:45.910 }, 00:17:45.910 { 00:17:45.910 "method": "sock_impl_set_options", 00:17:45.910 "params": { 00:17:45.910 "impl_name": "ssl", 00:17:45.910 "recv_buf_size": 4096, 00:17:45.910 "send_buf_size": 4096, 00:17:45.910 "enable_recv_pipe": true, 00:17:45.910 "enable_quickack": false, 00:17:45.910 "enable_placement_id": 0, 00:17:45.910 "enable_zerocopy_send_server": true, 00:17:45.910 "enable_zerocopy_send_client": false, 00:17:45.910 "zerocopy_threshold": 0, 00:17:45.910 "tls_version": 0, 00:17:45.910 "enable_ktls": false 00:17:45.910 } 00:17:45.910 } 00:17:45.910 ] 00:17:45.910 }, 00:17:45.910 { 00:17:45.910 "subsystem": "vmd", 00:17:45.910 "config": [] 00:17:45.910 }, 00:17:45.910 { 00:17:45.910 "subsystem": "accel", 00:17:45.910 "config": [ 00:17:45.910 { 00:17:45.910 "method": "accel_set_options", 00:17:45.910 "params": { 00:17:45.910 "small_cache_size": 128, 00:17:45.910 "large_cache_size": 16, 00:17:45.910 "task_count": 2048, 00:17:45.910 "sequence_count": 2048, 00:17:45.910 "buf_count": 2048 00:17:45.910 } 00:17:45.910 } 00:17:45.910 ] 00:17:45.910 }, 00:17:45.910 { 00:17:45.910 "subsystem": "bdev", 00:17:45.910 "config": [ 00:17:45.910 { 00:17:45.910 "method": "bdev_set_options", 00:17:45.910 "params": { 00:17:45.910 "bdev_io_pool_size": 65535, 00:17:45.910 "bdev_io_cache_size": 256, 00:17:45.910 "bdev_auto_examine": true, 00:17:45.910 "iobuf_small_cache_size": 128, 00:17:45.910 "iobuf_large_cache_size": 16 00:17:45.910 } 00:17:45.910 }, 00:17:45.910 { 00:17:45.910 "method": "bdev_raid_set_options", 00:17:45.910 "params": { 00:17:45.910 "process_window_size_kb": 1024 00:17:45.910 } 00:17:45.910 }, 00:17:45.910 { 00:17:45.910 "method": "bdev_iscsi_set_options", 00:17:45.910 "params": { 00:17:45.910 "timeout_sec": 30 00:17:45.910 } 00:17:45.910 }, 00:17:45.910 { 00:17:45.910 "method": "bdev_nvme_set_options", 00:17:45.910 "params": { 00:17:45.910 "action_on_timeout": "none", 00:17:45.910 "timeout_us": 0, 00:17:45.910 "timeout_admin_us": 0, 00:17:45.910 "keep_alive_timeout_ms": 10000, 00:17:45.910 "transport_retry_count": 4, 00:17:45.910 "arbitration_burst": 0, 00:17:45.910 "low_priority_weight": 0, 00:17:45.910 "medium_priority_weight": 0, 00:17:45.910 "high_priority_weight": 0, 00:17:45.910 "nvme_adminq_poll_period_us": 10000, 00:17:45.910 "nvme_ioq_poll_period_us": 0, 00:17:45.910 "io_queue_requests": 512, 00:17:45.910 "delay_cmd_submit": true, 00:17:45.910 "bdev_retry_count": 3, 00:17:45.910 "transport_ack_timeout": 0, 00:17:45.910 "ctrlr_loss_timeout_sec": 0, 00:17:45.910 "reconnect_delay_sec": 0, 00:17:45.910 "fast_io_fail_timeout_sec": 0, 00:17:45.910 "generate_uuids": false, 00:17:45.910 "transport_tos": 0, 00:17:45.910 "io_path_stat": false, 00:17:45.910 "allow_accel_sequence": false 00:17:45.910 } 00:17:45.910 }, 00:17:45.910 { 00:17:45.910 "method": "bdev_nvme_attach_controller", 00:17:45.910 "params": { 00:17:45.910 "name": "TLSTEST", 00:17:45.910 "trtype": "TCP", 00:17:45.910 "adrfam": "IPv4", 00:17:45.910 "traddr": "10.0.0.2", 00:17:45.910 "trsvcid": "4420", 00:17:45.910 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:45.910 "prchk_reftag": false, 00:17:45.910 "prchk_guard": false, 00:17:45.910 "ctrlr_loss_timeout_sec": 0, 00:17:45.910 "reconnect_delay_sec": 0, 00:17:45.910 "fast_io_fail_timeout_sec": 0, 00:17:45.910 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:45.910 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:45.910 "hdgst": false, 00:17:45.910 "ddgst": false 00:17:45.910 } 00:17:45.910 }, 00:17:45.910 { 00:17:45.910 "method": "bdev_nvme_set_hotplug", 00:17:45.910 "params": { 00:17:45.910 "period_us": 100000, 00:17:45.910 "enable": false 00:17:45.910 } 00:17:45.910 }, 00:17:45.910 { 00:17:45.910 "method": "bdev_wait_for_examine" 00:17:45.910 } 00:17:45.910 ] 00:17:45.910 }, 00:17:45.910 { 00:17:45.910 "subsystem": "nbd", 00:17:45.910 "config": [] 00:17:45.910 } 00:17:45.910 ] 00:17:45.910 }' 00:17:45.910 [2024-11-28 11:42:05.795933] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:45.910 [2024-11-28 11:42:05.796001] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3829559 ] 00:17:45.910 EAL: No free 2048 kB hugepages reported on node 1 00:17:45.910 [2024-11-28 11:42:05.853880] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:46.170 [2024-11-28 11:42:05.968036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:46.170 [2024-11-28 11:42:06.130705] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:46.738 11:42:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:46.738 11:42:06 -- common/autotest_common.sh@862 -- # return 0 00:17:46.738 11:42:06 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:46.997 Running I/O for 10 seconds... 00:17:57.004 00:17:57.004 Latency(us) 00:17:57.004 [2024-11-28T10:42:17.060Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:57.004 [2024-11-28T10:42:17.060Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:57.004 Verification LBA range: start 0x0 length 0x2000 00:17:57.004 TLSTESTn1 : 10.02 4236.86 16.55 0.00 0.00 30170.81 4757.43 46215.02 00:17:57.004 [2024-11-28T10:42:17.060Z] =================================================================================================================== 00:17:57.004 [2024-11-28T10:42:17.060Z] Total : 4236.86 16.55 0.00 0.00 30170.81 4757.43 46215.02 00:17:57.004 0 00:17:57.004 11:42:16 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:57.004 11:42:16 -- target/tls.sh@223 -- # killprocess 3829559 00:17:57.004 11:42:16 -- common/autotest_common.sh@936 -- # '[' -z 3829559 ']' 00:17:57.004 11:42:16 -- common/autotest_common.sh@940 -- # kill -0 3829559 00:17:57.004 11:42:16 -- common/autotest_common.sh@941 -- # uname 00:17:57.004 11:42:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:57.004 11:42:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3829559 00:17:57.004 11:42:16 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:57.004 11:42:16 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:57.004 11:42:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3829559' 00:17:57.004 killing process with pid 3829559 00:17:57.004 11:42:16 -- common/autotest_common.sh@955 -- # kill 3829559 00:17:57.004 Received shutdown signal, test time was about 10.000000 seconds 00:17:57.004 00:17:57.004 Latency(us) 00:17:57.004 [2024-11-28T10:42:17.060Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:57.004 [2024-11-28T10:42:17.060Z] =================================================================================================================== 00:17:57.004 [2024-11-28T10:42:17.061Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:57.005 11:42:16 -- common/autotest_common.sh@960 -- # wait 3829559 00:17:57.264 11:42:17 -- target/tls.sh@224 -- # killprocess 3829403 00:17:57.264 11:42:17 -- common/autotest_common.sh@936 -- # '[' -z 3829403 ']' 00:17:57.264 11:42:17 -- common/autotest_common.sh@940 -- # kill -0 3829403 00:17:57.264 11:42:17 -- common/autotest_common.sh@941 -- # uname 00:17:57.264 11:42:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:57.264 11:42:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3829403 00:17:57.264 11:42:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:57.264 11:42:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:57.264 11:42:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3829403' 00:17:57.264 killing process with pid 3829403 00:17:57.264 11:42:17 -- common/autotest_common.sh@955 -- # kill 3829403 00:17:57.264 11:42:17 -- common/autotest_common.sh@960 -- # wait 3829403 00:17:57.524 11:42:17 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:17:57.524 11:42:17 -- target/tls.sh@227 -- # cleanup 00:17:57.524 11:42:17 -- target/tls.sh@15 -- # process_shm --id 0 00:17:57.524 11:42:17 -- common/autotest_common.sh@806 -- # type=--id 00:17:57.524 11:42:17 -- common/autotest_common.sh@807 -- # id=0 00:17:57.524 11:42:17 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:17:57.524 11:42:17 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:57.783 11:42:17 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:17:57.783 11:42:17 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:17:57.783 11:42:17 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:17:57.783 11:42:17 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:57.783 nvmf_trace.0 00:17:57.783 11:42:17 -- common/autotest_common.sh@821 -- # return 0 00:17:57.783 11:42:17 -- target/tls.sh@16 -- # killprocess 3829559 00:17:57.783 11:42:17 -- common/autotest_common.sh@936 -- # '[' -z 3829559 ']' 00:17:57.783 11:42:17 -- common/autotest_common.sh@940 -- # kill -0 3829559 00:17:57.783 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3829559) - No such process 00:17:57.783 11:42:17 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3829559 is not found' 00:17:57.783 Process with pid 3829559 is not found 00:17:57.783 11:42:17 -- target/tls.sh@17 -- # nvmftestfini 00:17:57.783 11:42:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:57.783 11:42:17 -- nvmf/common.sh@116 -- # sync 00:17:57.783 11:42:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:57.783 11:42:17 -- nvmf/common.sh@119 -- # set +e 00:17:57.783 11:42:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:57.783 11:42:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:57.783 rmmod nvme_tcp 00:17:57.784 rmmod nvme_fabrics 00:17:57.784 rmmod nvme_keyring 00:17:57.784 11:42:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:57.784 11:42:17 -- nvmf/common.sh@123 -- # set -e 00:17:57.784 11:42:17 -- nvmf/common.sh@124 -- # return 0 00:17:57.784 11:42:17 -- nvmf/common.sh@477 -- # '[' -n 3829403 ']' 00:17:57.784 11:42:17 -- nvmf/common.sh@478 -- # killprocess 3829403 00:17:57.784 11:42:17 -- common/autotest_common.sh@936 -- # '[' -z 3829403 ']' 00:17:57.784 11:42:17 -- common/autotest_common.sh@940 -- # kill -0 3829403 00:17:57.784 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3829403) - No such process 00:17:57.784 11:42:17 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3829403 is not found' 00:17:57.784 Process with pid 3829403 is not found 00:17:57.784 11:42:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:57.784 11:42:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:57.784 11:42:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:57.784 11:42:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:57.784 11:42:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:57.784 11:42:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:57.784 11:42:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:57.784 11:42:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:59.689 11:42:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:59.689 11:42:19 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.689 00:17:59.689 real 1m16.092s 00:17:59.689 user 1m57.637s 00:17:59.689 sys 0m24.853s 00:17:59.689 11:42:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:59.689 11:42:19 -- common/autotest_common.sh@10 -- # set +x 00:17:59.689 ************************************ 00:17:59.689 END TEST nvmf_tls 00:17:59.689 ************************************ 00:17:59.948 11:42:19 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:59.948 11:42:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:59.948 11:42:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:59.948 11:42:19 -- common/autotest_common.sh@10 -- # set +x 00:17:59.948 ************************************ 00:17:59.948 START TEST nvmf_fips 00:17:59.948 ************************************ 00:17:59.948 11:42:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:59.948 * Looking for test storage... 00:17:59.948 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:17:59.948 11:42:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:59.948 11:42:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:59.948 11:42:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:59.948 11:42:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:59.948 11:42:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:59.948 11:42:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:59.948 11:42:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:59.949 11:42:19 -- scripts/common.sh@335 -- # IFS=.-: 00:17:59.949 11:42:19 -- scripts/common.sh@335 -- # read -ra ver1 00:17:59.949 11:42:19 -- scripts/common.sh@336 -- # IFS=.-: 00:17:59.949 11:42:19 -- scripts/common.sh@336 -- # read -ra ver2 00:17:59.949 11:42:19 -- scripts/common.sh@337 -- # local 'op=<' 00:17:59.949 11:42:19 -- scripts/common.sh@339 -- # ver1_l=2 00:17:59.949 11:42:19 -- scripts/common.sh@340 -- # ver2_l=1 00:17:59.949 11:42:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:59.949 11:42:19 -- scripts/common.sh@343 -- # case "$op" in 00:17:59.949 11:42:19 -- scripts/common.sh@344 -- # : 1 00:17:59.949 11:42:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:59.949 11:42:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:59.949 11:42:19 -- scripts/common.sh@364 -- # decimal 1 00:17:59.949 11:42:19 -- scripts/common.sh@352 -- # local d=1 00:17:59.949 11:42:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:59.949 11:42:19 -- scripts/common.sh@354 -- # echo 1 00:17:59.949 11:42:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:59.949 11:42:19 -- scripts/common.sh@365 -- # decimal 2 00:17:59.949 11:42:19 -- scripts/common.sh@352 -- # local d=2 00:17:59.949 11:42:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:59.949 11:42:19 -- scripts/common.sh@354 -- # echo 2 00:17:59.949 11:42:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:59.949 11:42:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:59.949 11:42:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:59.949 11:42:19 -- scripts/common.sh@367 -- # return 0 00:17:59.949 11:42:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:59.949 11:42:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:59.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:59.949 --rc genhtml_branch_coverage=1 00:17:59.949 --rc genhtml_function_coverage=1 00:17:59.949 --rc genhtml_legend=1 00:17:59.949 --rc geninfo_all_blocks=1 00:17:59.949 --rc geninfo_unexecuted_blocks=1 00:17:59.949 00:17:59.949 ' 00:17:59.949 11:42:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:59.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:59.949 --rc genhtml_branch_coverage=1 00:17:59.949 --rc genhtml_function_coverage=1 00:17:59.949 --rc genhtml_legend=1 00:17:59.949 --rc geninfo_all_blocks=1 00:17:59.949 --rc geninfo_unexecuted_blocks=1 00:17:59.949 00:17:59.949 ' 00:17:59.949 11:42:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:59.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:59.949 --rc genhtml_branch_coverage=1 00:17:59.949 --rc genhtml_function_coverage=1 00:17:59.949 --rc genhtml_legend=1 00:17:59.949 --rc geninfo_all_blocks=1 00:17:59.949 --rc geninfo_unexecuted_blocks=1 00:17:59.949 00:17:59.949 ' 00:17:59.949 11:42:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:59.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:59.949 --rc genhtml_branch_coverage=1 00:17:59.949 --rc genhtml_function_coverage=1 00:17:59.949 --rc genhtml_legend=1 00:17:59.949 --rc geninfo_all_blocks=1 00:17:59.949 --rc geninfo_unexecuted_blocks=1 00:17:59.949 00:17:59.949 ' 00:17:59.949 11:42:19 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:59.949 11:42:19 -- nvmf/common.sh@7 -- # uname -s 00:17:59.949 11:42:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:59.949 11:42:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:59.949 11:42:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:59.949 11:42:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:59.949 11:42:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:59.949 11:42:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:59.949 11:42:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:59.949 11:42:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:59.949 11:42:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:59.949 11:42:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:59.949 11:42:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:59.949 11:42:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:59.949 11:42:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:59.949 11:42:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:59.949 11:42:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:59.949 11:42:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:59.949 11:42:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:59.949 11:42:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:59.949 11:42:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:59.949 11:42:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:59.949 11:42:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:59.949 11:42:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:59.949 11:42:19 -- paths/export.sh@5 -- # export PATH 00:17:59.949 11:42:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:59.949 11:42:19 -- nvmf/common.sh@46 -- # : 0 00:17:59.949 11:42:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:59.949 11:42:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:59.949 11:42:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:59.949 11:42:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:59.949 11:42:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:59.949 11:42:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:59.949 11:42:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:59.949 11:42:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:59.949 11:42:19 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:59.949 11:42:19 -- fips/fips.sh@89 -- # check_openssl_version 00:17:59.949 11:42:19 -- fips/fips.sh@83 -- # local target=3.0.0 00:17:59.949 11:42:19 -- fips/fips.sh@85 -- # openssl version 00:17:59.949 11:42:19 -- fips/fips.sh@85 -- # awk '{print $2}' 00:17:59.949 11:42:19 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:17:59.949 11:42:19 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:17:59.949 11:42:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:59.949 11:42:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:59.949 11:42:19 -- scripts/common.sh@335 -- # IFS=.-: 00:17:59.949 11:42:19 -- scripts/common.sh@335 -- # read -ra ver1 00:17:59.949 11:42:19 -- scripts/common.sh@336 -- # IFS=.-: 00:17:59.949 11:42:19 -- scripts/common.sh@336 -- # read -ra ver2 00:17:59.949 11:42:19 -- scripts/common.sh@337 -- # local 'op=>=' 00:17:59.949 11:42:19 -- scripts/common.sh@339 -- # ver1_l=3 00:17:59.949 11:42:19 -- scripts/common.sh@340 -- # ver2_l=3 00:17:59.949 11:42:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:59.949 11:42:19 -- scripts/common.sh@343 -- # case "$op" in 00:17:59.949 11:42:19 -- scripts/common.sh@347 -- # : 1 00:17:59.949 11:42:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:59.949 11:42:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:59.949 11:42:19 -- scripts/common.sh@364 -- # decimal 3 00:17:59.949 11:42:19 -- scripts/common.sh@352 -- # local d=3 00:17:59.949 11:42:19 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:59.949 11:42:19 -- scripts/common.sh@354 -- # echo 3 00:17:59.949 11:42:19 -- scripts/common.sh@364 -- # ver1[v]=3 00:17:59.949 11:42:19 -- scripts/common.sh@365 -- # decimal 3 00:17:59.949 11:42:19 -- scripts/common.sh@352 -- # local d=3 00:17:59.949 11:42:19 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:59.949 11:42:19 -- scripts/common.sh@354 -- # echo 3 00:17:59.949 11:42:19 -- scripts/common.sh@365 -- # ver2[v]=3 00:17:59.949 11:42:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:59.949 11:42:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:59.949 11:42:19 -- scripts/common.sh@363 -- # (( v++ )) 00:17:59.949 11:42:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:59.949 11:42:19 -- scripts/common.sh@364 -- # decimal 1 00:17:59.949 11:42:19 -- scripts/common.sh@352 -- # local d=1 00:17:59.949 11:42:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:59.949 11:42:19 -- scripts/common.sh@354 -- # echo 1 00:17:59.949 11:42:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:59.949 11:42:19 -- scripts/common.sh@365 -- # decimal 0 00:17:59.949 11:42:19 -- scripts/common.sh@352 -- # local d=0 00:17:59.949 11:42:19 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:17:59.949 11:42:19 -- scripts/common.sh@354 -- # echo 0 00:17:59.949 11:42:19 -- scripts/common.sh@365 -- # ver2[v]=0 00:17:59.949 11:42:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:59.949 11:42:19 -- scripts/common.sh@366 -- # return 0 00:17:59.949 11:42:19 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:17:59.949 11:42:19 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:17:59.949 11:42:19 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:17:59.950 11:42:19 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:17:59.950 11:42:19 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:17:59.950 11:42:19 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:17:59.950 11:42:19 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:17:59.950 11:42:19 -- fips/fips.sh@113 -- # build_openssl_config 00:17:59.950 11:42:19 -- fips/fips.sh@37 -- # cat 00:17:59.950 11:42:19 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:17:59.950 11:42:19 -- fips/fips.sh@58 -- # cat - 00:17:59.950 11:42:19 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:17:59.950 11:42:19 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:17:59.950 11:42:19 -- fips/fips.sh@116 -- # mapfile -t providers 00:17:59.950 11:42:19 -- fips/fips.sh@116 -- # openssl list -providers 00:17:59.950 11:42:19 -- fips/fips.sh@116 -- # grep name 00:17:59.950 11:42:19 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:17:59.950 11:42:19 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:17:59.950 11:42:19 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:17:59.950 11:42:19 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:17:59.950 11:42:19 -- fips/fips.sh@127 -- # : 00:17:59.950 11:42:19 -- common/autotest_common.sh@650 -- # local es=0 00:17:59.950 11:42:19 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:17:59.950 11:42:19 -- common/autotest_common.sh@638 -- # local arg=openssl 00:17:59.950 11:42:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:59.950 11:42:19 -- common/autotest_common.sh@642 -- # type -t openssl 00:17:59.950 11:42:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:59.950 11:42:19 -- common/autotest_common.sh@644 -- # type -P openssl 00:17:59.950 11:42:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:59.950 11:42:19 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:17:59.950 11:42:19 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:17:59.950 11:42:19 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:00.208 Error setting digest 00:18:00.208 40F2AAC0C17F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:00.208 40F2AAC0C17F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:00.208 11:42:20 -- common/autotest_common.sh@653 -- # es=1 00:18:00.208 11:42:20 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:00.208 11:42:20 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:00.208 11:42:20 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:00.208 11:42:20 -- fips/fips.sh@130 -- # nvmftestinit 00:18:00.208 11:42:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:00.208 11:42:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:00.208 11:42:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:00.208 11:42:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:00.208 11:42:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:00.208 11:42:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:00.208 11:42:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:00.208 11:42:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:00.208 11:42:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:00.208 11:42:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:00.208 11:42:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:00.208 11:42:20 -- common/autotest_common.sh@10 -- # set +x 00:18:02.114 11:42:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:02.115 11:42:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:02.115 11:42:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:02.115 11:42:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:02.115 11:42:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:02.115 11:42:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:02.115 11:42:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:02.115 11:42:22 -- nvmf/common.sh@294 -- # net_devs=() 00:18:02.115 11:42:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:02.115 11:42:22 -- nvmf/common.sh@295 -- # e810=() 00:18:02.115 11:42:22 -- nvmf/common.sh@295 -- # local -ga e810 00:18:02.115 11:42:22 -- nvmf/common.sh@296 -- # x722=() 00:18:02.115 11:42:22 -- nvmf/common.sh@296 -- # local -ga x722 00:18:02.115 11:42:22 -- nvmf/common.sh@297 -- # mlx=() 00:18:02.115 11:42:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:02.115 11:42:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:02.115 11:42:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:02.115 11:42:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:02.115 11:42:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:02.115 11:42:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:02.115 11:42:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:02.115 11:42:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:02.115 11:42:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:02.115 11:42:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:02.115 11:42:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:02.115 11:42:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:02.115 11:42:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:02.115 11:42:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:02.115 11:42:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:02.115 11:42:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:02.115 11:42:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:02.115 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:02.115 11:42:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:02.115 11:42:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:02.115 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:02.115 11:42:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:02.115 11:42:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:02.115 11:42:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:02.115 11:42:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:02.115 11:42:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:02.115 11:42:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:02.115 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:02.115 11:42:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:02.115 11:42:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:02.115 11:42:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:02.115 11:42:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:02.115 11:42:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:02.115 11:42:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:02.115 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:02.115 11:42:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:02.115 11:42:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:02.115 11:42:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:02.115 11:42:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:02.115 11:42:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:02.115 11:42:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:02.115 11:42:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:02.115 11:42:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:02.115 11:42:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:02.115 11:42:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:02.115 11:42:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:02.115 11:42:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:02.115 11:42:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:02.115 11:42:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:02.115 11:42:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:02.115 11:42:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:02.115 11:42:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:02.115 11:42:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:02.115 11:42:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:02.115 11:42:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:02.115 11:42:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:02.115 11:42:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:02.115 11:42:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:02.115 11:42:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:02.115 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:02.115 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.278 ms 00:18:02.115 00:18:02.115 --- 10.0.0.2 ping statistics --- 00:18:02.115 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:02.115 rtt min/avg/max/mdev = 0.278/0.278/0.278/0.000 ms 00:18:02.115 11:42:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:02.115 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:02.115 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.133 ms 00:18:02.115 00:18:02.115 --- 10.0.0.1 ping statistics --- 00:18:02.115 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:02.115 rtt min/avg/max/mdev = 0.133/0.133/0.133/0.000 ms 00:18:02.115 11:42:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:02.115 11:42:22 -- nvmf/common.sh@410 -- # return 0 00:18:02.115 11:42:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:02.115 11:42:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:02.115 11:42:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:02.115 11:42:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:02.115 11:42:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:02.115 11:42:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:02.115 11:42:22 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:02.115 11:42:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:02.115 11:42:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:02.115 11:42:22 -- common/autotest_common.sh@10 -- # set +x 00:18:02.374 11:42:22 -- nvmf/common.sh@469 -- # nvmfpid=3833411 00:18:02.374 11:42:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:02.374 11:42:22 -- nvmf/common.sh@470 -- # waitforlisten 3833411 00:18:02.374 11:42:22 -- common/autotest_common.sh@829 -- # '[' -z 3833411 ']' 00:18:02.374 11:42:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:02.374 11:42:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:02.374 11:42:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:02.374 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:02.374 11:42:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:02.374 11:42:22 -- common/autotest_common.sh@10 -- # set +x 00:18:02.374 [2024-11-28 11:42:22.240144] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:02.374 [2024-11-28 11:42:22.240227] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:02.374 EAL: No free 2048 kB hugepages reported on node 1 00:18:02.374 [2024-11-28 11:42:22.308305] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:02.374 [2024-11-28 11:42:22.423686] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:02.374 [2024-11-28 11:42:22.423853] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:02.374 [2024-11-28 11:42:22.423871] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:02.374 [2024-11-28 11:42:22.423884] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:02.374 [2024-11-28 11:42:22.423911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:03.308 11:42:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:03.308 11:42:23 -- common/autotest_common.sh@862 -- # return 0 00:18:03.308 11:42:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:03.308 11:42:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:03.308 11:42:23 -- common/autotest_common.sh@10 -- # set +x 00:18:03.308 11:42:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:03.308 11:42:23 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:03.308 11:42:23 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:03.308 11:42:23 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:03.308 11:42:23 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:03.308 11:42:23 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:03.308 11:42:23 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:03.308 11:42:23 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:03.308 11:42:23 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:03.566 [2024-11-28 11:42:23.437140] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:03.566 [2024-11-28 11:42:23.453128] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:03.566 [2024-11-28 11:42:23.453342] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:03.566 malloc0 00:18:03.566 11:42:23 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:03.566 11:42:23 -- fips/fips.sh@147 -- # bdevperf_pid=3833689 00:18:03.566 11:42:23 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:03.566 11:42:23 -- fips/fips.sh@148 -- # waitforlisten 3833689 /var/tmp/bdevperf.sock 00:18:03.566 11:42:23 -- common/autotest_common.sh@829 -- # '[' -z 3833689 ']' 00:18:03.566 11:42:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:03.566 11:42:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:03.566 11:42:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:03.566 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:03.566 11:42:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:03.566 11:42:23 -- common/autotest_common.sh@10 -- # set +x 00:18:03.566 [2024-11-28 11:42:23.573178] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:03.566 [2024-11-28 11:42:23.573261] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3833689 ] 00:18:03.566 EAL: No free 2048 kB hugepages reported on node 1 00:18:03.824 [2024-11-28 11:42:23.630251] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:03.824 [2024-11-28 11:42:23.732990] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:04.757 11:42:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:04.758 11:42:24 -- common/autotest_common.sh@862 -- # return 0 00:18:04.758 11:42:24 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:04.758 [2024-11-28 11:42:24.738078] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:05.015 TLSTESTn1 00:18:05.015 11:42:24 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:05.015 Running I/O for 10 seconds... 00:18:15.082 00:18:15.082 Latency(us) 00:18:15.082 [2024-11-28T10:42:35.138Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:15.082 [2024-11-28T10:42:35.138Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:15.082 Verification LBA range: start 0x0 length 0x2000 00:18:15.082 TLSTESTn1 : 10.02 3963.80 15.48 0.00 0.00 32252.30 7815.77 41360.50 00:18:15.082 [2024-11-28T10:42:35.138Z] =================================================================================================================== 00:18:15.082 [2024-11-28T10:42:35.138Z] Total : 3963.80 15.48 0.00 0.00 32252.30 7815.77 41360.50 00:18:15.082 0 00:18:15.082 11:42:34 -- fips/fips.sh@1 -- # cleanup 00:18:15.082 11:42:34 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:15.082 11:42:34 -- common/autotest_common.sh@806 -- # type=--id 00:18:15.082 11:42:34 -- common/autotest_common.sh@807 -- # id=0 00:18:15.082 11:42:34 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:15.082 11:42:34 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:15.082 11:42:34 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:15.082 11:42:34 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:15.082 11:42:34 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:15.082 11:42:34 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:15.082 nvmf_trace.0 00:18:15.082 11:42:35 -- common/autotest_common.sh@821 -- # return 0 00:18:15.082 11:42:35 -- fips/fips.sh@16 -- # killprocess 3833689 00:18:15.082 11:42:35 -- common/autotest_common.sh@936 -- # '[' -z 3833689 ']' 00:18:15.082 11:42:35 -- common/autotest_common.sh@940 -- # kill -0 3833689 00:18:15.082 11:42:35 -- common/autotest_common.sh@941 -- # uname 00:18:15.082 11:42:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:15.082 11:42:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3833689 00:18:15.082 11:42:35 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:15.082 11:42:35 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:15.082 11:42:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3833689' 00:18:15.082 killing process with pid 3833689 00:18:15.082 11:42:35 -- common/autotest_common.sh@955 -- # kill 3833689 00:18:15.082 Received shutdown signal, test time was about 10.000000 seconds 00:18:15.082 00:18:15.082 Latency(us) 00:18:15.082 [2024-11-28T10:42:35.138Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:15.082 [2024-11-28T10:42:35.138Z] =================================================================================================================== 00:18:15.082 [2024-11-28T10:42:35.138Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:15.082 11:42:35 -- common/autotest_common.sh@960 -- # wait 3833689 00:18:15.339 11:42:35 -- fips/fips.sh@17 -- # nvmftestfini 00:18:15.339 11:42:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:15.339 11:42:35 -- nvmf/common.sh@116 -- # sync 00:18:15.339 11:42:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:15.339 11:42:35 -- nvmf/common.sh@119 -- # set +e 00:18:15.339 11:42:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:15.339 11:42:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:15.339 rmmod nvme_tcp 00:18:15.339 rmmod nvme_fabrics 00:18:15.597 rmmod nvme_keyring 00:18:15.597 11:42:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:15.597 11:42:35 -- nvmf/common.sh@123 -- # set -e 00:18:15.597 11:42:35 -- nvmf/common.sh@124 -- # return 0 00:18:15.597 11:42:35 -- nvmf/common.sh@477 -- # '[' -n 3833411 ']' 00:18:15.597 11:42:35 -- nvmf/common.sh@478 -- # killprocess 3833411 00:18:15.597 11:42:35 -- common/autotest_common.sh@936 -- # '[' -z 3833411 ']' 00:18:15.597 11:42:35 -- common/autotest_common.sh@940 -- # kill -0 3833411 00:18:15.597 11:42:35 -- common/autotest_common.sh@941 -- # uname 00:18:15.597 11:42:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:15.597 11:42:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3833411 00:18:15.597 11:42:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:15.597 11:42:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:15.597 11:42:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3833411' 00:18:15.597 killing process with pid 3833411 00:18:15.597 11:42:35 -- common/autotest_common.sh@955 -- # kill 3833411 00:18:15.597 11:42:35 -- common/autotest_common.sh@960 -- # wait 3833411 00:18:15.853 11:42:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:15.853 11:42:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:15.853 11:42:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:15.853 11:42:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:15.853 11:42:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:15.853 11:42:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:15.853 11:42:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:15.853 11:42:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:17.754 11:42:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:17.754 11:42:37 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:17.754 00:18:17.754 real 0m18.033s 00:18:17.754 user 0m22.899s 00:18:17.754 sys 0m6.584s 00:18:17.754 11:42:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:17.754 11:42:37 -- common/autotest_common.sh@10 -- # set +x 00:18:17.754 ************************************ 00:18:17.754 END TEST nvmf_fips 00:18:17.754 ************************************ 00:18:18.012 11:42:37 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:18.012 11:42:37 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:18.012 11:42:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:18.012 11:42:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:18.012 11:42:37 -- common/autotest_common.sh@10 -- # set +x 00:18:18.012 ************************************ 00:18:18.012 START TEST nvmf_fuzz 00:18:18.012 ************************************ 00:18:18.012 11:42:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:18.012 * Looking for test storage... 00:18:18.012 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:18.012 11:42:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:18.012 11:42:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:18.012 11:42:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:18.013 11:42:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:18.013 11:42:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:18.013 11:42:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:18.013 11:42:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:18.013 11:42:37 -- scripts/common.sh@335 -- # IFS=.-: 00:18:18.013 11:42:37 -- scripts/common.sh@335 -- # read -ra ver1 00:18:18.013 11:42:37 -- scripts/common.sh@336 -- # IFS=.-: 00:18:18.013 11:42:37 -- scripts/common.sh@336 -- # read -ra ver2 00:18:18.013 11:42:37 -- scripts/common.sh@337 -- # local 'op=<' 00:18:18.013 11:42:37 -- scripts/common.sh@339 -- # ver1_l=2 00:18:18.013 11:42:37 -- scripts/common.sh@340 -- # ver2_l=1 00:18:18.013 11:42:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:18.013 11:42:37 -- scripts/common.sh@343 -- # case "$op" in 00:18:18.013 11:42:37 -- scripts/common.sh@344 -- # : 1 00:18:18.013 11:42:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:18.013 11:42:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:18.013 11:42:37 -- scripts/common.sh@364 -- # decimal 1 00:18:18.013 11:42:37 -- scripts/common.sh@352 -- # local d=1 00:18:18.013 11:42:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:18.013 11:42:37 -- scripts/common.sh@354 -- # echo 1 00:18:18.013 11:42:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:18.013 11:42:37 -- scripts/common.sh@365 -- # decimal 2 00:18:18.013 11:42:37 -- scripts/common.sh@352 -- # local d=2 00:18:18.013 11:42:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:18.013 11:42:37 -- scripts/common.sh@354 -- # echo 2 00:18:18.013 11:42:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:18.013 11:42:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:18.013 11:42:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:18.013 11:42:37 -- scripts/common.sh@367 -- # return 0 00:18:18.013 11:42:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:18.013 11:42:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:18.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:18.013 --rc genhtml_branch_coverage=1 00:18:18.013 --rc genhtml_function_coverage=1 00:18:18.013 --rc genhtml_legend=1 00:18:18.013 --rc geninfo_all_blocks=1 00:18:18.013 --rc geninfo_unexecuted_blocks=1 00:18:18.013 00:18:18.013 ' 00:18:18.013 11:42:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:18.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:18.013 --rc genhtml_branch_coverage=1 00:18:18.013 --rc genhtml_function_coverage=1 00:18:18.013 --rc genhtml_legend=1 00:18:18.013 --rc geninfo_all_blocks=1 00:18:18.013 --rc geninfo_unexecuted_blocks=1 00:18:18.013 00:18:18.013 ' 00:18:18.013 11:42:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:18.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:18.013 --rc genhtml_branch_coverage=1 00:18:18.013 --rc genhtml_function_coverage=1 00:18:18.013 --rc genhtml_legend=1 00:18:18.013 --rc geninfo_all_blocks=1 00:18:18.013 --rc geninfo_unexecuted_blocks=1 00:18:18.013 00:18:18.013 ' 00:18:18.013 11:42:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:18.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:18.013 --rc genhtml_branch_coverage=1 00:18:18.013 --rc genhtml_function_coverage=1 00:18:18.013 --rc genhtml_legend=1 00:18:18.013 --rc geninfo_all_blocks=1 00:18:18.013 --rc geninfo_unexecuted_blocks=1 00:18:18.013 00:18:18.013 ' 00:18:18.013 11:42:37 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:18.013 11:42:37 -- nvmf/common.sh@7 -- # uname -s 00:18:18.013 11:42:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:18.013 11:42:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:18.013 11:42:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:18.013 11:42:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:18.013 11:42:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:18.013 11:42:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:18.013 11:42:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:18.013 11:42:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:18.013 11:42:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:18.013 11:42:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:18.013 11:42:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:18.013 11:42:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:18.013 11:42:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:18.013 11:42:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:18.013 11:42:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:18.013 11:42:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:18.013 11:42:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:18.013 11:42:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:18.013 11:42:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:18.013 11:42:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.013 11:42:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.013 11:42:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.013 11:42:37 -- paths/export.sh@5 -- # export PATH 00:18:18.013 11:42:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.013 11:42:37 -- nvmf/common.sh@46 -- # : 0 00:18:18.013 11:42:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:18.013 11:42:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:18.013 11:42:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:18.013 11:42:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:18.013 11:42:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:18.013 11:42:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:18.013 11:42:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:18.013 11:42:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:18.013 11:42:37 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:18.013 11:42:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:18.013 11:42:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:18.013 11:42:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:18.013 11:42:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:18.013 11:42:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:18.013 11:42:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:18.013 11:42:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:18.013 11:42:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:18.013 11:42:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:18.013 11:42:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:18.013 11:42:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:18.013 11:42:37 -- common/autotest_common.sh@10 -- # set +x 00:18:19.917 11:42:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:19.917 11:42:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:19.917 11:42:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:19.917 11:42:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:19.917 11:42:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:19.917 11:42:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:19.917 11:42:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:19.917 11:42:39 -- nvmf/common.sh@294 -- # net_devs=() 00:18:19.917 11:42:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:19.917 11:42:39 -- nvmf/common.sh@295 -- # e810=() 00:18:19.917 11:42:39 -- nvmf/common.sh@295 -- # local -ga e810 00:18:19.917 11:42:39 -- nvmf/common.sh@296 -- # x722=() 00:18:19.917 11:42:39 -- nvmf/common.sh@296 -- # local -ga x722 00:18:19.917 11:42:39 -- nvmf/common.sh@297 -- # mlx=() 00:18:19.917 11:42:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:19.917 11:42:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:19.917 11:42:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:19.917 11:42:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:19.917 11:42:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:19.917 11:42:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:19.917 11:42:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:19.917 11:42:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:19.917 11:42:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:19.917 11:42:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:19.917 11:42:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:19.917 11:42:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:19.917 11:42:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:19.917 11:42:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:19.917 11:42:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:19.917 11:42:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:19.917 11:42:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:19.917 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:19.917 11:42:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:19.917 11:42:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:19.917 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:19.917 11:42:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:19.917 11:42:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:19.917 11:42:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:19.917 11:42:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:19.917 11:42:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:19.917 11:42:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:19.917 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:19.917 11:42:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:19.917 11:42:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:19.917 11:42:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:19.917 11:42:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:19.917 11:42:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:19.917 11:42:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:19.917 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:19.917 11:42:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:19.917 11:42:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:19.917 11:42:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:19.917 11:42:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:19.917 11:42:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:19.917 11:42:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:19.917 11:42:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:19.917 11:42:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:19.917 11:42:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:19.917 11:42:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:19.917 11:42:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:19.917 11:42:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:19.917 11:42:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:19.917 11:42:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:19.917 11:42:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:19.917 11:42:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:19.917 11:42:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:19.917 11:42:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:19.917 11:42:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:19.917 11:42:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:19.917 11:42:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:19.917 11:42:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:20.176 11:42:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:20.176 11:42:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:20.176 11:42:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:20.176 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:20.176 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.287 ms 00:18:20.176 00:18:20.176 --- 10.0.0.2 ping statistics --- 00:18:20.176 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:20.176 rtt min/avg/max/mdev = 0.287/0.287/0.287/0.000 ms 00:18:20.176 11:42:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:20.176 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:20.176 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:18:20.176 00:18:20.176 --- 10.0.0.1 ping statistics --- 00:18:20.176 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:20.176 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:18:20.176 11:42:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:20.176 11:42:40 -- nvmf/common.sh@410 -- # return 0 00:18:20.176 11:42:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:20.176 11:42:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:20.176 11:42:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:20.176 11:42:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:20.176 11:42:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:20.176 11:42:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:20.176 11:42:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:20.176 11:42:40 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=3837013 00:18:20.176 11:42:40 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:20.176 11:42:40 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:20.176 11:42:40 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 3837013 00:18:20.176 11:42:40 -- common/autotest_common.sh@829 -- # '[' -z 3837013 ']' 00:18:20.176 11:42:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:20.176 11:42:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:20.176 11:42:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:20.176 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:20.176 11:42:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:20.176 11:42:40 -- common/autotest_common.sh@10 -- # set +x 00:18:21.108 11:42:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:21.108 11:42:41 -- common/autotest_common.sh@862 -- # return 0 00:18:21.108 11:42:41 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:21.108 11:42:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.108 11:42:41 -- common/autotest_common.sh@10 -- # set +x 00:18:21.108 11:42:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.108 11:42:41 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:21.108 11:42:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.108 11:42:41 -- common/autotest_common.sh@10 -- # set +x 00:18:21.108 Malloc0 00:18:21.108 11:42:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.108 11:42:41 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:21.108 11:42:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.108 11:42:41 -- common/autotest_common.sh@10 -- # set +x 00:18:21.108 11:42:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.108 11:42:41 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:21.108 11:42:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.108 11:42:41 -- common/autotest_common.sh@10 -- # set +x 00:18:21.367 11:42:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.367 11:42:41 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:21.367 11:42:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.367 11:42:41 -- common/autotest_common.sh@10 -- # set +x 00:18:21.367 11:42:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.367 11:42:41 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:21.367 11:42:41 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:18:53.438 Fuzzing completed. Shutting down the fuzz application 00:18:53.438 00:18:53.438 Dumping successful admin opcodes: 00:18:53.438 8, 9, 10, 24, 00:18:53.438 Dumping successful io opcodes: 00:18:53.438 0, 9, 00:18:53.438 NS: 0x200003aeff00 I/O qp, Total commands completed: 471630, total successful commands: 2725, random_seed: 797739456 00:18:53.438 NS: 0x200003aeff00 admin qp, Total commands completed: 58128, total successful commands: 463, random_seed: 3336464896 00:18:53.438 11:43:11 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:18:53.438 Fuzzing completed. Shutting down the fuzz application 00:18:53.438 00:18:53.438 Dumping successful admin opcodes: 00:18:53.438 24, 00:18:53.438 Dumping successful io opcodes: 00:18:53.438 00:18:53.438 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 661091637 00:18:53.438 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 661246389 00:18:53.438 11:43:13 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:53.438 11:43:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:53.438 11:43:13 -- common/autotest_common.sh@10 -- # set +x 00:18:53.438 11:43:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:53.438 11:43:13 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:18:53.438 11:43:13 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:18:53.438 11:43:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:53.438 11:43:13 -- nvmf/common.sh@116 -- # sync 00:18:53.438 11:43:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:53.438 11:43:13 -- nvmf/common.sh@119 -- # set +e 00:18:53.438 11:43:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:53.438 11:43:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:53.438 rmmod nvme_tcp 00:18:53.438 rmmod nvme_fabrics 00:18:53.438 rmmod nvme_keyring 00:18:53.438 11:43:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:53.438 11:43:13 -- nvmf/common.sh@123 -- # set -e 00:18:53.438 11:43:13 -- nvmf/common.sh@124 -- # return 0 00:18:53.438 11:43:13 -- nvmf/common.sh@477 -- # '[' -n 3837013 ']' 00:18:53.438 11:43:13 -- nvmf/common.sh@478 -- # killprocess 3837013 00:18:53.438 11:43:13 -- common/autotest_common.sh@936 -- # '[' -z 3837013 ']' 00:18:53.438 11:43:13 -- common/autotest_common.sh@940 -- # kill -0 3837013 00:18:53.438 11:43:13 -- common/autotest_common.sh@941 -- # uname 00:18:53.438 11:43:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:53.438 11:43:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3837013 00:18:53.438 11:43:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:53.438 11:43:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:53.438 11:43:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3837013' 00:18:53.438 killing process with pid 3837013 00:18:53.438 11:43:13 -- common/autotest_common.sh@955 -- # kill 3837013 00:18:53.438 11:43:13 -- common/autotest_common.sh@960 -- # wait 3837013 00:18:53.697 11:43:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:53.697 11:43:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:53.697 11:43:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:53.697 11:43:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:53.697 11:43:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:53.697 11:43:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:53.697 11:43:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:53.697 11:43:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:55.596 11:43:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:55.596 11:43:15 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:18:55.596 00:18:55.596 real 0m37.753s 00:18:55.596 user 0m52.805s 00:18:55.596 sys 0m14.497s 00:18:55.596 11:43:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:55.596 11:43:15 -- common/autotest_common.sh@10 -- # set +x 00:18:55.596 ************************************ 00:18:55.596 END TEST nvmf_fuzz 00:18:55.596 ************************************ 00:18:55.596 11:43:15 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:55.596 11:43:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:55.596 11:43:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:55.596 11:43:15 -- common/autotest_common.sh@10 -- # set +x 00:18:55.596 ************************************ 00:18:55.596 START TEST nvmf_multiconnection 00:18:55.596 ************************************ 00:18:55.596 11:43:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:55.596 * Looking for test storage... 00:18:55.596 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:55.596 11:43:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:55.596 11:43:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:55.596 11:43:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:55.855 11:43:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:55.855 11:43:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:55.855 11:43:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:55.855 11:43:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:55.855 11:43:15 -- scripts/common.sh@335 -- # IFS=.-: 00:18:55.855 11:43:15 -- scripts/common.sh@335 -- # read -ra ver1 00:18:55.855 11:43:15 -- scripts/common.sh@336 -- # IFS=.-: 00:18:55.855 11:43:15 -- scripts/common.sh@336 -- # read -ra ver2 00:18:55.855 11:43:15 -- scripts/common.sh@337 -- # local 'op=<' 00:18:55.855 11:43:15 -- scripts/common.sh@339 -- # ver1_l=2 00:18:55.855 11:43:15 -- scripts/common.sh@340 -- # ver2_l=1 00:18:55.855 11:43:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:55.855 11:43:15 -- scripts/common.sh@343 -- # case "$op" in 00:18:55.855 11:43:15 -- scripts/common.sh@344 -- # : 1 00:18:55.855 11:43:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:55.855 11:43:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:55.855 11:43:15 -- scripts/common.sh@364 -- # decimal 1 00:18:55.855 11:43:15 -- scripts/common.sh@352 -- # local d=1 00:18:55.855 11:43:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:55.855 11:43:15 -- scripts/common.sh@354 -- # echo 1 00:18:55.855 11:43:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:55.855 11:43:15 -- scripts/common.sh@365 -- # decimal 2 00:18:55.855 11:43:15 -- scripts/common.sh@352 -- # local d=2 00:18:55.855 11:43:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:55.855 11:43:15 -- scripts/common.sh@354 -- # echo 2 00:18:55.855 11:43:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:55.855 11:43:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:55.855 11:43:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:55.855 11:43:15 -- scripts/common.sh@367 -- # return 0 00:18:55.855 11:43:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:55.855 11:43:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:55.855 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.855 --rc genhtml_branch_coverage=1 00:18:55.855 --rc genhtml_function_coverage=1 00:18:55.855 --rc genhtml_legend=1 00:18:55.855 --rc geninfo_all_blocks=1 00:18:55.855 --rc geninfo_unexecuted_blocks=1 00:18:55.855 00:18:55.855 ' 00:18:55.855 11:43:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:55.855 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.855 --rc genhtml_branch_coverage=1 00:18:55.855 --rc genhtml_function_coverage=1 00:18:55.855 --rc genhtml_legend=1 00:18:55.855 --rc geninfo_all_blocks=1 00:18:55.855 --rc geninfo_unexecuted_blocks=1 00:18:55.855 00:18:55.855 ' 00:18:55.855 11:43:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:55.855 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.855 --rc genhtml_branch_coverage=1 00:18:55.855 --rc genhtml_function_coverage=1 00:18:55.855 --rc genhtml_legend=1 00:18:55.855 --rc geninfo_all_blocks=1 00:18:55.855 --rc geninfo_unexecuted_blocks=1 00:18:55.856 00:18:55.856 ' 00:18:55.856 11:43:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:55.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.856 --rc genhtml_branch_coverage=1 00:18:55.856 --rc genhtml_function_coverage=1 00:18:55.856 --rc genhtml_legend=1 00:18:55.856 --rc geninfo_all_blocks=1 00:18:55.856 --rc geninfo_unexecuted_blocks=1 00:18:55.856 00:18:55.856 ' 00:18:55.856 11:43:15 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:55.856 11:43:15 -- nvmf/common.sh@7 -- # uname -s 00:18:55.856 11:43:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:55.856 11:43:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:55.856 11:43:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:55.856 11:43:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:55.856 11:43:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:55.856 11:43:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:55.856 11:43:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:55.856 11:43:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:55.856 11:43:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:55.856 11:43:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:55.856 11:43:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:55.856 11:43:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:55.856 11:43:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:55.856 11:43:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:55.856 11:43:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:55.856 11:43:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:55.856 11:43:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:55.856 11:43:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:55.856 11:43:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:55.856 11:43:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.856 11:43:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.856 11:43:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.856 11:43:15 -- paths/export.sh@5 -- # export PATH 00:18:55.856 11:43:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.856 11:43:15 -- nvmf/common.sh@46 -- # : 0 00:18:55.856 11:43:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:55.856 11:43:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:55.856 11:43:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:55.856 11:43:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:55.856 11:43:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:55.856 11:43:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:55.856 11:43:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:55.856 11:43:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:55.856 11:43:15 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:55.856 11:43:15 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:55.856 11:43:15 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:18:55.856 11:43:15 -- target/multiconnection.sh@16 -- # nvmftestinit 00:18:55.856 11:43:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:55.856 11:43:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:55.856 11:43:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:55.856 11:43:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:55.856 11:43:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:55.856 11:43:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:55.856 11:43:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:55.856 11:43:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:55.856 11:43:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:55.856 11:43:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:55.856 11:43:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:55.856 11:43:15 -- common/autotest_common.sh@10 -- # set +x 00:18:57.756 11:43:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:57.756 11:43:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:57.756 11:43:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:57.756 11:43:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:57.756 11:43:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:57.756 11:43:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:57.756 11:43:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:57.756 11:43:17 -- nvmf/common.sh@294 -- # net_devs=() 00:18:57.756 11:43:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:57.756 11:43:17 -- nvmf/common.sh@295 -- # e810=() 00:18:57.756 11:43:17 -- nvmf/common.sh@295 -- # local -ga e810 00:18:57.756 11:43:17 -- nvmf/common.sh@296 -- # x722=() 00:18:57.756 11:43:17 -- nvmf/common.sh@296 -- # local -ga x722 00:18:57.756 11:43:17 -- nvmf/common.sh@297 -- # mlx=() 00:18:57.756 11:43:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:57.756 11:43:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:57.756 11:43:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:57.756 11:43:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:57.756 11:43:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:57.756 11:43:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:57.756 11:43:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:57.756 11:43:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:57.756 11:43:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:57.756 11:43:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:57.757 11:43:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:57.757 11:43:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:57.757 11:43:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:57.757 11:43:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:57.757 11:43:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:57.757 11:43:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:57.757 11:43:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:57.757 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:57.757 11:43:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:57.757 11:43:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:57.757 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:57.757 11:43:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:57.757 11:43:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:57.757 11:43:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:57.757 11:43:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:57.757 11:43:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:57.757 11:43:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:57.757 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:57.757 11:43:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:57.757 11:43:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:57.757 11:43:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:57.757 11:43:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:57.757 11:43:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:57.757 11:43:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:57.757 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:57.757 11:43:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:57.757 11:43:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:57.757 11:43:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:57.757 11:43:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:57.757 11:43:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:57.757 11:43:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:57.757 11:43:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:57.757 11:43:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:57.757 11:43:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:57.757 11:43:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:57.757 11:43:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:57.757 11:43:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:57.757 11:43:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:57.757 11:43:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:57.757 11:43:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:57.757 11:43:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:57.757 11:43:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:57.757 11:43:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:57.757 11:43:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:57.757 11:43:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:57.757 11:43:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:57.757 11:43:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:58.015 11:43:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:58.015 11:43:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:58.015 11:43:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:58.015 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:58.015 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:18:58.015 00:18:58.015 --- 10.0.0.2 ping statistics --- 00:18:58.015 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:58.015 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:18:58.015 11:43:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:58.015 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:58.015 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:18:58.015 00:18:58.015 --- 10.0.0.1 ping statistics --- 00:18:58.015 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:58.015 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:18:58.015 11:43:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:58.015 11:43:17 -- nvmf/common.sh@410 -- # return 0 00:18:58.015 11:43:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:58.015 11:43:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:58.015 11:43:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:58.015 11:43:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:58.015 11:43:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:58.015 11:43:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:58.015 11:43:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:58.015 11:43:17 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:18:58.015 11:43:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:58.015 11:43:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:58.015 11:43:17 -- common/autotest_common.sh@10 -- # set +x 00:18:58.015 11:43:17 -- nvmf/common.sh@469 -- # nvmfpid=3842954 00:18:58.015 11:43:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:58.015 11:43:17 -- nvmf/common.sh@470 -- # waitforlisten 3842954 00:18:58.015 11:43:17 -- common/autotest_common.sh@829 -- # '[' -z 3842954 ']' 00:18:58.015 11:43:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:58.015 11:43:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:58.015 11:43:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:58.015 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:58.015 11:43:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:58.015 11:43:17 -- common/autotest_common.sh@10 -- # set +x 00:18:58.015 [2024-11-28 11:43:17.981076] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:58.015 [2024-11-28 11:43:17.981152] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:58.015 EAL: No free 2048 kB hugepages reported on node 1 00:18:58.015 [2024-11-28 11:43:18.053138] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:58.273 [2024-11-28 11:43:18.171016] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:58.273 [2024-11-28 11:43:18.171179] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:58.273 [2024-11-28 11:43:18.171198] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:58.273 [2024-11-28 11:43:18.171212] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:58.273 [2024-11-28 11:43:18.171295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:58.273 [2024-11-28 11:43:18.171353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:58.273 [2024-11-28 11:43:18.171468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:58.273 [2024-11-28 11:43:18.171471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:59.206 11:43:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:59.206 11:43:18 -- common/autotest_common.sh@862 -- # return 0 00:18:59.206 11:43:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:59.206 11:43:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:59.206 11:43:18 -- common/autotest_common.sh@10 -- # set +x 00:18:59.206 11:43:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:59.206 11:43:18 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:59.206 11:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.206 11:43:18 -- common/autotest_common.sh@10 -- # set +x 00:18:59.206 [2024-11-28 11:43:18.965992] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:59.206 11:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:18 -- target/multiconnection.sh@21 -- # seq 1 11 00:18:59.207 11:43:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.207 11:43:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:18:59.207 11:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:18 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 Malloc1 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 [2024-11-28 11:43:19.021279] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.207 11:43:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 Malloc2 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.207 11:43:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 Malloc3 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.207 11:43:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 Malloc4 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.207 11:43:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 Malloc5 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.207 11:43:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 Malloc6 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:18:59.207 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.207 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.207 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.207 11:43:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:18:59.208 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.208 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.208 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.208 11:43:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.208 11:43:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:18:59.208 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.208 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 Malloc7 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.466 11:43:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 Malloc8 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.466 11:43:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 Malloc9 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.466 11:43:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 Malloc10 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.466 11:43:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 Malloc11 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:18:59.466 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.466 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.466 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.466 11:43:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:18:59.467 11:43:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.467 11:43:19 -- common/autotest_common.sh@10 -- # set +x 00:18:59.467 11:43:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.467 11:43:19 -- target/multiconnection.sh@28 -- # seq 1 11 00:18:59.467 11:43:19 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.467 11:43:19 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:00.398 11:43:20 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:00.399 11:43:20 -- common/autotest_common.sh@1187 -- # local i=0 00:19:00.399 11:43:20 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:00.399 11:43:20 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:00.399 11:43:20 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:02.297 11:43:22 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:02.297 11:43:22 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:02.297 11:43:22 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:02.297 11:43:22 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:02.297 11:43:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:02.297 11:43:22 -- common/autotest_common.sh@1197 -- # return 0 00:19:02.297 11:43:22 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.297 11:43:22 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:02.863 11:43:22 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:02.863 11:43:22 -- common/autotest_common.sh@1187 -- # local i=0 00:19:02.863 11:43:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:02.863 11:43:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:02.863 11:43:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:05.390 11:43:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:05.390 11:43:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:05.390 11:43:24 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:05.390 11:43:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:05.390 11:43:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:05.390 11:43:24 -- common/autotest_common.sh@1197 -- # return 0 00:19:05.390 11:43:24 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:05.390 11:43:24 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:05.648 11:43:25 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:05.648 11:43:25 -- common/autotest_common.sh@1187 -- # local i=0 00:19:05.648 11:43:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:05.648 11:43:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:05.648 11:43:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:07.548 11:43:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:07.548 11:43:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:07.548 11:43:27 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:07.548 11:43:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:07.548 11:43:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:07.548 11:43:27 -- common/autotest_common.sh@1197 -- # return 0 00:19:07.548 11:43:27 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:07.548 11:43:27 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:08.482 11:43:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:08.482 11:43:28 -- common/autotest_common.sh@1187 -- # local i=0 00:19:08.482 11:43:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:08.482 11:43:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:08.482 11:43:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:10.381 11:43:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:10.381 11:43:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:10.381 11:43:30 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:10.381 11:43:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:10.381 11:43:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:10.381 11:43:30 -- common/autotest_common.sh@1197 -- # return 0 00:19:10.381 11:43:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:10.381 11:43:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:11.315 11:43:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:11.315 11:43:31 -- common/autotest_common.sh@1187 -- # local i=0 00:19:11.315 11:43:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:11.315 11:43:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:11.315 11:43:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:13.215 11:43:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:13.215 11:43:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:13.215 11:43:33 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:13.215 11:43:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:13.215 11:43:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:13.215 11:43:33 -- common/autotest_common.sh@1197 -- # return 0 00:19:13.215 11:43:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:13.215 11:43:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:14.150 11:43:34 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:14.150 11:43:34 -- common/autotest_common.sh@1187 -- # local i=0 00:19:14.150 11:43:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:14.150 11:43:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:14.150 11:43:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:16.046 11:43:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:16.046 11:43:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:16.046 11:43:36 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:16.046 11:43:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:16.046 11:43:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:16.046 11:43:36 -- common/autotest_common.sh@1197 -- # return 0 00:19:16.047 11:43:36 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:16.047 11:43:36 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:17.041 11:43:36 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:17.041 11:43:36 -- common/autotest_common.sh@1187 -- # local i=0 00:19:17.041 11:43:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:17.041 11:43:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:17.041 11:43:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:18.942 11:43:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:18.942 11:43:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:18.942 11:43:38 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:18.942 11:43:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:18.942 11:43:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:18.942 11:43:38 -- common/autotest_common.sh@1197 -- # return 0 00:19:18.942 11:43:38 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:18.942 11:43:38 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:19.877 11:43:39 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:19.877 11:43:39 -- common/autotest_common.sh@1187 -- # local i=0 00:19:19.877 11:43:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:19.877 11:43:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:19.877 11:43:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:21.774 11:43:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:21.774 11:43:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:21.774 11:43:41 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:21.774 11:43:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:21.774 11:43:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:21.774 11:43:41 -- common/autotest_common.sh@1197 -- # return 0 00:19:21.774 11:43:41 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:21.774 11:43:41 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:22.709 11:43:42 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:22.709 11:43:42 -- common/autotest_common.sh@1187 -- # local i=0 00:19:22.709 11:43:42 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:22.709 11:43:42 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:22.709 11:43:42 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:24.609 11:43:44 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:24.609 11:43:44 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:24.609 11:43:44 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:19:24.609 11:43:44 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:24.609 11:43:44 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:24.609 11:43:44 -- common/autotest_common.sh@1197 -- # return 0 00:19:24.609 11:43:44 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:24.609 11:43:44 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:25.542 11:43:45 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:25.542 11:43:45 -- common/autotest_common.sh@1187 -- # local i=0 00:19:25.542 11:43:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:25.542 11:43:45 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:25.542 11:43:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:28.071 11:43:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:28.071 11:43:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:28.071 11:43:47 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:19:28.071 11:43:47 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:28.071 11:43:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:28.071 11:43:47 -- common/autotest_common.sh@1197 -- # return 0 00:19:28.071 11:43:47 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:28.071 11:43:47 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:19:28.638 11:43:48 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:19:28.638 11:43:48 -- common/autotest_common.sh@1187 -- # local i=0 00:19:28.638 11:43:48 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:28.638 11:43:48 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:28.638 11:43:48 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:30.537 11:43:50 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:30.537 11:43:50 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:30.537 11:43:50 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:19:30.537 11:43:50 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:30.537 11:43:50 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:30.537 11:43:50 -- common/autotest_common.sh@1197 -- # return 0 00:19:30.537 11:43:50 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:19:30.537 [global] 00:19:30.537 thread=1 00:19:30.537 invalidate=1 00:19:30.537 rw=read 00:19:30.537 time_based=1 00:19:30.537 runtime=10 00:19:30.537 ioengine=libaio 00:19:30.537 direct=1 00:19:30.537 bs=262144 00:19:30.537 iodepth=64 00:19:30.537 norandommap=1 00:19:30.537 numjobs=1 00:19:30.537 00:19:30.537 [job0] 00:19:30.537 filename=/dev/nvme0n1 00:19:30.537 [job1] 00:19:30.537 filename=/dev/nvme10n1 00:19:30.537 [job2] 00:19:30.537 filename=/dev/nvme1n1 00:19:30.537 [job3] 00:19:30.537 filename=/dev/nvme2n1 00:19:30.537 [job4] 00:19:30.537 filename=/dev/nvme3n1 00:19:30.537 [job5] 00:19:30.537 filename=/dev/nvme4n1 00:19:30.537 [job6] 00:19:30.537 filename=/dev/nvme5n1 00:19:30.538 [job7] 00:19:30.538 filename=/dev/nvme6n1 00:19:30.538 [job8] 00:19:30.538 filename=/dev/nvme7n1 00:19:30.538 [job9] 00:19:30.538 filename=/dev/nvme8n1 00:19:30.538 [job10] 00:19:30.538 filename=/dev/nvme9n1 00:19:30.538 Could not set queue depth (nvme0n1) 00:19:30.538 Could not set queue depth (nvme10n1) 00:19:30.538 Could not set queue depth (nvme1n1) 00:19:30.538 Could not set queue depth (nvme2n1) 00:19:30.538 Could not set queue depth (nvme3n1) 00:19:30.538 Could not set queue depth (nvme4n1) 00:19:30.538 Could not set queue depth (nvme5n1) 00:19:30.538 Could not set queue depth (nvme6n1) 00:19:30.538 Could not set queue depth (nvme7n1) 00:19:30.538 Could not set queue depth (nvme8n1) 00:19:30.538 Could not set queue depth (nvme9n1) 00:19:30.822 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.822 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.822 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.822 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.822 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.822 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.822 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.822 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.822 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.822 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.822 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.822 fio-3.35 00:19:30.822 Starting 11 threads 00:19:43.025 00:19:43.025 job0: (groupid=0, jobs=1): err= 0: pid=3847553: Thu Nov 28 11:44:01 2024 00:19:43.025 read: IOPS=542, BW=136MiB/s (142MB/s)(1373MiB/10116msec) 00:19:43.025 slat (usec): min=10, max=84847, avg=1675.35, stdev=5310.77 00:19:43.025 clat (msec): min=4, max=401, avg=116.16, stdev=55.49 00:19:43.025 lat (msec): min=4, max=401, avg=117.84, stdev=56.41 00:19:43.025 clat percentiles (msec): 00:19:43.025 | 1.00th=[ 22], 5.00th=[ 42], 10.00th=[ 48], 20.00th=[ 63], 00:19:43.025 | 30.00th=[ 75], 40.00th=[ 100], 50.00th=[ 122], 60.00th=[ 134], 00:19:43.025 | 70.00th=[ 146], 80.00th=[ 159], 90.00th=[ 178], 95.00th=[ 203], 00:19:43.025 | 99.00th=[ 296], 99.50th=[ 321], 99.90th=[ 363], 99.95th=[ 372], 00:19:43.025 | 99.99th=[ 401] 00:19:43.025 bw ( KiB/s): min=53141, max=269796, per=7.47%, avg=138852.75, stdev=60704.96, samples=20 00:19:43.025 iops : min= 207, max= 1053, avg=542.25, stdev=237.08, samples=20 00:19:43.025 lat (msec) : 10=0.38%, 20=0.40%, 50=11.58%, 100=27.91%, 250=58.12% 00:19:43.025 lat (msec) : 500=1.60% 00:19:43.025 cpu : usr=0.28%, sys=1.87%, ctx=1012, majf=0, minf=4097 00:19:43.025 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:43.025 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.025 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:43.025 issued rwts: total=5490,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.025 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:43.025 job1: (groupid=0, jobs=1): err= 0: pid=3847560: Thu Nov 28 11:44:01 2024 00:19:43.025 read: IOPS=727, BW=182MiB/s (191MB/s)(1821MiB/10020msec) 00:19:43.025 slat (usec): min=9, max=96307, avg=949.07, stdev=4147.06 00:19:43.025 clat (usec): min=1182, max=406588, avg=87021.56, stdev=54295.90 00:19:43.025 lat (usec): min=1201, max=406616, avg=87970.63, stdev=54922.71 00:19:43.025 clat percentiles (msec): 00:19:43.025 | 1.00th=[ 6], 5.00th=[ 16], 10.00th=[ 28], 20.00th=[ 39], 00:19:43.025 | 30.00th=[ 58], 40.00th=[ 70], 50.00th=[ 80], 60.00th=[ 90], 00:19:43.025 | 70.00th=[ 108], 80.00th=[ 125], 90.00th=[ 155], 95.00th=[ 184], 00:19:43.025 | 99.00th=[ 279], 99.50th=[ 321], 99.90th=[ 380], 99.95th=[ 380], 00:19:43.025 | 99.99th=[ 405] 00:19:43.025 bw ( KiB/s): min=48031, max=318464, per=9.94%, avg=184837.65, stdev=72770.16, samples=20 00:19:43.025 iops : min= 187, max= 1244, avg=721.85, stdev=284.32, samples=20 00:19:43.025 lat (msec) : 2=0.22%, 4=0.36%, 10=2.58%, 20=3.29%, 50=19.84% 00:19:43.025 lat (msec) : 100=39.67%, 250=32.61%, 500=1.43% 00:19:43.025 cpu : usr=0.37%, sys=2.18%, ctx=1475, majf=0, minf=4097 00:19:43.025 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:19:43.025 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.025 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:43.025 issued rwts: total=7285,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.025 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:43.025 job2: (groupid=0, jobs=1): err= 0: pid=3847561: Thu Nov 28 11:44:01 2024 00:19:43.025 read: IOPS=930, BW=233MiB/s (244MB/s)(2345MiB/10082msec) 00:19:43.025 slat (usec): min=13, max=87498, avg=993.63, stdev=2999.22 00:19:43.025 clat (usec): min=1561, max=215285, avg=67746.13, stdev=26745.89 00:19:43.025 lat (usec): min=1608, max=251495, avg=68739.76, stdev=27112.44 00:19:43.025 clat percentiles (msec): 00:19:43.025 | 1.00th=[ 18], 5.00th=[ 33], 10.00th=[ 37], 20.00th=[ 48], 00:19:43.025 | 30.00th=[ 55], 40.00th=[ 59], 50.00th=[ 64], 60.00th=[ 70], 00:19:43.025 | 70.00th=[ 77], 80.00th=[ 87], 90.00th=[ 103], 95.00th=[ 115], 00:19:43.025 | 99.00th=[ 169], 99.50th=[ 180], 99.90th=[ 194], 99.95th=[ 199], 00:19:43.025 | 99.99th=[ 215] 00:19:43.025 bw ( KiB/s): min=159232, max=451704, per=12.82%, avg=238378.70, stdev=63366.81, samples=20 00:19:43.025 iops : min= 622, max= 1764, avg=930.95, stdev=247.47, samples=20 00:19:43.025 lat (msec) : 2=0.02%, 4=0.12%, 10=0.47%, 20=0.67%, 50=21.77% 00:19:43.025 lat (msec) : 100=65.98%, 250=10.97% 00:19:43.025 cpu : usr=0.50%, sys=2.95%, ctx=1539, majf=0, minf=4097 00:19:43.025 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:19:43.025 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.025 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:43.025 issued rwts: total=9380,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.025 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:43.025 job3: (groupid=0, jobs=1): err= 0: pid=3847562: Thu Nov 28 11:44:01 2024 00:19:43.025 read: IOPS=614, BW=154MiB/s (161MB/s)(1556MiB/10122msec) 00:19:43.025 slat (usec): min=13, max=174297, avg=1386.13, stdev=5372.25 00:19:43.025 clat (usec): min=1861, max=303736, avg=102597.01, stdev=57600.19 00:19:43.025 lat (usec): min=1910, max=333447, avg=103983.14, stdev=58430.70 00:19:43.025 clat percentiles (msec): 00:19:43.025 | 1.00th=[ 12], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 33], 00:19:43.025 | 30.00th=[ 63], 40.00th=[ 84], 50.00th=[ 100], 60.00th=[ 125], 00:19:43.025 | 70.00th=[ 144], 80.00th=[ 157], 90.00th=[ 174], 95.00th=[ 188], 00:19:43.025 | 99.00th=[ 218], 99.50th=[ 296], 99.90th=[ 305], 99.95th=[ 305], 00:19:43.025 | 99.99th=[ 305] 00:19:43.025 bw ( KiB/s): min=88064, max=503313, per=8.48%, avg=157626.75, stdev=97891.53, samples=20 00:19:43.025 iops : min= 344, max= 1966, avg=615.65, stdev=382.39, samples=20 00:19:43.025 lat (msec) : 2=0.03%, 4=0.24%, 10=0.50%, 20=1.08%, 50=23.47% 00:19:43.025 lat (msec) : 100=25.41%, 250=48.47%, 500=0.80% 00:19:43.025 cpu : usr=0.36%, sys=2.06%, ctx=1238, majf=0, minf=3721 00:19:43.025 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:43.025 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.025 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:43.025 issued rwts: total=6225,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.025 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:43.025 job4: (groupid=0, jobs=1): err= 0: pid=3847563: Thu Nov 28 11:44:01 2024 00:19:43.025 read: IOPS=683, BW=171MiB/s (179MB/s)(1722MiB/10083msec) 00:19:43.025 slat (usec): min=13, max=106522, avg=1269.56, stdev=4827.83 00:19:43.025 clat (usec): min=1835, max=435192, avg=92333.30, stdev=57838.42 00:19:43.025 lat (usec): min=1855, max=435240, avg=93602.85, stdev=58701.84 00:19:43.025 clat percentiles (msec): 00:19:43.025 | 1.00th=[ 7], 5.00th=[ 14], 10.00th=[ 28], 20.00th=[ 34], 00:19:43.025 | 30.00th=[ 60], 40.00th=[ 71], 50.00th=[ 84], 60.00th=[ 101], 00:19:43.025 | 70.00th=[ 117], 80.00th=[ 144], 90.00th=[ 163], 95.00th=[ 180], 00:19:43.025 | 99.00th=[ 284], 99.50th=[ 326], 99.90th=[ 355], 99.95th=[ 355], 00:19:43.025 | 99.99th=[ 435] 00:19:43.026 bw ( KiB/s): min=51608, max=466432, per=9.39%, avg=174642.55, stdev=96465.79, samples=20 00:19:43.026 iops : min= 201, max= 1822, avg=682.10, stdev=376.89, samples=20 00:19:43.026 lat (msec) : 2=0.07%, 4=0.36%, 10=2.12%, 20=4.57%, 50=18.73% 00:19:43.026 lat (msec) : 100=33.83%, 250=38.85%, 500=1.47% 00:19:43.026 cpu : usr=0.40%, sys=2.22%, ctx=1275, majf=0, minf=4097 00:19:43.026 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:43.026 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.026 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:43.026 issued rwts: total=6888,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.026 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:43.026 job5: (groupid=0, jobs=1): err= 0: pid=3847564: Thu Nov 28 11:44:01 2024 00:19:43.026 read: IOPS=480, BW=120MiB/s (126MB/s)(1215MiB/10118msec) 00:19:43.026 slat (usec): min=14, max=87713, avg=1759.86, stdev=5711.95 00:19:43.026 clat (msec): min=5, max=419, avg=131.42, stdev=48.05 00:19:43.026 lat (msec): min=5, max=419, avg=133.18, stdev=48.90 00:19:43.026 clat percentiles (msec): 00:19:43.026 | 1.00th=[ 20], 5.00th=[ 74], 10.00th=[ 85], 20.00th=[ 95], 00:19:43.026 | 30.00th=[ 103], 40.00th=[ 112], 50.00th=[ 123], 60.00th=[ 138], 00:19:43.026 | 70.00th=[ 153], 80.00th=[ 169], 90.00th=[ 188], 95.00th=[ 205], 00:19:43.026 | 99.00th=[ 300], 99.50th=[ 338], 99.90th=[ 372], 99.95th=[ 393], 00:19:43.026 | 99.99th=[ 422] 00:19:43.026 bw ( KiB/s): min=49053, max=167936, per=6.60%, avg=122686.10, stdev=30694.09, samples=20 00:19:43.026 iops : min= 191, max= 656, avg=479.10, stdev=119.94, samples=20 00:19:43.026 lat (msec) : 10=0.31%, 20=0.74%, 50=1.21%, 100=25.17%, 250=70.52% 00:19:43.026 lat (msec) : 500=2.04% 00:19:43.026 cpu : usr=0.33%, sys=1.67%, ctx=951, majf=0, minf=4097 00:19:43.026 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:43.026 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.026 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:43.026 issued rwts: total=4858,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.026 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:43.026 job6: (groupid=0, jobs=1): err= 0: pid=3847565: Thu Nov 28 11:44:01 2024 00:19:43.026 read: IOPS=572, BW=143MiB/s (150MB/s)(1449MiB/10126msec) 00:19:43.026 slat (usec): min=9, max=216108, avg=1127.46, stdev=5927.11 00:19:43.026 clat (usec): min=799, max=478638, avg=110632.46, stdev=65000.38 00:19:43.026 lat (usec): min=822, max=478669, avg=111759.92, stdev=66050.56 00:19:43.026 clat percentiles (msec): 00:19:43.026 | 1.00th=[ 4], 5.00th=[ 16], 10.00th=[ 31], 20.00th=[ 51], 00:19:43.026 | 30.00th=[ 66], 40.00th=[ 80], 50.00th=[ 113], 60.00th=[ 133], 00:19:43.026 | 70.00th=[ 153], 80.00th=[ 165], 90.00th=[ 184], 95.00th=[ 201], 00:19:43.026 | 99.00th=[ 330], 99.50th=[ 384], 99.90th=[ 397], 99.95th=[ 414], 00:19:43.026 | 99.99th=[ 481] 00:19:43.026 bw ( KiB/s): min=53652, max=300966, per=7.89%, avg=146586.75, stdev=67950.08, samples=20 00:19:43.026 iops : min= 209, max= 1175, avg=572.40, stdev=265.38, samples=20 00:19:43.026 lat (usec) : 1000=0.26% 00:19:43.026 lat (msec) : 2=0.45%, 4=0.64%, 10=2.24%, 20=2.45%, 50=13.84% 00:19:43.026 lat (msec) : 100=25.80%, 250=52.35%, 500=1.97% 00:19:43.026 cpu : usr=0.29%, sys=1.69%, ctx=1354, majf=0, minf=4097 00:19:43.026 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:43.026 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.026 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:43.026 issued rwts: total=5794,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.026 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:43.026 job7: (groupid=0, jobs=1): err= 0: pid=3847566: Thu Nov 28 11:44:01 2024 00:19:43.026 read: IOPS=674, BW=169MiB/s (177MB/s)(1707MiB/10125msec) 00:19:43.026 slat (usec): min=8, max=155636, avg=1068.93, stdev=4952.43 00:19:43.026 clat (usec): min=1532, max=386987, avg=93777.82, stdev=65933.81 00:19:43.026 lat (usec): min=1551, max=525633, avg=94846.75, stdev=66849.68 00:19:43.026 clat percentiles (msec): 00:19:43.026 | 1.00th=[ 4], 5.00th=[ 10], 10.00th=[ 20], 20.00th=[ 29], 00:19:43.026 | 30.00th=[ 33], 40.00th=[ 54], 50.00th=[ 88], 60.00th=[ 126], 00:19:43.026 | 70.00th=[ 142], 80.00th=[ 159], 90.00th=[ 174], 95.00th=[ 194], 00:19:43.026 | 99.00th=[ 234], 99.50th=[ 292], 99.90th=[ 380], 99.95th=[ 380], 00:19:43.026 | 99.99th=[ 388] 00:19:43.026 bw ( KiB/s): min=78848, max=441485, per=9.30%, avg=172971.75, stdev=107040.22, samples=20 00:19:43.026 iops : min= 308, max= 1724, avg=675.50, stdev=417.96, samples=20 00:19:43.026 lat (msec) : 2=0.04%, 4=1.41%, 10=3.79%, 20=4.95%, 50=28.94% 00:19:43.026 lat (msec) : 100=12.89%, 250=47.14%, 500=0.83% 00:19:43.026 cpu : usr=0.31%, sys=2.05%, ctx=1496, majf=0, minf=4097 00:19:43.026 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:43.026 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.026 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:43.026 issued rwts: total=6827,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.026 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:43.026 job8: (groupid=0, jobs=1): err= 0: pid=3847567: Thu Nov 28 11:44:01 2024 00:19:43.026 read: IOPS=860, BW=215MiB/s (226MB/s)(2171MiB/10087msec) 00:19:43.026 slat (usec): min=9, max=75574, avg=1087.74, stdev=3330.75 00:19:43.026 clat (msec): min=2, max=206, avg=73.22, stdev=26.79 00:19:43.026 lat (msec): min=2, max=206, avg=74.31, stdev=27.20 00:19:43.026 clat percentiles (msec): 00:19:43.026 | 1.00th=[ 11], 5.00th=[ 28], 10.00th=[ 35], 20.00th=[ 57], 00:19:43.026 | 30.00th=[ 63], 40.00th=[ 67], 50.00th=[ 71], 60.00th=[ 77], 00:19:43.026 | 70.00th=[ 84], 80.00th=[ 95], 90.00th=[ 110], 95.00th=[ 121], 00:19:43.026 | 99.00th=[ 138], 99.50th=[ 144], 99.90th=[ 186], 99.95th=[ 186], 00:19:43.026 | 99.99th=[ 207] 00:19:43.026 bw ( KiB/s): min=135920, max=368128, per=11.86%, avg=220518.95, stdev=54424.78, samples=20 00:19:43.026 iops : min= 530, max= 1438, avg=861.15, stdev=212.62, samples=20 00:19:43.026 lat (msec) : 4=0.28%, 10=0.51%, 20=2.65%, 50=11.02%, 100=69.49% 00:19:43.026 lat (msec) : 250=16.06% 00:19:43.026 cpu : usr=0.58%, sys=2.67%, ctx=1518, majf=0, minf=4098 00:19:43.026 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:43.026 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.026 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:43.026 issued rwts: total=8682,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.026 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:43.026 job9: (groupid=0, jobs=1): err= 0: pid=3847568: Thu Nov 28 11:44:01 2024 00:19:43.026 read: IOPS=556, BW=139MiB/s (146MB/s)(1395MiB/10023msec) 00:19:43.026 slat (usec): min=12, max=96903, avg=1367.45, stdev=5330.90 00:19:43.026 clat (msec): min=3, max=367, avg=113.52, stdev=60.07 00:19:43.026 lat (msec): min=3, max=424, avg=114.89, stdev=60.97 00:19:43.026 clat percentiles (msec): 00:19:43.026 | 1.00th=[ 11], 5.00th=[ 30], 10.00th=[ 37], 20.00th=[ 58], 00:19:43.026 | 30.00th=[ 77], 40.00th=[ 90], 50.00th=[ 108], 60.00th=[ 136], 00:19:43.026 | 70.00th=[ 148], 80.00th=[ 161], 90.00th=[ 186], 95.00th=[ 207], 00:19:43.026 | 99.00th=[ 305], 99.50th=[ 321], 99.90th=[ 359], 99.95th=[ 363], 00:19:43.026 | 99.99th=[ 368] 00:19:43.026 bw ( KiB/s): min=57229, max=232448, per=7.59%, avg=141162.50, stdev=51334.56, samples=20 00:19:43.026 iops : min= 223, max= 908, avg=551.25, stdev=200.57, samples=20 00:19:43.026 lat (msec) : 4=0.13%, 10=0.77%, 20=1.88%, 50=13.69%, 100=29.44% 00:19:43.026 lat (msec) : 250=52.13%, 500=1.95% 00:19:43.026 cpu : usr=0.42%, sys=1.85%, ctx=1134, majf=0, minf=4097 00:19:43.026 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:43.026 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.026 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:43.026 issued rwts: total=5580,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.026 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:43.026 job10: (groupid=0, jobs=1): err= 0: pid=3847569: Thu Nov 28 11:44:01 2024 00:19:43.026 read: IOPS=644, BW=161MiB/s (169MB/s)(1630MiB/10123msec) 00:19:43.026 slat (usec): min=9, max=311800, avg=1144.16, stdev=6089.07 00:19:43.026 clat (usec): min=1119, max=377877, avg=98129.30, stdev=66890.87 00:19:43.026 lat (usec): min=1158, max=561567, avg=99273.45, stdev=67778.06 00:19:43.026 clat percentiles (msec): 00:19:43.026 | 1.00th=[ 6], 5.00th=[ 20], 10.00th=[ 27], 20.00th=[ 31], 00:19:43.026 | 30.00th=[ 48], 40.00th=[ 69], 50.00th=[ 80], 60.00th=[ 108], 00:19:43.026 | 70.00th=[ 144], 80.00th=[ 163], 90.00th=[ 186], 95.00th=[ 205], 00:19:43.026 | 99.00th=[ 264], 99.50th=[ 351], 99.90th=[ 380], 99.95th=[ 380], 00:19:43.026 | 99.99th=[ 380] 00:19:43.026 bw ( KiB/s): min=60537, max=496670, per=8.89%, avg=165209.75, stdev=105507.53, samples=20 00:19:43.026 iops : min= 236, max= 1940, avg=645.25, stdev=412.16, samples=20 00:19:43.026 lat (msec) : 2=0.08%, 4=0.26%, 10=2.12%, 20=2.62%, 50=25.78% 00:19:43.026 lat (msec) : 100=27.88%, 250=39.78%, 500=1.49% 00:19:43.026 cpu : usr=0.32%, sys=2.12%, ctx=1376, majf=0, minf=4097 00:19:43.026 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:19:43.026 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.026 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:43.026 issued rwts: total=6521,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.026 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:43.026 00:19:43.026 Run status group 0 (all jobs): 00:19:43.026 READ: bw=1815MiB/s (1904MB/s), 120MiB/s-233MiB/s (126MB/s-244MB/s), io=18.0GiB (19.3GB), run=10020-10126msec 00:19:43.026 00:19:43.026 Disk stats (read/write): 00:19:43.026 nvme0n1: ios=10800/0, merge=0/0, ticks=1231578/0, in_queue=1231578, util=97.39% 00:19:43.026 nvme10n1: ios=14339/0, merge=0/0, ticks=1242102/0, in_queue=1242102, util=97.58% 00:19:43.026 nvme1n1: ios=18593/0, merge=0/0, ticks=1239175/0, in_queue=1239175, util=97.84% 00:19:43.026 nvme2n1: ios=12286/0, merge=0/0, ticks=1235399/0, in_queue=1235399, util=97.98% 00:19:43.026 nvme3n1: ios=13578/0, merge=0/0, ticks=1233956/0, in_queue=1233956, util=98.06% 00:19:43.026 nvme4n1: ios=9549/0, merge=0/0, ticks=1233139/0, in_queue=1233139, util=98.35% 00:19:43.026 nvme5n1: ios=11419/0, merge=0/0, ticks=1239500/0, in_queue=1239500, util=98.51% 00:19:43.026 nvme6n1: ios=13487/0, merge=0/0, ticks=1236693/0, in_queue=1236693, util=98.60% 00:19:43.026 nvme7n1: ios=17198/0, merge=0/0, ticks=1239112/0, in_queue=1239112, util=98.99% 00:19:43.027 nvme8n1: ios=10929/0, merge=0/0, ticks=1238315/0, in_queue=1238315, util=99.14% 00:19:43.027 nvme9n1: ios=12893/0, merge=0/0, ticks=1237965/0, in_queue=1237965, util=99.23% 00:19:43.027 11:44:01 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:19:43.027 [global] 00:19:43.027 thread=1 00:19:43.027 invalidate=1 00:19:43.027 rw=randwrite 00:19:43.027 time_based=1 00:19:43.027 runtime=10 00:19:43.027 ioengine=libaio 00:19:43.027 direct=1 00:19:43.027 bs=262144 00:19:43.027 iodepth=64 00:19:43.027 norandommap=1 00:19:43.027 numjobs=1 00:19:43.027 00:19:43.027 [job0] 00:19:43.027 filename=/dev/nvme0n1 00:19:43.027 [job1] 00:19:43.027 filename=/dev/nvme10n1 00:19:43.027 [job2] 00:19:43.027 filename=/dev/nvme1n1 00:19:43.027 [job3] 00:19:43.027 filename=/dev/nvme2n1 00:19:43.027 [job4] 00:19:43.027 filename=/dev/nvme3n1 00:19:43.027 [job5] 00:19:43.027 filename=/dev/nvme4n1 00:19:43.027 [job6] 00:19:43.027 filename=/dev/nvme5n1 00:19:43.027 [job7] 00:19:43.027 filename=/dev/nvme6n1 00:19:43.027 [job8] 00:19:43.027 filename=/dev/nvme7n1 00:19:43.027 [job9] 00:19:43.027 filename=/dev/nvme8n1 00:19:43.027 [job10] 00:19:43.027 filename=/dev/nvme9n1 00:19:43.027 Could not set queue depth (nvme0n1) 00:19:43.027 Could not set queue depth (nvme10n1) 00:19:43.027 Could not set queue depth (nvme1n1) 00:19:43.027 Could not set queue depth (nvme2n1) 00:19:43.027 Could not set queue depth (nvme3n1) 00:19:43.027 Could not set queue depth (nvme4n1) 00:19:43.027 Could not set queue depth (nvme5n1) 00:19:43.027 Could not set queue depth (nvme6n1) 00:19:43.027 Could not set queue depth (nvme7n1) 00:19:43.027 Could not set queue depth (nvme8n1) 00:19:43.027 Could not set queue depth (nvme9n1) 00:19:43.027 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:43.027 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:43.027 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:43.027 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:43.027 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:43.027 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:43.027 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:43.027 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:43.027 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:43.027 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:43.027 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:43.027 fio-3.35 00:19:43.027 Starting 11 threads 00:19:52.998 00:19:52.998 job0: (groupid=0, jobs=1): err= 0: pid=3848619: Thu Nov 28 11:44:12 2024 00:19:52.998 write: IOPS=375, BW=93.8MiB/s (98.4MB/s)(951MiB/10136msec); 0 zone resets 00:19:52.998 slat (usec): min=16, max=108454, avg=2070.99, stdev=5476.26 00:19:52.998 clat (usec): min=896, max=315636, avg=168269.78, stdev=69401.63 00:19:52.998 lat (usec): min=920, max=318301, avg=170340.77, stdev=70399.60 00:19:52.998 clat percentiles (msec): 00:19:52.998 | 1.00th=[ 10], 5.00th=[ 32], 10.00th=[ 57], 20.00th=[ 108], 00:19:52.998 | 30.00th=[ 150], 40.00th=[ 165], 50.00th=[ 178], 60.00th=[ 192], 00:19:52.998 | 70.00th=[ 209], 80.00th=[ 230], 90.00th=[ 251], 95.00th=[ 266], 00:19:52.998 | 99.00th=[ 292], 99.50th=[ 296], 99.90th=[ 309], 99.95th=[ 317], 00:19:52.998 | 99.99th=[ 317] 00:19:52.998 bw ( KiB/s): min=60928, max=207360, per=6.78%, avg=95773.15, stdev=32934.10, samples=20 00:19:52.998 iops : min= 238, max= 810, avg=374.10, stdev=128.64, samples=20 00:19:52.998 lat (usec) : 1000=0.08% 00:19:52.998 lat (msec) : 2=0.18%, 4=0.24%, 10=0.60%, 20=1.94%, 50=5.68% 00:19:52.998 lat (msec) : 100=9.20%, 250=71.98%, 500=10.09% 00:19:52.998 cpu : usr=1.13%, sys=1.53%, ctx=1860, majf=0, minf=1 00:19:52.998 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.3% 00:19:52.999 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.999 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.999 issued rwts: total=0,3805,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.999 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.999 job1: (groupid=0, jobs=1): err= 0: pid=3848623: Thu Nov 28 11:44:12 2024 00:19:52.999 write: IOPS=546, BW=137MiB/s (143MB/s)(1381MiB/10103msec); 0 zone resets 00:19:52.999 slat (usec): min=16, max=77956, avg=1299.10, stdev=3810.75 00:19:52.999 clat (usec): min=1147, max=320428, avg=115665.00, stdev=74218.06 00:19:52.999 lat (usec): min=1200, max=320481, avg=116964.10, stdev=75183.73 00:19:52.999 clat percentiles (msec): 00:19:52.999 | 1.00th=[ 7], 5.00th=[ 19], 10.00th=[ 30], 20.00th=[ 45], 00:19:52.999 | 30.00th=[ 61], 40.00th=[ 72], 50.00th=[ 96], 60.00th=[ 142], 00:19:52.999 | 70.00th=[ 176], 80.00th=[ 197], 90.00th=[ 213], 95.00th=[ 230], 00:19:52.999 | 99.00th=[ 292], 99.50th=[ 305], 99.90th=[ 321], 99.95th=[ 321], 00:19:52.999 | 99.99th=[ 321] 00:19:52.999 bw ( KiB/s): min=69632, max=357376, per=9.90%, avg=139787.60, stdev=78799.61, samples=20 00:19:52.999 iops : min= 272, max= 1396, avg=546.00, stdev=307.81, samples=20 00:19:52.999 lat (msec) : 2=0.07%, 4=0.33%, 10=1.48%, 20=3.62%, 50=21.74% 00:19:52.999 lat (msec) : 100=24.43%, 250=45.47%, 500=2.86% 00:19:52.999 cpu : usr=1.70%, sys=1.89%, ctx=2981, majf=0, minf=1 00:19:52.999 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:52.999 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.999 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.999 issued rwts: total=0,5525,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.999 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.999 job2: (groupid=0, jobs=1): err= 0: pid=3848632: Thu Nov 28 11:44:12 2024 00:19:52.999 write: IOPS=649, BW=162MiB/s (170MB/s)(1641MiB/10104msec); 0 zone resets 00:19:52.999 slat (usec): min=20, max=47269, avg=1212.24, stdev=3232.12 00:19:52.999 clat (msec): min=2, max=282, avg=97.24, stdev=68.54 00:19:52.999 lat (msec): min=2, max=282, avg=98.45, stdev=69.38 00:19:52.999 clat percentiles (msec): 00:19:52.999 | 1.00th=[ 10], 5.00th=[ 23], 10.00th=[ 42], 20.00th=[ 43], 00:19:52.999 | 30.00th=[ 44], 40.00th=[ 48], 50.00th=[ 75], 60.00th=[ 90], 00:19:52.999 | 70.00th=[ 124], 80.00th=[ 171], 90.00th=[ 207], 95.00th=[ 232], 00:19:52.999 | 99.00th=[ 266], 99.50th=[ 271], 99.90th=[ 284], 99.95th=[ 284], 00:19:52.999 | 99.99th=[ 284] 00:19:52.999 bw ( KiB/s): min=72704, max=370688, per=11.78%, avg=166419.60, stdev=95908.77, samples=20 00:19:52.999 iops : min= 284, max= 1448, avg=650.00, stdev=374.65, samples=20 00:19:52.999 lat (msec) : 4=0.08%, 10=0.96%, 20=3.35%, 50=37.46%, 100=21.61% 00:19:52.999 lat (msec) : 250=33.86%, 500=2.68% 00:19:52.999 cpu : usr=1.95%, sys=2.59%, ctx=2693, majf=0, minf=1 00:19:52.999 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:19:52.999 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.999 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.999 issued rwts: total=0,6565,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.999 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.999 job3: (groupid=0, jobs=1): err= 0: pid=3848633: Thu Nov 28 11:44:12 2024 00:19:52.999 write: IOPS=591, BW=148MiB/s (155MB/s)(1497MiB/10128msec); 0 zone resets 00:19:52.999 slat (usec): min=16, max=49176, avg=1127.78, stdev=3091.63 00:19:52.999 clat (usec): min=821, max=266974, avg=107080.25, stdev=63786.10 00:19:52.999 lat (usec): min=847, max=267026, avg=108208.03, stdev=64506.01 00:19:52.999 clat percentiles (msec): 00:19:52.999 | 1.00th=[ 5], 5.00th=[ 16], 10.00th=[ 28], 20.00th=[ 50], 00:19:52.999 | 30.00th=[ 56], 40.00th=[ 84], 50.00th=[ 99], 60.00th=[ 118], 00:19:52.999 | 70.00th=[ 146], 80.00th=[ 163], 90.00th=[ 197], 95.00th=[ 234], 00:19:52.999 | 99.00th=[ 249], 99.50th=[ 253], 99.90th=[ 266], 99.95th=[ 266], 00:19:52.999 | 99.99th=[ 268] 00:19:52.999 bw ( KiB/s): min=67584, max=289724, per=10.73%, avg=151629.50, stdev=65383.25, samples=20 00:19:52.999 iops : min= 264, max= 1131, avg=592.20, stdev=255.30, samples=20 00:19:52.999 lat (usec) : 1000=0.02% 00:19:52.999 lat (msec) : 2=0.28%, 4=0.60%, 10=2.61%, 20=2.99%, 50=13.80% 00:19:52.999 lat (msec) : 100=30.60%, 250=48.35%, 500=0.75% 00:19:52.999 cpu : usr=1.70%, sys=1.96%, ctx=3277, majf=0, minf=1 00:19:52.999 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:19:52.999 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.999 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.999 issued rwts: total=0,5987,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.999 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.999 job4: (groupid=0, jobs=1): err= 0: pid=3848634: Thu Nov 28 11:44:12 2024 00:19:52.999 write: IOPS=351, BW=87.8MiB/s (92.0MB/s)(892MiB/10162msec); 0 zone resets 00:19:52.999 slat (usec): min=19, max=81022, avg=2240.87, stdev=5688.12 00:19:52.999 clat (usec): min=1597, max=438139, avg=179937.87, stdev=79382.67 00:19:52.999 lat (msec): min=2, max=438, avg=182.18, stdev=80.58 00:19:52.999 clat percentiles (msec): 00:19:52.999 | 1.00th=[ 7], 5.00th=[ 27], 10.00th=[ 51], 20.00th=[ 114], 00:19:52.999 | 30.00th=[ 163], 40.00th=[ 180], 50.00th=[ 190], 60.00th=[ 203], 00:19:52.999 | 70.00th=[ 220], 80.00th=[ 236], 90.00th=[ 271], 95.00th=[ 300], 00:19:52.999 | 99.00th=[ 355], 99.50th=[ 363], 99.90th=[ 418], 99.95th=[ 439], 00:19:52.999 | 99.99th=[ 439] 00:19:52.999 bw ( KiB/s): min=49152, max=157696, per=6.35%, avg=89680.15, stdev=30716.08, samples=20 00:19:52.999 iops : min= 192, max= 616, avg=350.25, stdev=120.03, samples=20 00:19:52.999 lat (msec) : 2=0.03%, 4=0.25%, 10=1.46%, 20=2.10%, 50=6.05% 00:19:52.999 lat (msec) : 100=8.18%, 250=65.92%, 500=16.00% 00:19:52.999 cpu : usr=1.24%, sys=1.18%, ctx=1794, majf=0, minf=1 00:19:52.999 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.2% 00:19:52.999 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.999 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.999 issued rwts: total=0,3568,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.999 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.999 job5: (groupid=0, jobs=1): err= 0: pid=3848662: Thu Nov 28 11:44:12 2024 00:19:52.999 write: IOPS=502, BW=126MiB/s (132MB/s)(1268MiB/10097msec); 0 zone resets 00:19:52.999 slat (usec): min=16, max=68195, avg=1319.52, stdev=3936.42 00:19:52.999 clat (usec): min=1624, max=287662, avg=126006.94, stdev=68644.04 00:19:52.999 lat (usec): min=1663, max=287716, avg=127326.47, stdev=69487.30 00:19:52.999 clat percentiles (msec): 00:19:52.999 | 1.00th=[ 4], 5.00th=[ 18], 10.00th=[ 28], 20.00th=[ 47], 00:19:52.999 | 30.00th=[ 83], 40.00th=[ 110], 50.00th=[ 133], 60.00th=[ 153], 00:19:52.999 | 70.00th=[ 176], 80.00th=[ 194], 90.00th=[ 213], 95.00th=[ 224], 00:19:52.999 | 99.00th=[ 262], 99.50th=[ 266], 99.90th=[ 279], 99.95th=[ 279], 00:19:52.999 | 99.99th=[ 288] 00:19:52.999 bw ( KiB/s): min=63488, max=261120, per=9.08%, avg=128229.50, stdev=46354.30, samples=20 00:19:52.999 iops : min= 248, max= 1020, avg=500.80, stdev=181.06, samples=20 00:19:52.999 lat (msec) : 2=0.06%, 4=0.99%, 10=1.06%, 20=3.94%, 50=15.18% 00:19:52.999 lat (msec) : 100=13.80%, 250=63.36%, 500=1.62% 00:19:52.999 cpu : usr=1.57%, sys=1.65%, ctx=3010, majf=0, minf=1 00:19:52.999 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:52.999 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.000 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:53.000 issued rwts: total=0,5073,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.000 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:53.000 job6: (groupid=0, jobs=1): err= 0: pid=3848675: Thu Nov 28 11:44:12 2024 00:19:53.000 write: IOPS=397, BW=99.4MiB/s (104MB/s)(1006MiB/10121msec); 0 zone resets 00:19:53.000 slat (usec): min=22, max=59325, avg=2189.76, stdev=4794.64 00:19:53.000 clat (msec): min=2, max=429, avg=158.67, stdev=61.71 00:19:53.000 lat (msec): min=2, max=429, avg=160.86, stdev=62.42 00:19:53.000 clat percentiles (msec): 00:19:53.000 | 1.00th=[ 8], 5.00th=[ 33], 10.00th=[ 77], 20.00th=[ 120], 00:19:53.000 | 30.00th=[ 144], 40.00th=[ 155], 50.00th=[ 161], 60.00th=[ 171], 00:19:53.000 | 70.00th=[ 184], 80.00th=[ 197], 90.00th=[ 226], 95.00th=[ 259], 00:19:53.000 | 99.00th=[ 321], 99.50th=[ 342], 99.90th=[ 409], 99.95th=[ 409], 00:19:53.000 | 99.99th=[ 430] 00:19:53.000 bw ( KiB/s): min=55296, max=138752, per=7.18%, avg=101409.05, stdev=21202.62, samples=20 00:19:53.000 iops : min= 216, max= 542, avg=396.10, stdev=82.85, samples=20 00:19:53.000 lat (msec) : 4=0.12%, 10=1.29%, 20=1.76%, 50=3.68%, 100=8.05% 00:19:53.000 lat (msec) : 250=79.85%, 500=5.24% 00:19:53.000 cpu : usr=1.21%, sys=1.49%, ctx=1567, majf=0, minf=1 00:19:53.000 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:19:53.000 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.000 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:53.000 issued rwts: total=0,4025,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.000 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:53.000 job7: (groupid=0, jobs=1): err= 0: pid=3848685: Thu Nov 28 11:44:12 2024 00:19:53.000 write: IOPS=389, BW=97.3MiB/s (102MB/s)(986MiB/10135msec); 0 zone resets 00:19:53.000 slat (usec): min=16, max=42805, avg=2207.31, stdev=4765.22 00:19:53.000 clat (msec): min=3, max=314, avg=162.17, stdev=58.60 00:19:53.000 lat (msec): min=3, max=314, avg=164.37, stdev=59.45 00:19:53.000 clat percentiles (msec): 00:19:53.000 | 1.00th=[ 8], 5.00th=[ 50], 10.00th=[ 74], 20.00th=[ 111], 00:19:53.000 | 30.00th=[ 138], 40.00th=[ 161], 50.00th=[ 176], 60.00th=[ 186], 00:19:53.000 | 70.00th=[ 199], 80.00th=[ 209], 90.00th=[ 226], 95.00th=[ 243], 00:19:53.000 | 99.00th=[ 271], 99.50th=[ 279], 99.90th=[ 305], 99.95th=[ 313], 00:19:53.000 | 99.99th=[ 313] 00:19:53.000 bw ( KiB/s): min=65536, max=182930, per=7.03%, avg=99334.10, stdev=25541.17, samples=20 00:19:53.000 iops : min= 256, max= 714, avg=387.95, stdev=99.67, samples=20 00:19:53.000 lat (msec) : 4=0.03%, 10=1.80%, 20=0.91%, 50=2.36%, 100=10.22% 00:19:53.000 lat (msec) : 250=81.69%, 500=2.99% 00:19:53.000 cpu : usr=1.30%, sys=1.31%, ctx=1591, majf=0, minf=1 00:19:53.000 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:19:53.000 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.000 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:53.000 issued rwts: total=0,3944,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.000 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:53.000 job8: (groupid=0, jobs=1): err= 0: pid=3848738: Thu Nov 28 11:44:12 2024 00:19:53.000 write: IOPS=535, BW=134MiB/s (140MB/s)(1360MiB/10163msec); 0 zone resets 00:19:53.000 slat (usec): min=23, max=36171, avg=1482.08, stdev=3791.98 00:19:53.000 clat (msec): min=3, max=450, avg=117.98, stdev=75.66 00:19:53.000 lat (msec): min=3, max=450, avg=119.46, stdev=76.68 00:19:53.000 clat percentiles (msec): 00:19:53.000 | 1.00th=[ 11], 5.00th=[ 33], 10.00th=[ 42], 20.00th=[ 47], 00:19:53.000 | 30.00th=[ 62], 40.00th=[ 84], 50.00th=[ 101], 60.00th=[ 124], 00:19:53.000 | 70.00th=[ 150], 80.00th=[ 180], 90.00th=[ 232], 95.00th=[ 255], 00:19:53.000 | 99.00th=[ 334], 99.50th=[ 347], 99.90th=[ 430], 99.95th=[ 430], 00:19:53.000 | 99.99th=[ 451] 00:19:53.000 bw ( KiB/s): min=51097, max=282624, per=9.74%, avg=137608.85, stdev=75708.86, samples=20 00:19:53.000 iops : min= 199, max= 1104, avg=537.45, stdev=295.69, samples=20 00:19:53.000 lat (msec) : 4=0.04%, 10=0.83%, 20=1.76%, 50=22.00%, 100=25.12% 00:19:53.000 lat (msec) : 250=44.75%, 500=5.50% 00:19:53.000 cpu : usr=1.98%, sys=1.76%, ctx=2237, majf=0, minf=1 00:19:53.000 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:53.000 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.000 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:53.000 issued rwts: total=0,5441,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.000 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:53.000 job9: (groupid=0, jobs=1): err= 0: pid=3848767: Thu Nov 28 11:44:12 2024 00:19:53.000 write: IOPS=638, BW=160MiB/s (167MB/s)(1621MiB/10161msec); 0 zone resets 00:19:53.000 slat (usec): min=17, max=32613, avg=1129.81, stdev=3319.25 00:19:53.000 clat (usec): min=1151, max=441552, avg=99091.10, stdev=79042.58 00:19:53.000 lat (usec): min=1235, max=441582, avg=100220.91, stdev=80089.00 00:19:53.000 clat percentiles (msec): 00:19:53.000 | 1.00th=[ 7], 5.00th=[ 18], 10.00th=[ 33], 20.00th=[ 43], 00:19:53.000 | 30.00th=[ 45], 40.00th=[ 51], 50.00th=[ 73], 60.00th=[ 86], 00:19:53.000 | 70.00th=[ 112], 80.00th=[ 161], 90.00th=[ 232], 95.00th=[ 262], 00:19:53.000 | 99.00th=[ 338], 99.50th=[ 355], 99.90th=[ 405], 99.95th=[ 422], 00:19:53.000 | 99.99th=[ 443] 00:19:53.000 bw ( KiB/s): min=49152, max=361984, per=11.63%, avg=164359.40, stdev=101086.25, samples=20 00:19:53.000 iops : min= 192, max= 1414, avg=641.95, stdev=394.92, samples=20 00:19:53.000 lat (msec) : 2=0.05%, 4=0.35%, 10=1.46%, 20=4.13%, 50=33.72% 00:19:53.000 lat (msec) : 100=26.35%, 250=28.33%, 500=5.60% 00:19:53.000 cpu : usr=1.89%, sys=1.96%, ctx=3262, majf=0, minf=1 00:19:53.000 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:19:53.000 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.000 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:53.000 issued rwts: total=0,6485,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.000 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:53.000 job10: (groupid=0, jobs=1): err= 0: pid=3848784: Thu Nov 28 11:44:12 2024 00:19:53.000 write: IOPS=560, BW=140MiB/s (147MB/s)(1416MiB/10098msec); 0 zone resets 00:19:53.000 slat (usec): min=17, max=58418, avg=1110.14, stdev=3487.80 00:19:53.000 clat (usec): min=1506, max=361728, avg=112961.82, stdev=82067.49 00:19:53.000 lat (usec): min=1544, max=361812, avg=114071.96, stdev=83013.16 00:19:53.000 clat percentiles (msec): 00:19:53.000 | 1.00th=[ 7], 5.00th=[ 16], 10.00th=[ 28], 20.00th=[ 47], 00:19:53.000 | 30.00th=[ 50], 40.00th=[ 73], 50.00th=[ 88], 60.00th=[ 108], 00:19:53.000 | 70.00th=[ 146], 80.00th=[ 199], 90.00th=[ 236], 95.00th=[ 262], 00:19:53.000 | 99.00th=[ 334], 99.50th=[ 347], 99.90th=[ 363], 99.95th=[ 363], 00:19:53.000 | 99.99th=[ 363] 00:19:53.000 bw ( KiB/s): min=49152, max=360448, per=10.15%, avg=143339.50, stdev=82261.03, samples=20 00:19:53.000 iops : min= 192, max= 1408, avg=559.85, stdev=321.36, samples=20 00:19:53.000 lat (msec) : 2=0.04%, 4=0.26%, 10=2.54%, 20=4.45%, 50=24.58% 00:19:53.000 lat (msec) : 100=25.57%, 250=36.15%, 500=6.41% 00:19:53.000 cpu : usr=1.55%, sys=2.03%, ctx=3191, majf=0, minf=1 00:19:53.000 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:53.000 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.000 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:53.000 issued rwts: total=0,5663,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.000 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:53.001 00:19:53.001 Run status group 0 (all jobs): 00:19:53.001 WRITE: bw=1380MiB/s (1447MB/s), 87.8MiB/s-162MiB/s (92.0MB/s-170MB/s), io=13.7GiB (14.7GB), run=10097-10163msec 00:19:53.001 00:19:53.001 Disk stats (read/write): 00:19:53.001 nvme0n1: ios=46/7425, merge=0/0, ticks=2823/1208046, in_queue=1210869, util=99.73% 00:19:53.001 nvme10n1: ios=49/10759, merge=0/0, ticks=381/1216464, in_queue=1216845, util=97.83% 00:19:53.001 nvme1n1: ios=46/12921, merge=0/0, ticks=165/1213929, in_queue=1214094, util=98.54% 00:19:53.001 nvme2n1: ios=0/11651, merge=0/0, ticks=0/1220197, in_queue=1220197, util=97.59% 00:19:53.001 nvme3n1: ios=21/7133, merge=0/0, ticks=60/1243914, in_queue=1243974, util=98.17% 00:19:53.001 nvme4n1: ios=21/9929, merge=0/0, ticks=66/1216711, in_queue=1216777, util=98.19% 00:19:53.001 nvme5n1: ios=0/7829, merge=0/0, ticks=0/1199990, in_queue=1199990, util=98.14% 00:19:53.001 nvme6n1: ios=0/7705, merge=0/0, ticks=0/1207274, in_queue=1207274, util=98.32% 00:19:53.001 nvme7n1: ios=0/10878, merge=0/0, ticks=0/1243283, in_queue=1243283, util=98.80% 00:19:53.001 nvme8n1: ios=44/12969, merge=0/0, ticks=326/1247293, in_queue=1247619, util=100.00% 00:19:53.001 nvme9n1: ios=0/11055, merge=0/0, ticks=0/1215292, in_queue=1215292, util=99.05% 00:19:53.001 11:44:12 -- target/multiconnection.sh@36 -- # sync 00:19:53.001 11:44:12 -- target/multiconnection.sh@37 -- # seq 1 11 00:19:53.001 11:44:12 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:53.001 11:44:12 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:53.001 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:53.001 11:44:12 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:19:53.001 11:44:12 -- common/autotest_common.sh@1208 -- # local i=0 00:19:53.001 11:44:12 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:53.001 11:44:12 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:19:53.001 11:44:12 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:53.001 11:44:12 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:19:53.001 11:44:12 -- common/autotest_common.sh@1220 -- # return 0 00:19:53.001 11:44:12 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:53.001 11:44:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.001 11:44:12 -- common/autotest_common.sh@10 -- # set +x 00:19:53.001 11:44:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.001 11:44:12 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:53.001 11:44:12 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:19:53.001 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:19:53.001 11:44:12 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:19:53.001 11:44:12 -- common/autotest_common.sh@1208 -- # local i=0 00:19:53.001 11:44:12 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:53.001 11:44:12 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:19:53.001 11:44:12 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:53.001 11:44:12 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:19:53.001 11:44:12 -- common/autotest_common.sh@1220 -- # return 0 00:19:53.001 11:44:12 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:19:53.001 11:44:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.001 11:44:12 -- common/autotest_common.sh@10 -- # set +x 00:19:53.001 11:44:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.001 11:44:12 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:53.001 11:44:12 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:19:53.259 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:19:53.259 11:44:13 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:19:53.259 11:44:13 -- common/autotest_common.sh@1208 -- # local i=0 00:19:53.259 11:44:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:53.259 11:44:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:19:53.259 11:44:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:53.259 11:44:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:19:53.259 11:44:13 -- common/autotest_common.sh@1220 -- # return 0 00:19:53.259 11:44:13 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:19:53.259 11:44:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.259 11:44:13 -- common/autotest_common.sh@10 -- # set +x 00:19:53.259 11:44:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.259 11:44:13 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:53.259 11:44:13 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:19:53.518 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:19:53.518 11:44:13 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:19:53.518 11:44:13 -- common/autotest_common.sh@1208 -- # local i=0 00:19:53.518 11:44:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:53.518 11:44:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:19:53.518 11:44:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:53.518 11:44:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:19:53.518 11:44:13 -- common/autotest_common.sh@1220 -- # return 0 00:19:53.518 11:44:13 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:19:53.518 11:44:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.518 11:44:13 -- common/autotest_common.sh@10 -- # set +x 00:19:53.518 11:44:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.518 11:44:13 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:53.518 11:44:13 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:19:53.776 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:19:53.776 11:44:13 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:19:53.776 11:44:13 -- common/autotest_common.sh@1208 -- # local i=0 00:19:53.776 11:44:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:53.776 11:44:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:19:53.776 11:44:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:53.776 11:44:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:19:53.776 11:44:13 -- common/autotest_common.sh@1220 -- # return 0 00:19:53.776 11:44:13 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:19:53.776 11:44:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.776 11:44:13 -- common/autotest_common.sh@10 -- # set +x 00:19:53.776 11:44:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.776 11:44:13 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:53.776 11:44:13 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:19:54.034 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:19:54.034 11:44:13 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:19:54.034 11:44:13 -- common/autotest_common.sh@1208 -- # local i=0 00:19:54.034 11:44:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:54.034 11:44:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:19:54.034 11:44:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:54.034 11:44:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:19:54.034 11:44:13 -- common/autotest_common.sh@1220 -- # return 0 00:19:54.034 11:44:13 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:19:54.034 11:44:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.034 11:44:13 -- common/autotest_common.sh@10 -- # set +x 00:19:54.034 11:44:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.034 11:44:13 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:54.034 11:44:13 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:19:54.293 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:19:54.293 11:44:14 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:19:54.293 11:44:14 -- common/autotest_common.sh@1208 -- # local i=0 00:19:54.293 11:44:14 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:54.293 11:44:14 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:19:54.293 11:44:14 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:54.293 11:44:14 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:19:54.293 11:44:14 -- common/autotest_common.sh@1220 -- # return 0 00:19:54.293 11:44:14 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:19:54.293 11:44:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.293 11:44:14 -- common/autotest_common.sh@10 -- # set +x 00:19:54.293 11:44:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.293 11:44:14 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:54.293 11:44:14 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:19:54.551 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:19:54.551 11:44:14 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:19:54.551 11:44:14 -- common/autotest_common.sh@1208 -- # local i=0 00:19:54.551 11:44:14 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:54.551 11:44:14 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:19:54.551 11:44:14 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:54.551 11:44:14 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:19:54.551 11:44:14 -- common/autotest_common.sh@1220 -- # return 0 00:19:54.551 11:44:14 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:19:54.551 11:44:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.551 11:44:14 -- common/autotest_common.sh@10 -- # set +x 00:19:54.551 11:44:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.551 11:44:14 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:54.552 11:44:14 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:19:54.552 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:19:54.552 11:44:14 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:19:54.552 11:44:14 -- common/autotest_common.sh@1208 -- # local i=0 00:19:54.552 11:44:14 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:54.552 11:44:14 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:19:54.552 11:44:14 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:54.552 11:44:14 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:19:54.552 11:44:14 -- common/autotest_common.sh@1220 -- # return 0 00:19:54.552 11:44:14 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:19:54.552 11:44:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.552 11:44:14 -- common/autotest_common.sh@10 -- # set +x 00:19:54.552 11:44:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.552 11:44:14 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:54.552 11:44:14 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:19:54.811 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:19:54.811 11:44:14 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:19:54.811 11:44:14 -- common/autotest_common.sh@1208 -- # local i=0 00:19:54.811 11:44:14 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:54.811 11:44:14 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:19:54.811 11:44:14 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:54.811 11:44:14 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:19:54.811 11:44:14 -- common/autotest_common.sh@1220 -- # return 0 00:19:54.811 11:44:14 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:19:54.811 11:44:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.811 11:44:14 -- common/autotest_common.sh@10 -- # set +x 00:19:54.811 11:44:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.811 11:44:14 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:54.811 11:44:14 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:19:54.811 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:19:54.811 11:44:14 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:19:54.811 11:44:14 -- common/autotest_common.sh@1208 -- # local i=0 00:19:54.811 11:44:14 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:54.811 11:44:14 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:19:54.811 11:44:14 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:54.811 11:44:14 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:19:54.811 11:44:14 -- common/autotest_common.sh@1220 -- # return 0 00:19:54.811 11:44:14 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:19:54.811 11:44:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.811 11:44:14 -- common/autotest_common.sh@10 -- # set +x 00:19:54.811 11:44:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.811 11:44:14 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:19:54.811 11:44:14 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:19:54.811 11:44:14 -- target/multiconnection.sh@47 -- # nvmftestfini 00:19:54.811 11:44:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:54.811 11:44:14 -- nvmf/common.sh@116 -- # sync 00:19:54.811 11:44:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:54.811 11:44:14 -- nvmf/common.sh@119 -- # set +e 00:19:54.811 11:44:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:54.811 11:44:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:54.811 rmmod nvme_tcp 00:19:54.811 rmmod nvme_fabrics 00:19:54.811 rmmod nvme_keyring 00:19:54.811 11:44:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:54.811 11:44:14 -- nvmf/common.sh@123 -- # set -e 00:19:54.811 11:44:14 -- nvmf/common.sh@124 -- # return 0 00:19:54.811 11:44:14 -- nvmf/common.sh@477 -- # '[' -n 3842954 ']' 00:19:54.811 11:44:14 -- nvmf/common.sh@478 -- # killprocess 3842954 00:19:54.811 11:44:14 -- common/autotest_common.sh@936 -- # '[' -z 3842954 ']' 00:19:54.811 11:44:14 -- common/autotest_common.sh@940 -- # kill -0 3842954 00:19:54.811 11:44:14 -- common/autotest_common.sh@941 -- # uname 00:19:54.811 11:44:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:54.811 11:44:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3842954 00:19:55.070 11:44:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:55.070 11:44:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:55.070 11:44:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3842954' 00:19:55.070 killing process with pid 3842954 00:19:55.070 11:44:14 -- common/autotest_common.sh@955 -- # kill 3842954 00:19:55.070 11:44:14 -- common/autotest_common.sh@960 -- # wait 3842954 00:19:55.642 11:44:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:55.642 11:44:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:55.642 11:44:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:55.642 11:44:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:55.642 11:44:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:55.642 11:44:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:55.642 11:44:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:55.642 11:44:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:57.547 11:44:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:57.547 00:19:57.547 real 1m1.858s 00:19:57.547 user 3m25.510s 00:19:57.547 sys 0m26.244s 00:19:57.547 11:44:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:57.547 11:44:17 -- common/autotest_common.sh@10 -- # set +x 00:19:57.547 ************************************ 00:19:57.547 END TEST nvmf_multiconnection 00:19:57.547 ************************************ 00:19:57.547 11:44:17 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:19:57.547 11:44:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:57.547 11:44:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:57.547 11:44:17 -- common/autotest_common.sh@10 -- # set +x 00:19:57.547 ************************************ 00:19:57.547 START TEST nvmf_initiator_timeout 00:19:57.547 ************************************ 00:19:57.547 11:44:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:19:57.547 * Looking for test storage... 00:19:57.547 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:57.547 11:44:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:57.547 11:44:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:57.547 11:44:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:57.806 11:44:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:57.806 11:44:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:57.806 11:44:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:57.806 11:44:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:57.806 11:44:17 -- scripts/common.sh@335 -- # IFS=.-: 00:19:57.806 11:44:17 -- scripts/common.sh@335 -- # read -ra ver1 00:19:57.806 11:44:17 -- scripts/common.sh@336 -- # IFS=.-: 00:19:57.806 11:44:17 -- scripts/common.sh@336 -- # read -ra ver2 00:19:57.806 11:44:17 -- scripts/common.sh@337 -- # local 'op=<' 00:19:57.806 11:44:17 -- scripts/common.sh@339 -- # ver1_l=2 00:19:57.806 11:44:17 -- scripts/common.sh@340 -- # ver2_l=1 00:19:57.806 11:44:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:57.806 11:44:17 -- scripts/common.sh@343 -- # case "$op" in 00:19:57.806 11:44:17 -- scripts/common.sh@344 -- # : 1 00:19:57.806 11:44:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:57.806 11:44:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:57.806 11:44:17 -- scripts/common.sh@364 -- # decimal 1 00:19:57.806 11:44:17 -- scripts/common.sh@352 -- # local d=1 00:19:57.806 11:44:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:57.806 11:44:17 -- scripts/common.sh@354 -- # echo 1 00:19:57.806 11:44:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:57.806 11:44:17 -- scripts/common.sh@365 -- # decimal 2 00:19:57.806 11:44:17 -- scripts/common.sh@352 -- # local d=2 00:19:57.806 11:44:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:57.806 11:44:17 -- scripts/common.sh@354 -- # echo 2 00:19:57.807 11:44:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:57.807 11:44:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:57.807 11:44:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:57.807 11:44:17 -- scripts/common.sh@367 -- # return 0 00:19:57.807 11:44:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:57.807 11:44:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:57.807 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.807 --rc genhtml_branch_coverage=1 00:19:57.807 --rc genhtml_function_coverage=1 00:19:57.807 --rc genhtml_legend=1 00:19:57.807 --rc geninfo_all_blocks=1 00:19:57.807 --rc geninfo_unexecuted_blocks=1 00:19:57.807 00:19:57.807 ' 00:19:57.807 11:44:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:57.807 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.807 --rc genhtml_branch_coverage=1 00:19:57.807 --rc genhtml_function_coverage=1 00:19:57.807 --rc genhtml_legend=1 00:19:57.807 --rc geninfo_all_blocks=1 00:19:57.807 --rc geninfo_unexecuted_blocks=1 00:19:57.807 00:19:57.807 ' 00:19:57.807 11:44:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:57.807 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.807 --rc genhtml_branch_coverage=1 00:19:57.807 --rc genhtml_function_coverage=1 00:19:57.807 --rc genhtml_legend=1 00:19:57.807 --rc geninfo_all_blocks=1 00:19:57.807 --rc geninfo_unexecuted_blocks=1 00:19:57.807 00:19:57.807 ' 00:19:57.807 11:44:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:57.807 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.807 --rc genhtml_branch_coverage=1 00:19:57.807 --rc genhtml_function_coverage=1 00:19:57.807 --rc genhtml_legend=1 00:19:57.807 --rc geninfo_all_blocks=1 00:19:57.807 --rc geninfo_unexecuted_blocks=1 00:19:57.807 00:19:57.807 ' 00:19:57.807 11:44:17 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:57.807 11:44:17 -- nvmf/common.sh@7 -- # uname -s 00:19:57.807 11:44:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:57.807 11:44:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:57.807 11:44:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:57.807 11:44:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:57.807 11:44:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:57.807 11:44:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:57.807 11:44:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:57.807 11:44:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:57.807 11:44:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:57.807 11:44:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:57.807 11:44:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:57.807 11:44:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:57.807 11:44:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:57.807 11:44:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:57.807 11:44:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:57.807 11:44:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:57.807 11:44:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:57.807 11:44:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:57.807 11:44:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:57.807 11:44:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.807 11:44:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.807 11:44:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.807 11:44:17 -- paths/export.sh@5 -- # export PATH 00:19:57.807 11:44:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.807 11:44:17 -- nvmf/common.sh@46 -- # : 0 00:19:57.807 11:44:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:57.807 11:44:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:57.807 11:44:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:57.807 11:44:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:57.807 11:44:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:57.807 11:44:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:57.807 11:44:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:57.807 11:44:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:57.807 11:44:17 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:57.807 11:44:17 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:57.807 11:44:17 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:19:57.807 11:44:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:57.807 11:44:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:57.807 11:44:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:57.807 11:44:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:57.807 11:44:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:57.807 11:44:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:57.807 11:44:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:57.807 11:44:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:57.807 11:44:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:57.807 11:44:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:57.807 11:44:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:57.807 11:44:17 -- common/autotest_common.sh@10 -- # set +x 00:19:59.710 11:44:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:59.710 11:44:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:59.710 11:44:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:59.710 11:44:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:59.710 11:44:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:59.710 11:44:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:59.710 11:44:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:59.711 11:44:19 -- nvmf/common.sh@294 -- # net_devs=() 00:19:59.711 11:44:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:59.711 11:44:19 -- nvmf/common.sh@295 -- # e810=() 00:19:59.711 11:44:19 -- nvmf/common.sh@295 -- # local -ga e810 00:19:59.711 11:44:19 -- nvmf/common.sh@296 -- # x722=() 00:19:59.711 11:44:19 -- nvmf/common.sh@296 -- # local -ga x722 00:19:59.711 11:44:19 -- nvmf/common.sh@297 -- # mlx=() 00:19:59.711 11:44:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:59.711 11:44:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:59.711 11:44:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:59.711 11:44:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:59.711 11:44:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:59.711 11:44:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:59.711 11:44:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:59.711 11:44:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:59.711 11:44:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:59.711 11:44:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:59.711 11:44:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:59.711 11:44:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:59.711 11:44:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:59.711 11:44:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:59.711 11:44:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:59.711 11:44:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:59.711 11:44:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:59.711 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:59.711 11:44:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:59.711 11:44:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:59.711 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:59.711 11:44:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:59.711 11:44:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:59.711 11:44:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:59.711 11:44:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:59.711 11:44:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:59.711 11:44:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:59.711 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:59.711 11:44:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:59.711 11:44:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:59.711 11:44:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:59.711 11:44:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:59.711 11:44:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:59.711 11:44:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:59.711 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:59.711 11:44:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:59.711 11:44:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:59.711 11:44:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:59.711 11:44:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:59.711 11:44:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:59.711 11:44:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:59.711 11:44:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:59.711 11:44:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:59.711 11:44:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:59.711 11:44:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:59.711 11:44:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:59.711 11:44:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:59.711 11:44:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:59.711 11:44:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:59.711 11:44:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:59.711 11:44:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:59.711 11:44:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:59.711 11:44:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:59.711 11:44:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:59.711 11:44:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:59.711 11:44:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:59.711 11:44:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:59.969 11:44:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:59.969 11:44:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:59.969 11:44:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:59.969 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:59.969 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.264 ms 00:19:59.969 00:19:59.969 --- 10.0.0.2 ping statistics --- 00:19:59.969 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:59.969 rtt min/avg/max/mdev = 0.264/0.264/0.264/0.000 ms 00:19:59.969 11:44:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:59.969 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:59.969 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:19:59.969 00:19:59.969 --- 10.0.0.1 ping statistics --- 00:19:59.969 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:59.969 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:19:59.969 11:44:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:59.969 11:44:19 -- nvmf/common.sh@410 -- # return 0 00:19:59.969 11:44:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:59.969 11:44:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:59.969 11:44:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:59.969 11:44:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:59.969 11:44:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:59.969 11:44:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:59.969 11:44:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:59.969 11:44:19 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:19:59.969 11:44:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:59.969 11:44:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:59.969 11:44:19 -- common/autotest_common.sh@10 -- # set +x 00:19:59.969 11:44:19 -- nvmf/common.sh@469 -- # nvmfpid=3852182 00:19:59.969 11:44:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:59.969 11:44:19 -- nvmf/common.sh@470 -- # waitforlisten 3852182 00:19:59.969 11:44:19 -- common/autotest_common.sh@829 -- # '[' -z 3852182 ']' 00:19:59.969 11:44:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:59.969 11:44:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:59.970 11:44:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:59.970 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:59.970 11:44:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:59.970 11:44:19 -- common/autotest_common.sh@10 -- # set +x 00:19:59.970 [2024-11-28 11:44:19.932881] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:59.970 [2024-11-28 11:44:19.932959] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:59.970 EAL: No free 2048 kB hugepages reported on node 1 00:19:59.970 [2024-11-28 11:44:19.998898] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:00.228 [2024-11-28 11:44:20.119552] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:00.228 [2024-11-28 11:44:20.119708] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:00.228 [2024-11-28 11:44:20.119727] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:00.228 [2024-11-28 11:44:20.119741] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:00.228 [2024-11-28 11:44:20.119799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:00.228 [2024-11-28 11:44:20.119869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:00.228 [2024-11-28 11:44:20.119968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:00.228 [2024-11-28 11:44:20.119971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:01.171 11:44:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:01.171 11:44:20 -- common/autotest_common.sh@862 -- # return 0 00:20:01.171 11:44:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:01.171 11:44:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:01.171 11:44:20 -- common/autotest_common.sh@10 -- # set +x 00:20:01.171 11:44:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:01.171 11:44:20 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:01.171 11:44:20 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:01.171 11:44:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:01.171 11:44:20 -- common/autotest_common.sh@10 -- # set +x 00:20:01.171 Malloc0 00:20:01.171 11:44:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:01.171 11:44:20 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:01.171 11:44:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:01.171 11:44:20 -- common/autotest_common.sh@10 -- # set +x 00:20:01.171 Delay0 00:20:01.171 11:44:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:01.171 11:44:21 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:01.171 11:44:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:01.171 11:44:21 -- common/autotest_common.sh@10 -- # set +x 00:20:01.171 [2024-11-28 11:44:21.006698] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:01.171 11:44:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:01.171 11:44:21 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:01.171 11:44:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:01.171 11:44:21 -- common/autotest_common.sh@10 -- # set +x 00:20:01.171 11:44:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:01.171 11:44:21 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:01.171 11:44:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:01.171 11:44:21 -- common/autotest_common.sh@10 -- # set +x 00:20:01.171 11:44:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:01.171 11:44:21 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:01.171 11:44:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:01.171 11:44:21 -- common/autotest_common.sh@10 -- # set +x 00:20:01.171 [2024-11-28 11:44:21.035019] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:01.171 11:44:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:01.171 11:44:21 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:01.737 11:44:21 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:01.737 11:44:21 -- common/autotest_common.sh@1187 -- # local i=0 00:20:01.737 11:44:21 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:01.737 11:44:21 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:01.737 11:44:21 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:04.264 11:44:23 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:04.264 11:44:23 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:04.264 11:44:23 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:04.264 11:44:23 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:04.264 11:44:23 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:04.264 11:44:23 -- common/autotest_common.sh@1197 -- # return 0 00:20:04.264 11:44:23 -- target/initiator_timeout.sh@35 -- # fio_pid=3852752 00:20:04.264 11:44:23 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:04.264 11:44:23 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:04.264 [global] 00:20:04.264 thread=1 00:20:04.264 invalidate=1 00:20:04.264 rw=write 00:20:04.264 time_based=1 00:20:04.264 runtime=60 00:20:04.264 ioengine=libaio 00:20:04.264 direct=1 00:20:04.264 bs=4096 00:20:04.264 iodepth=1 00:20:04.264 norandommap=0 00:20:04.264 numjobs=1 00:20:04.264 00:20:04.264 verify_dump=1 00:20:04.264 verify_backlog=512 00:20:04.264 verify_state_save=0 00:20:04.264 do_verify=1 00:20:04.264 verify=crc32c-intel 00:20:04.264 [job0] 00:20:04.264 filename=/dev/nvme0n1 00:20:04.264 Could not set queue depth (nvme0n1) 00:20:04.264 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:04.264 fio-3.35 00:20:04.264 Starting 1 thread 00:20:06.790 11:44:26 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:06.790 11:44:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.790 11:44:26 -- common/autotest_common.sh@10 -- # set +x 00:20:06.790 true 00:20:06.790 11:44:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.790 11:44:26 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:06.790 11:44:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.790 11:44:26 -- common/autotest_common.sh@10 -- # set +x 00:20:06.791 true 00:20:06.791 11:44:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.791 11:44:26 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:06.791 11:44:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.791 11:44:26 -- common/autotest_common.sh@10 -- # set +x 00:20:06.791 true 00:20:06.791 11:44:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.791 11:44:26 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:06.791 11:44:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.791 11:44:26 -- common/autotest_common.sh@10 -- # set +x 00:20:06.791 true 00:20:06.791 11:44:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.791 11:44:26 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:10.164 11:44:29 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:10.164 11:44:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:10.164 11:44:29 -- common/autotest_common.sh@10 -- # set +x 00:20:10.164 true 00:20:10.164 11:44:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:10.164 11:44:29 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:10.164 11:44:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:10.164 11:44:29 -- common/autotest_common.sh@10 -- # set +x 00:20:10.164 true 00:20:10.164 11:44:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:10.164 11:44:29 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:10.164 11:44:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:10.164 11:44:29 -- common/autotest_common.sh@10 -- # set +x 00:20:10.164 true 00:20:10.164 11:44:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:10.164 11:44:29 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:10.164 11:44:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:10.164 11:44:29 -- common/autotest_common.sh@10 -- # set +x 00:20:10.164 true 00:20:10.164 11:44:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:10.164 11:44:29 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:10.164 11:44:29 -- target/initiator_timeout.sh@54 -- # wait 3852752 00:21:06.371 00:21:06.371 job0: (groupid=0, jobs=1): err= 0: pid=3852825: Thu Nov 28 11:45:24 2024 00:21:06.371 read: IOPS=142, BW=571KiB/s (585kB/s)(33.5MiB/60032msec) 00:21:06.371 slat (nsec): min=5568, max=63885, avg=11397.04, stdev=6121.73 00:21:06.371 clat (usec): min=243, max=40930k, avg=6728.12, stdev=442239.90 00:21:06.371 lat (usec): min=248, max=40930k, avg=6739.52, stdev=442239.98 00:21:06.371 clat percentiles (usec): 00:21:06.371 | 1.00th=[ 253], 5.00th=[ 262], 10.00th=[ 265], 00:21:06.371 | 20.00th=[ 273], 30.00th=[ 277], 40.00th=[ 285], 00:21:06.371 | 50.00th=[ 293], 60.00th=[ 302], 70.00th=[ 310], 00:21:06.371 | 80.00th=[ 326], 90.00th=[ 355], 95.00th=[ 449], 00:21:06.371 | 99.00th=[ 41157], 99.50th=[ 41157], 99.90th=[ 42206], 00:21:06.371 | 99.95th=[ 42730], 99.99th=[17112761] 00:21:06.371 write: IOPS=144, BW=580KiB/s (594kB/s)(34.0MiB/60032msec); 0 zone resets 00:21:06.371 slat (usec): min=7, max=8883, avg=18.96, stdev=124.74 00:21:06.371 clat (usec): min=183, max=4075, avg=235.68, stdev=54.36 00:21:06.371 lat (usec): min=191, max=9342, avg=254.64, stdev=139.90 00:21:06.371 clat percentiles (usec): 00:21:06.371 | 1.00th=[ 192], 5.00th=[ 198], 10.00th=[ 202], 20.00th=[ 208], 00:21:06.371 | 30.00th=[ 215], 40.00th=[ 225], 50.00th=[ 231], 60.00th=[ 237], 00:21:06.371 | 70.00th=[ 243], 80.00th=[ 251], 90.00th=[ 273], 95.00th=[ 302], 00:21:06.371 | 99.00th=[ 367], 99.50th=[ 388], 99.90th=[ 420], 99.95th=[ 429], 00:21:06.371 | 99.99th=[ 4080] 00:21:06.371 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=6330.18, stdev=1845.00, samples=11 00:21:06.371 iops : min= 1024, max= 2048, avg=1582.55, stdev=461.25, samples=11 00:21:06.371 lat (usec) : 250=39.82%, 500=57.89%, 750=0.25%, 1000=0.01% 00:21:06.371 lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 50=2.01%, >=2000=0.01% 00:21:06.371 cpu : usr=0.32%, sys=0.54%, ctx=17276, majf=0, minf=1 00:21:06.371 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:06.371 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:06.371 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:06.372 issued rwts: total=8568,8704,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:06.372 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:06.372 00:21:06.372 Run status group 0 (all jobs): 00:21:06.372 READ: bw=571KiB/s (585kB/s), 571KiB/s-571KiB/s (585kB/s-585kB/s), io=33.5MiB (35.1MB), run=60032-60032msec 00:21:06.372 WRITE: bw=580KiB/s (594kB/s), 580KiB/s-580KiB/s (594kB/s-594kB/s), io=34.0MiB (35.7MB), run=60032-60032msec 00:21:06.372 00:21:06.372 Disk stats (read/write): 00:21:06.372 nvme0n1: ios=8663/8704, merge=0/0, ticks=16520/1961, in_queue=18481, util=99.57% 00:21:06.372 11:45:24 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:06.372 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:06.372 11:45:24 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:06.372 11:45:24 -- common/autotest_common.sh@1208 -- # local i=0 00:21:06.372 11:45:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:06.372 11:45:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:06.372 11:45:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:06.372 11:45:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:06.372 11:45:24 -- common/autotest_common.sh@1220 -- # return 0 00:21:06.372 11:45:24 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:06.372 11:45:24 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:06.372 nvmf hotplug test: fio successful as expected 00:21:06.372 11:45:24 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:06.372 11:45:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:06.372 11:45:24 -- common/autotest_common.sh@10 -- # set +x 00:21:06.372 11:45:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:06.372 11:45:24 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:06.372 11:45:24 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:06.372 11:45:24 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:06.372 11:45:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:06.372 11:45:24 -- nvmf/common.sh@116 -- # sync 00:21:06.372 11:45:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:06.372 11:45:24 -- nvmf/common.sh@119 -- # set +e 00:21:06.372 11:45:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:06.372 11:45:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:06.372 rmmod nvme_tcp 00:21:06.372 rmmod nvme_fabrics 00:21:06.372 rmmod nvme_keyring 00:21:06.372 11:45:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:06.372 11:45:24 -- nvmf/common.sh@123 -- # set -e 00:21:06.372 11:45:24 -- nvmf/common.sh@124 -- # return 0 00:21:06.372 11:45:24 -- nvmf/common.sh@477 -- # '[' -n 3852182 ']' 00:21:06.372 11:45:24 -- nvmf/common.sh@478 -- # killprocess 3852182 00:21:06.372 11:45:24 -- common/autotest_common.sh@936 -- # '[' -z 3852182 ']' 00:21:06.372 11:45:24 -- common/autotest_common.sh@940 -- # kill -0 3852182 00:21:06.372 11:45:24 -- common/autotest_common.sh@941 -- # uname 00:21:06.372 11:45:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:06.372 11:45:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3852182 00:21:06.372 11:45:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:06.372 11:45:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:06.372 11:45:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3852182' 00:21:06.372 killing process with pid 3852182 00:21:06.372 11:45:24 -- common/autotest_common.sh@955 -- # kill 3852182 00:21:06.372 11:45:24 -- common/autotest_common.sh@960 -- # wait 3852182 00:21:06.372 11:45:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:06.372 11:45:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:06.372 11:45:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:06.372 11:45:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:06.372 11:45:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:06.372 11:45:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:06.372 11:45:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:06.372 11:45:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:06.939 11:45:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:06.939 00:21:06.939 real 1m9.241s 00:21:06.939 user 4m14.182s 00:21:06.939 sys 0m7.101s 00:21:06.939 11:45:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:06.939 11:45:26 -- common/autotest_common.sh@10 -- # set +x 00:21:06.939 ************************************ 00:21:06.939 END TEST nvmf_initiator_timeout 00:21:06.939 ************************************ 00:21:06.939 11:45:26 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:06.939 11:45:26 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:06.939 11:45:26 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:06.939 11:45:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:06.939 11:45:26 -- common/autotest_common.sh@10 -- # set +x 00:21:08.838 11:45:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:08.838 11:45:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:08.838 11:45:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:08.838 11:45:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:08.838 11:45:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:08.838 11:45:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:08.838 11:45:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:08.838 11:45:28 -- nvmf/common.sh@294 -- # net_devs=() 00:21:08.838 11:45:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:08.838 11:45:28 -- nvmf/common.sh@295 -- # e810=() 00:21:08.838 11:45:28 -- nvmf/common.sh@295 -- # local -ga e810 00:21:08.838 11:45:28 -- nvmf/common.sh@296 -- # x722=() 00:21:08.838 11:45:28 -- nvmf/common.sh@296 -- # local -ga x722 00:21:08.838 11:45:28 -- nvmf/common.sh@297 -- # mlx=() 00:21:08.838 11:45:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:08.838 11:45:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:08.839 11:45:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:08.839 11:45:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:08.839 11:45:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:08.839 11:45:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:08.839 11:45:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:08.839 11:45:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:08.839 11:45:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:08.839 11:45:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:08.839 11:45:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:08.839 11:45:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:08.839 11:45:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:08.839 11:45:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:08.839 11:45:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:08.839 11:45:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:08.839 11:45:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:08.839 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:08.839 11:45:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:08.839 11:45:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:08.839 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:08.839 11:45:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:08.839 11:45:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:08.839 11:45:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:08.839 11:45:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:08.839 11:45:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:08.839 11:45:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:08.839 11:45:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:08.839 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:08.839 11:45:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:08.839 11:45:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:08.839 11:45:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:08.839 11:45:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:08.839 11:45:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:08.839 11:45:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:08.839 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:08.839 11:45:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:08.839 11:45:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:08.839 11:45:28 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:08.839 11:45:28 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:08.839 11:45:28 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:08.839 11:45:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:08.839 11:45:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:08.839 11:45:28 -- common/autotest_common.sh@10 -- # set +x 00:21:08.839 ************************************ 00:21:08.839 START TEST nvmf_perf_adq 00:21:08.839 ************************************ 00:21:08.839 11:45:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:08.839 * Looking for test storage... 00:21:08.839 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:08.839 11:45:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:08.839 11:45:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:08.839 11:45:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:09.098 11:45:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:09.098 11:45:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:09.098 11:45:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:09.098 11:45:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:09.098 11:45:28 -- scripts/common.sh@335 -- # IFS=.-: 00:21:09.098 11:45:28 -- scripts/common.sh@335 -- # read -ra ver1 00:21:09.098 11:45:28 -- scripts/common.sh@336 -- # IFS=.-: 00:21:09.098 11:45:28 -- scripts/common.sh@336 -- # read -ra ver2 00:21:09.098 11:45:28 -- scripts/common.sh@337 -- # local 'op=<' 00:21:09.098 11:45:28 -- scripts/common.sh@339 -- # ver1_l=2 00:21:09.098 11:45:28 -- scripts/common.sh@340 -- # ver2_l=1 00:21:09.098 11:45:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:09.098 11:45:28 -- scripts/common.sh@343 -- # case "$op" in 00:21:09.098 11:45:28 -- scripts/common.sh@344 -- # : 1 00:21:09.098 11:45:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:09.098 11:45:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:09.098 11:45:28 -- scripts/common.sh@364 -- # decimal 1 00:21:09.098 11:45:28 -- scripts/common.sh@352 -- # local d=1 00:21:09.098 11:45:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:09.098 11:45:28 -- scripts/common.sh@354 -- # echo 1 00:21:09.098 11:45:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:09.098 11:45:28 -- scripts/common.sh@365 -- # decimal 2 00:21:09.098 11:45:28 -- scripts/common.sh@352 -- # local d=2 00:21:09.098 11:45:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:09.098 11:45:28 -- scripts/common.sh@354 -- # echo 2 00:21:09.098 11:45:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:09.098 11:45:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:09.098 11:45:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:09.098 11:45:28 -- scripts/common.sh@367 -- # return 0 00:21:09.098 11:45:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:09.098 11:45:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:09.098 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:09.098 --rc genhtml_branch_coverage=1 00:21:09.098 --rc genhtml_function_coverage=1 00:21:09.098 --rc genhtml_legend=1 00:21:09.098 --rc geninfo_all_blocks=1 00:21:09.098 --rc geninfo_unexecuted_blocks=1 00:21:09.098 00:21:09.098 ' 00:21:09.098 11:45:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:09.098 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:09.098 --rc genhtml_branch_coverage=1 00:21:09.098 --rc genhtml_function_coverage=1 00:21:09.098 --rc genhtml_legend=1 00:21:09.098 --rc geninfo_all_blocks=1 00:21:09.098 --rc geninfo_unexecuted_blocks=1 00:21:09.098 00:21:09.098 ' 00:21:09.098 11:45:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:09.098 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:09.098 --rc genhtml_branch_coverage=1 00:21:09.098 --rc genhtml_function_coverage=1 00:21:09.098 --rc genhtml_legend=1 00:21:09.098 --rc geninfo_all_blocks=1 00:21:09.098 --rc geninfo_unexecuted_blocks=1 00:21:09.098 00:21:09.098 ' 00:21:09.099 11:45:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:09.099 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:09.099 --rc genhtml_branch_coverage=1 00:21:09.099 --rc genhtml_function_coverage=1 00:21:09.099 --rc genhtml_legend=1 00:21:09.099 --rc geninfo_all_blocks=1 00:21:09.099 --rc geninfo_unexecuted_blocks=1 00:21:09.099 00:21:09.099 ' 00:21:09.099 11:45:28 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:09.099 11:45:28 -- nvmf/common.sh@7 -- # uname -s 00:21:09.099 11:45:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:09.099 11:45:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:09.099 11:45:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:09.099 11:45:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:09.099 11:45:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:09.099 11:45:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:09.099 11:45:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:09.099 11:45:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:09.099 11:45:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:09.099 11:45:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:09.099 11:45:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:09.099 11:45:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:09.099 11:45:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:09.099 11:45:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:09.099 11:45:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:09.099 11:45:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:09.099 11:45:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:09.099 11:45:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:09.099 11:45:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:09.099 11:45:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:09.099 11:45:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:09.099 11:45:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:09.099 11:45:28 -- paths/export.sh@5 -- # export PATH 00:21:09.099 11:45:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:09.099 11:45:28 -- nvmf/common.sh@46 -- # : 0 00:21:09.099 11:45:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:09.099 11:45:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:09.099 11:45:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:09.099 11:45:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:09.099 11:45:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:09.099 11:45:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:09.099 11:45:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:09.099 11:45:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:09.099 11:45:28 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:09.099 11:45:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:09.099 11:45:28 -- common/autotest_common.sh@10 -- # set +x 00:21:11.001 11:45:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:11.001 11:45:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:11.001 11:45:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:11.001 11:45:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:11.001 11:45:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:11.001 11:45:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:11.001 11:45:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:11.001 11:45:31 -- nvmf/common.sh@294 -- # net_devs=() 00:21:11.001 11:45:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:11.001 11:45:31 -- nvmf/common.sh@295 -- # e810=() 00:21:11.001 11:45:31 -- nvmf/common.sh@295 -- # local -ga e810 00:21:11.001 11:45:31 -- nvmf/common.sh@296 -- # x722=() 00:21:11.001 11:45:31 -- nvmf/common.sh@296 -- # local -ga x722 00:21:11.001 11:45:31 -- nvmf/common.sh@297 -- # mlx=() 00:21:11.001 11:45:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:11.001 11:45:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:11.001 11:45:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:11.001 11:45:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:11.001 11:45:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:11.001 11:45:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:11.001 11:45:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:11.001 11:45:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:11.001 11:45:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:11.001 11:45:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:11.001 11:45:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:11.001 11:45:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:11.001 11:45:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:11.001 11:45:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:11.001 11:45:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:11.001 11:45:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:11.001 11:45:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:11.001 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:11.001 11:45:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:11.001 11:45:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:11.001 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:11.001 11:45:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:11.001 11:45:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:11.001 11:45:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:11.001 11:45:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:11.001 11:45:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:11.001 11:45:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:11.001 11:45:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:11.001 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:11.001 11:45:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:11.001 11:45:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:11.001 11:45:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:11.001 11:45:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:11.001 11:45:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:11.001 11:45:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:11.001 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:11.001 11:45:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:11.001 11:45:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:11.001 11:45:31 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:11.001 11:45:31 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:11.001 11:45:31 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:11.001 11:45:31 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:11.001 11:45:31 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:11.935 11:45:31 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:14.460 11:45:34 -- target/perf_adq.sh@54 -- # sleep 5 00:21:19.737 11:45:39 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:19.737 11:45:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:19.737 11:45:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:19.737 11:45:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:19.737 11:45:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:19.737 11:45:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:19.737 11:45:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:19.737 11:45:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:19.737 11:45:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:19.737 11:45:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:19.737 11:45:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:19.737 11:45:39 -- common/autotest_common.sh@10 -- # set +x 00:21:19.737 11:45:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:19.737 11:45:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:19.737 11:45:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:19.737 11:45:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:19.737 11:45:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:19.737 11:45:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:19.737 11:45:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:19.737 11:45:39 -- nvmf/common.sh@294 -- # net_devs=() 00:21:19.737 11:45:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:19.737 11:45:39 -- nvmf/common.sh@295 -- # e810=() 00:21:19.737 11:45:39 -- nvmf/common.sh@295 -- # local -ga e810 00:21:19.737 11:45:39 -- nvmf/common.sh@296 -- # x722=() 00:21:19.737 11:45:39 -- nvmf/common.sh@296 -- # local -ga x722 00:21:19.737 11:45:39 -- nvmf/common.sh@297 -- # mlx=() 00:21:19.737 11:45:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:19.737 11:45:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:19.737 11:45:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:19.737 11:45:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:19.737 11:45:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:19.737 11:45:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:19.737 11:45:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:19.737 11:45:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:19.737 11:45:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:19.737 11:45:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:19.737 11:45:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:19.737 11:45:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:19.737 11:45:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:19.737 11:45:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:19.737 11:45:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:19.737 11:45:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:19.737 11:45:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:19.737 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:19.737 11:45:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:19.737 11:45:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:19.737 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:19.737 11:45:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:19.737 11:45:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:19.737 11:45:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:19.737 11:45:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:19.737 11:45:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:19.737 11:45:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:19.737 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:19.737 11:45:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:19.737 11:45:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:19.737 11:45:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:19.737 11:45:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:19.737 11:45:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:19.737 11:45:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:19.737 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:19.737 11:45:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:19.737 11:45:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:19.737 11:45:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:19.737 11:45:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:19.737 11:45:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:19.737 11:45:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:19.737 11:45:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:19.737 11:45:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:19.737 11:45:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:19.737 11:45:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:19.737 11:45:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:19.737 11:45:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:19.737 11:45:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:19.737 11:45:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:19.737 11:45:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:19.737 11:45:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:19.738 11:45:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:19.738 11:45:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:19.738 11:45:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:19.738 11:45:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:19.738 11:45:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:19.738 11:45:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:19.738 11:45:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:19.738 11:45:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:19.738 11:45:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:19.738 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:19.738 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:21:19.738 00:21:19.738 --- 10.0.0.2 ping statistics --- 00:21:19.738 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:19.738 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:21:19.738 11:45:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:19.738 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:19.738 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:21:19.738 00:21:19.738 --- 10.0.0.1 ping statistics --- 00:21:19.738 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:19.738 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:21:19.738 11:45:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:19.738 11:45:39 -- nvmf/common.sh@410 -- # return 0 00:21:19.738 11:45:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:19.738 11:45:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:19.738 11:45:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:19.738 11:45:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:19.738 11:45:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:19.738 11:45:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:19.738 11:45:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:19.738 11:45:39 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:19.738 11:45:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:19.738 11:45:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:19.738 11:45:39 -- common/autotest_common.sh@10 -- # set +x 00:21:19.738 11:45:39 -- nvmf/common.sh@469 -- # nvmfpid=3865372 00:21:19.738 11:45:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:19.738 11:45:39 -- nvmf/common.sh@470 -- # waitforlisten 3865372 00:21:19.738 11:45:39 -- common/autotest_common.sh@829 -- # '[' -z 3865372 ']' 00:21:19.738 11:45:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:19.738 11:45:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:19.738 11:45:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:19.738 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:19.738 11:45:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:19.738 11:45:39 -- common/autotest_common.sh@10 -- # set +x 00:21:19.738 [2024-11-28 11:45:39.371838] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:19.738 [2024-11-28 11:45:39.371914] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:19.738 EAL: No free 2048 kB hugepages reported on node 1 00:21:19.738 [2024-11-28 11:45:39.441680] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:19.738 [2024-11-28 11:45:39.550626] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:19.738 [2024-11-28 11:45:39.550806] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:19.738 [2024-11-28 11:45:39.550833] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:19.738 [2024-11-28 11:45:39.550852] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:19.738 [2024-11-28 11:45:39.550916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:19.738 [2024-11-28 11:45:39.550978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:19.738 [2024-11-28 11:45:39.551044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:19.738 [2024-11-28 11:45:39.551050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:19.738 11:45:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:19.738 11:45:39 -- common/autotest_common.sh@862 -- # return 0 00:21:19.738 11:45:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:19.738 11:45:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:19.738 11:45:39 -- common/autotest_common.sh@10 -- # set +x 00:21:19.738 11:45:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:19.738 11:45:39 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:19.738 11:45:39 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:19.738 11:45:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.738 11:45:39 -- common/autotest_common.sh@10 -- # set +x 00:21:19.738 11:45:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.738 11:45:39 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:19.738 11:45:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.738 11:45:39 -- common/autotest_common.sh@10 -- # set +x 00:21:19.738 11:45:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.738 11:45:39 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:19.738 11:45:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.738 11:45:39 -- common/autotest_common.sh@10 -- # set +x 00:21:19.738 [2024-11-28 11:45:39.736327] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:19.738 11:45:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.738 11:45:39 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:19.738 11:45:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.738 11:45:39 -- common/autotest_common.sh@10 -- # set +x 00:21:19.738 Malloc1 00:21:19.738 11:45:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.738 11:45:39 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:19.738 11:45:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.738 11:45:39 -- common/autotest_common.sh@10 -- # set +x 00:21:19.738 11:45:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.738 11:45:39 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:19.738 11:45:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.738 11:45:39 -- common/autotest_common.sh@10 -- # set +x 00:21:19.738 11:45:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.738 11:45:39 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:19.738 11:45:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.738 11:45:39 -- common/autotest_common.sh@10 -- # set +x 00:21:19.738 [2024-11-28 11:45:39.789893] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:19.996 11:45:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.996 11:45:39 -- target/perf_adq.sh@73 -- # perfpid=3865407 00:21:19.996 11:45:39 -- target/perf_adq.sh@74 -- # sleep 2 00:21:19.996 11:45:39 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:19.996 EAL: No free 2048 kB hugepages reported on node 1 00:21:21.906 11:45:41 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:21.906 11:45:41 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:21.906 11:45:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:21.906 11:45:41 -- target/perf_adq.sh@76 -- # wc -l 00:21:21.906 11:45:41 -- common/autotest_common.sh@10 -- # set +x 00:21:21.906 11:45:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:21.906 11:45:41 -- target/perf_adq.sh@76 -- # count=4 00:21:21.906 11:45:41 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:21.906 11:45:41 -- target/perf_adq.sh@81 -- # wait 3865407 00:21:30.012 Initializing NVMe Controllers 00:21:30.012 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:30.012 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:30.012 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:30.012 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:30.012 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:30.012 Initialization complete. Launching workers. 00:21:30.012 ======================================================== 00:21:30.012 Latency(us) 00:21:30.012 Device Information : IOPS MiB/s Average min max 00:21:30.012 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 9416.60 36.78 6797.39 1995.06 10876.51 00:21:30.012 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11012.70 43.02 5813.23 1273.25 9116.43 00:21:30.012 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11688.40 45.66 5476.23 1189.85 9208.04 00:21:30.012 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11324.60 44.24 5652.72 1703.30 9249.82 00:21:30.012 ======================================================== 00:21:30.012 Total : 43442.29 169.70 5894.05 1189.85 10876.51 00:21:30.012 00:21:30.012 11:45:49 -- target/perf_adq.sh@82 -- # nvmftestfini 00:21:30.012 11:45:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:30.012 11:45:49 -- nvmf/common.sh@116 -- # sync 00:21:30.012 11:45:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:30.012 11:45:49 -- nvmf/common.sh@119 -- # set +e 00:21:30.012 11:45:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:30.012 11:45:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:30.012 rmmod nvme_tcp 00:21:30.012 rmmod nvme_fabrics 00:21:30.012 rmmod nvme_keyring 00:21:30.012 11:45:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:30.012 11:45:49 -- nvmf/common.sh@123 -- # set -e 00:21:30.012 11:45:49 -- nvmf/common.sh@124 -- # return 0 00:21:30.012 11:45:49 -- nvmf/common.sh@477 -- # '[' -n 3865372 ']' 00:21:30.012 11:45:49 -- nvmf/common.sh@478 -- # killprocess 3865372 00:21:30.012 11:45:49 -- common/autotest_common.sh@936 -- # '[' -z 3865372 ']' 00:21:30.012 11:45:49 -- common/autotest_common.sh@940 -- # kill -0 3865372 00:21:30.012 11:45:49 -- common/autotest_common.sh@941 -- # uname 00:21:30.012 11:45:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:30.012 11:45:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3865372 00:21:30.012 11:45:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:30.012 11:45:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:30.012 11:45:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3865372' 00:21:30.012 killing process with pid 3865372 00:21:30.012 11:45:49 -- common/autotest_common.sh@955 -- # kill 3865372 00:21:30.012 11:45:49 -- common/autotest_common.sh@960 -- # wait 3865372 00:21:30.270 11:45:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:30.270 11:45:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:30.270 11:45:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:30.270 11:45:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:30.270 11:45:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:30.270 11:45:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:30.270 11:45:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:30.270 11:45:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:32.804 11:45:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:32.804 11:45:52 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:21:32.804 11:45:52 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:33.062 11:45:53 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:35.592 11:45:55 -- target/perf_adq.sh@54 -- # sleep 5 00:21:40.865 11:46:00 -- target/perf_adq.sh@87 -- # nvmftestinit 00:21:40.865 11:46:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:40.865 11:46:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:40.865 11:46:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:40.865 11:46:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:40.865 11:46:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:40.865 11:46:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:40.865 11:46:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:40.865 11:46:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:40.865 11:46:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:40.865 11:46:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:40.865 11:46:00 -- common/autotest_common.sh@10 -- # set +x 00:21:40.865 11:46:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:40.865 11:46:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:40.865 11:46:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:40.865 11:46:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:40.865 11:46:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:40.865 11:46:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:40.865 11:46:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:40.865 11:46:00 -- nvmf/common.sh@294 -- # net_devs=() 00:21:40.865 11:46:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:40.865 11:46:00 -- nvmf/common.sh@295 -- # e810=() 00:21:40.865 11:46:00 -- nvmf/common.sh@295 -- # local -ga e810 00:21:40.865 11:46:00 -- nvmf/common.sh@296 -- # x722=() 00:21:40.865 11:46:00 -- nvmf/common.sh@296 -- # local -ga x722 00:21:40.865 11:46:00 -- nvmf/common.sh@297 -- # mlx=() 00:21:40.865 11:46:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:40.865 11:46:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:40.865 11:46:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:40.865 11:46:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:40.865 11:46:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:40.865 11:46:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:40.865 11:46:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:40.865 11:46:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:40.865 11:46:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:40.865 11:46:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:40.865 11:46:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:40.865 11:46:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:40.865 11:46:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:40.865 11:46:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:40.865 11:46:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:40.865 11:46:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:40.865 11:46:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:40.865 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:40.865 11:46:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:40.865 11:46:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:40.865 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:40.865 11:46:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:40.865 11:46:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:40.865 11:46:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:40.865 11:46:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:40.865 11:46:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:40.865 11:46:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:40.865 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:40.865 11:46:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:40.865 11:46:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:40.865 11:46:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:40.865 11:46:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:40.865 11:46:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:40.865 11:46:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:40.865 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:40.865 11:46:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:40.865 11:46:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:40.865 11:46:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:40.865 11:46:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:40.865 11:46:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:40.865 11:46:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:40.865 11:46:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:40.865 11:46:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:40.865 11:46:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:40.865 11:46:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:40.865 11:46:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:40.865 11:46:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:40.865 11:46:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:40.865 11:46:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:40.865 11:46:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:40.865 11:46:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:40.865 11:46:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:40.865 11:46:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:40.865 11:46:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:40.865 11:46:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:40.865 11:46:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:40.865 11:46:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:40.865 11:46:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:40.865 11:46:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:40.865 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:40.865 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.294 ms 00:21:40.865 00:21:40.865 --- 10.0.0.2 ping statistics --- 00:21:40.865 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:40.865 rtt min/avg/max/mdev = 0.294/0.294/0.294/0.000 ms 00:21:40.865 11:46:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:40.865 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:40.865 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.158 ms 00:21:40.865 00:21:40.865 --- 10.0.0.1 ping statistics --- 00:21:40.865 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:40.865 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:21:40.865 11:46:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:40.865 11:46:00 -- nvmf/common.sh@410 -- # return 0 00:21:40.865 11:46:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:40.865 11:46:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:40.865 11:46:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:40.865 11:46:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:40.865 11:46:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:40.865 11:46:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:40.865 11:46:00 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:21:40.865 11:46:00 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:21:40.865 11:46:00 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:21:40.865 11:46:00 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:21:40.865 net.core.busy_poll = 1 00:21:40.866 11:46:00 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:21:40.866 net.core.busy_read = 1 00:21:40.866 11:46:00 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:21:40.866 11:46:00 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:21:40.866 11:46:00 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:21:40.866 11:46:00 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:21:40.866 11:46:00 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:21:40.866 11:46:00 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:40.866 11:46:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:40.866 11:46:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:40.866 11:46:00 -- common/autotest_common.sh@10 -- # set +x 00:21:40.866 11:46:00 -- nvmf/common.sh@469 -- # nvmfpid=3868212 00:21:40.866 11:46:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:40.866 11:46:00 -- nvmf/common.sh@470 -- # waitforlisten 3868212 00:21:40.866 11:46:00 -- common/autotest_common.sh@829 -- # '[' -z 3868212 ']' 00:21:40.866 11:46:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:40.866 11:46:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:40.866 11:46:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:40.866 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:40.866 11:46:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:40.866 11:46:00 -- common/autotest_common.sh@10 -- # set +x 00:21:40.866 [2024-11-28 11:46:00.797726] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:40.866 [2024-11-28 11:46:00.797799] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:40.866 EAL: No free 2048 kB hugepages reported on node 1 00:21:40.866 [2024-11-28 11:46:00.868098] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:41.124 [2024-11-28 11:46:00.986899] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:41.124 [2024-11-28 11:46:00.987051] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:41.124 [2024-11-28 11:46:00.987067] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:41.124 [2024-11-28 11:46:00.987079] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:41.124 [2024-11-28 11:46:00.987130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:41.124 [2024-11-28 11:46:00.987159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:41.124 [2024-11-28 11:46:00.987214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:41.124 [2024-11-28 11:46:00.987217] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:42.056 11:46:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:42.056 11:46:01 -- common/autotest_common.sh@862 -- # return 0 00:21:42.056 11:46:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:42.056 11:46:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:42.056 11:46:01 -- common/autotest_common.sh@10 -- # set +x 00:21:42.056 11:46:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:42.056 11:46:01 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:21:42.056 11:46:01 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:21:42.056 11:46:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.056 11:46:01 -- common/autotest_common.sh@10 -- # set +x 00:21:42.056 11:46:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.056 11:46:01 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:42.056 11:46:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.056 11:46:01 -- common/autotest_common.sh@10 -- # set +x 00:21:42.056 11:46:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.056 11:46:01 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:21:42.056 11:46:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.056 11:46:01 -- common/autotest_common.sh@10 -- # set +x 00:21:42.056 [2024-11-28 11:46:01.949557] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:42.056 11:46:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.056 11:46:01 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:42.056 11:46:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.056 11:46:01 -- common/autotest_common.sh@10 -- # set +x 00:21:42.056 Malloc1 00:21:42.056 11:46:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.056 11:46:01 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:42.056 11:46:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.056 11:46:01 -- common/autotest_common.sh@10 -- # set +x 00:21:42.056 11:46:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.056 11:46:01 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:42.056 11:46:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.057 11:46:01 -- common/autotest_common.sh@10 -- # set +x 00:21:42.057 11:46:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.057 11:46:01 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:42.057 11:46:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.057 11:46:01 -- common/autotest_common.sh@10 -- # set +x 00:21:42.057 [2024-11-28 11:46:02.003014] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:42.057 11:46:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.057 11:46:02 -- target/perf_adq.sh@94 -- # perfpid=3868372 00:21:42.057 11:46:02 -- target/perf_adq.sh@95 -- # sleep 2 00:21:42.057 11:46:02 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:42.057 EAL: No free 2048 kB hugepages reported on node 1 00:21:44.020 11:46:04 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:21:44.020 11:46:04 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:21:44.020 11:46:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.020 11:46:04 -- target/perf_adq.sh@97 -- # wc -l 00:21:44.020 11:46:04 -- common/autotest_common.sh@10 -- # set +x 00:21:44.020 11:46:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.312 11:46:04 -- target/perf_adq.sh@97 -- # count=2 00:21:44.312 11:46:04 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:21:44.312 11:46:04 -- target/perf_adq.sh@103 -- # wait 3868372 00:21:52.419 Initializing NVMe Controllers 00:21:52.419 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:52.419 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:52.419 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:52.419 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:52.419 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:52.419 Initialization complete. Launching workers. 00:21:52.419 ======================================================== 00:21:52.419 Latency(us) 00:21:52.419 Device Information : IOPS MiB/s Average min max 00:21:52.419 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 7049.70 27.54 9079.21 1427.85 52925.91 00:21:52.419 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 8144.00 31.81 7859.34 1139.49 52514.52 00:21:52.419 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 7511.10 29.34 8545.94 1691.57 52920.53 00:21:52.419 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 7105.30 27.76 9007.60 1214.70 52692.20 00:21:52.419 ======================================================== 00:21:52.419 Total : 29810.09 116.45 8594.51 1139.49 52925.91 00:21:52.419 00:21:52.419 11:46:12 -- target/perf_adq.sh@104 -- # nvmftestfini 00:21:52.419 11:46:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:52.419 11:46:12 -- nvmf/common.sh@116 -- # sync 00:21:52.419 11:46:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:52.419 11:46:12 -- nvmf/common.sh@119 -- # set +e 00:21:52.419 11:46:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:52.419 11:46:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:52.420 rmmod nvme_tcp 00:21:52.420 rmmod nvme_fabrics 00:21:52.420 rmmod nvme_keyring 00:21:52.420 11:46:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:52.420 11:46:12 -- nvmf/common.sh@123 -- # set -e 00:21:52.420 11:46:12 -- nvmf/common.sh@124 -- # return 0 00:21:52.420 11:46:12 -- nvmf/common.sh@477 -- # '[' -n 3868212 ']' 00:21:52.420 11:46:12 -- nvmf/common.sh@478 -- # killprocess 3868212 00:21:52.420 11:46:12 -- common/autotest_common.sh@936 -- # '[' -z 3868212 ']' 00:21:52.420 11:46:12 -- common/autotest_common.sh@940 -- # kill -0 3868212 00:21:52.420 11:46:12 -- common/autotest_common.sh@941 -- # uname 00:21:52.420 11:46:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:52.420 11:46:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3868212 00:21:52.420 11:46:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:52.420 11:46:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:52.420 11:46:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3868212' 00:21:52.420 killing process with pid 3868212 00:21:52.420 11:46:12 -- common/autotest_common.sh@955 -- # kill 3868212 00:21:52.420 11:46:12 -- common/autotest_common.sh@960 -- # wait 3868212 00:21:52.678 11:46:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:52.678 11:46:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:52.678 11:46:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:52.678 11:46:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:52.678 11:46:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:52.678 11:46:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:52.678 11:46:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:52.678 11:46:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:55.963 11:46:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:55.963 11:46:15 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:21:55.963 00:21:55.963 real 0m46.827s 00:21:55.963 user 2m36.732s 00:21:55.963 sys 0m12.091s 00:21:55.963 11:46:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:55.963 11:46:15 -- common/autotest_common.sh@10 -- # set +x 00:21:55.963 ************************************ 00:21:55.963 END TEST nvmf_perf_adq 00:21:55.963 ************************************ 00:21:55.963 11:46:15 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:55.963 11:46:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:55.963 11:46:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:55.963 11:46:15 -- common/autotest_common.sh@10 -- # set +x 00:21:55.963 ************************************ 00:21:55.963 START TEST nvmf_shutdown 00:21:55.963 ************************************ 00:21:55.963 11:46:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:55.963 * Looking for test storage... 00:21:55.963 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:55.963 11:46:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:55.963 11:46:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:55.963 11:46:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:55.963 11:46:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:55.963 11:46:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:55.963 11:46:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:55.963 11:46:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:55.963 11:46:15 -- scripts/common.sh@335 -- # IFS=.-: 00:21:55.963 11:46:15 -- scripts/common.sh@335 -- # read -ra ver1 00:21:55.963 11:46:15 -- scripts/common.sh@336 -- # IFS=.-: 00:21:55.963 11:46:15 -- scripts/common.sh@336 -- # read -ra ver2 00:21:55.963 11:46:15 -- scripts/common.sh@337 -- # local 'op=<' 00:21:55.963 11:46:15 -- scripts/common.sh@339 -- # ver1_l=2 00:21:55.963 11:46:15 -- scripts/common.sh@340 -- # ver2_l=1 00:21:55.963 11:46:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:55.963 11:46:15 -- scripts/common.sh@343 -- # case "$op" in 00:21:55.963 11:46:15 -- scripts/common.sh@344 -- # : 1 00:21:55.963 11:46:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:55.963 11:46:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:55.963 11:46:15 -- scripts/common.sh@364 -- # decimal 1 00:21:55.963 11:46:15 -- scripts/common.sh@352 -- # local d=1 00:21:55.963 11:46:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:55.963 11:46:15 -- scripts/common.sh@354 -- # echo 1 00:21:55.963 11:46:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:55.963 11:46:15 -- scripts/common.sh@365 -- # decimal 2 00:21:55.963 11:46:15 -- scripts/common.sh@352 -- # local d=2 00:21:55.963 11:46:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:55.963 11:46:15 -- scripts/common.sh@354 -- # echo 2 00:21:55.963 11:46:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:55.963 11:46:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:55.963 11:46:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:55.963 11:46:15 -- scripts/common.sh@367 -- # return 0 00:21:55.963 11:46:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:55.963 11:46:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:55.963 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:55.963 --rc genhtml_branch_coverage=1 00:21:55.963 --rc genhtml_function_coverage=1 00:21:55.963 --rc genhtml_legend=1 00:21:55.963 --rc geninfo_all_blocks=1 00:21:55.963 --rc geninfo_unexecuted_blocks=1 00:21:55.963 00:21:55.963 ' 00:21:55.963 11:46:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:55.963 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:55.963 --rc genhtml_branch_coverage=1 00:21:55.963 --rc genhtml_function_coverage=1 00:21:55.963 --rc genhtml_legend=1 00:21:55.963 --rc geninfo_all_blocks=1 00:21:55.963 --rc geninfo_unexecuted_blocks=1 00:21:55.963 00:21:55.963 ' 00:21:55.963 11:46:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:55.963 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:55.963 --rc genhtml_branch_coverage=1 00:21:55.963 --rc genhtml_function_coverage=1 00:21:55.963 --rc genhtml_legend=1 00:21:55.963 --rc geninfo_all_blocks=1 00:21:55.963 --rc geninfo_unexecuted_blocks=1 00:21:55.963 00:21:55.963 ' 00:21:55.963 11:46:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:55.963 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:55.963 --rc genhtml_branch_coverage=1 00:21:55.963 --rc genhtml_function_coverage=1 00:21:55.963 --rc genhtml_legend=1 00:21:55.963 --rc geninfo_all_blocks=1 00:21:55.963 --rc geninfo_unexecuted_blocks=1 00:21:55.963 00:21:55.963 ' 00:21:55.963 11:46:15 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:55.963 11:46:15 -- nvmf/common.sh@7 -- # uname -s 00:21:55.963 11:46:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:55.963 11:46:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:55.963 11:46:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:55.963 11:46:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:55.963 11:46:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:55.963 11:46:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:55.963 11:46:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:55.963 11:46:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:55.963 11:46:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:55.963 11:46:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:55.963 11:46:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:55.964 11:46:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:55.964 11:46:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:55.964 11:46:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:55.964 11:46:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:55.964 11:46:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:55.964 11:46:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:55.964 11:46:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:55.964 11:46:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:55.964 11:46:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:55.964 11:46:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:55.964 11:46:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:55.964 11:46:15 -- paths/export.sh@5 -- # export PATH 00:21:55.964 11:46:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:55.964 11:46:15 -- nvmf/common.sh@46 -- # : 0 00:21:55.964 11:46:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:55.964 11:46:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:55.964 11:46:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:55.964 11:46:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:55.964 11:46:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:55.964 11:46:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:55.964 11:46:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:55.964 11:46:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:55.964 11:46:15 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:55.964 11:46:15 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:55.964 11:46:15 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:21:55.964 11:46:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:21:55.964 11:46:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:55.964 11:46:15 -- common/autotest_common.sh@10 -- # set +x 00:21:55.964 ************************************ 00:21:55.964 START TEST nvmf_shutdown_tc1 00:21:55.964 ************************************ 00:21:55.964 11:46:15 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:21:55.964 11:46:15 -- target/shutdown.sh@74 -- # starttarget 00:21:55.964 11:46:15 -- target/shutdown.sh@15 -- # nvmftestinit 00:21:55.964 11:46:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:55.964 11:46:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:55.964 11:46:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:55.964 11:46:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:55.964 11:46:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:55.964 11:46:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:55.964 11:46:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:55.964 11:46:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:55.964 11:46:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:55.964 11:46:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:55.964 11:46:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:55.964 11:46:15 -- common/autotest_common.sh@10 -- # set +x 00:21:57.866 11:46:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:57.866 11:46:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:57.866 11:46:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:57.866 11:46:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:57.866 11:46:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:57.866 11:46:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:57.866 11:46:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:57.866 11:46:17 -- nvmf/common.sh@294 -- # net_devs=() 00:21:57.866 11:46:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:57.866 11:46:17 -- nvmf/common.sh@295 -- # e810=() 00:21:57.866 11:46:17 -- nvmf/common.sh@295 -- # local -ga e810 00:21:57.866 11:46:17 -- nvmf/common.sh@296 -- # x722=() 00:21:57.866 11:46:17 -- nvmf/common.sh@296 -- # local -ga x722 00:21:57.866 11:46:17 -- nvmf/common.sh@297 -- # mlx=() 00:21:57.866 11:46:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:57.866 11:46:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:57.866 11:46:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:57.866 11:46:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:57.866 11:46:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:57.866 11:46:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:57.866 11:46:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:57.866 11:46:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:57.866 11:46:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:57.866 11:46:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:57.866 11:46:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:57.866 11:46:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:57.866 11:46:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:57.866 11:46:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:57.866 11:46:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:57.866 11:46:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:57.866 11:46:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:57.866 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:57.866 11:46:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:57.866 11:46:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:57.866 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:57.866 11:46:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:57.866 11:46:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:57.866 11:46:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:57.866 11:46:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:57.866 11:46:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:57.866 11:46:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:57.866 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:57.866 11:46:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:57.866 11:46:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:57.866 11:46:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:57.866 11:46:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:57.866 11:46:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:57.866 11:46:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:57.866 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:57.866 11:46:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:57.866 11:46:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:57.866 11:46:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:57.866 11:46:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:57.866 11:46:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:57.866 11:46:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:57.866 11:46:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:57.866 11:46:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:57.866 11:46:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:57.866 11:46:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:57.866 11:46:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:57.866 11:46:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:57.866 11:46:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:57.866 11:46:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:57.866 11:46:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:57.866 11:46:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:57.866 11:46:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:57.866 11:46:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:58.124 11:46:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:58.124 11:46:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:58.124 11:46:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:58.124 11:46:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:58.124 11:46:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:58.124 11:46:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:58.124 11:46:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:58.124 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:58.124 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:21:58.124 00:21:58.124 --- 10.0.0.2 ping statistics --- 00:21:58.124 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:58.124 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:21:58.124 11:46:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:58.124 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:58.124 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:21:58.124 00:21:58.124 --- 10.0.0.1 ping statistics --- 00:21:58.124 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:58.124 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:21:58.124 11:46:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:58.124 11:46:18 -- nvmf/common.sh@410 -- # return 0 00:21:58.124 11:46:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:58.124 11:46:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:58.124 11:46:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:58.124 11:46:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:58.124 11:46:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:58.124 11:46:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:58.124 11:46:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:58.125 11:46:18 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:21:58.125 11:46:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:58.125 11:46:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:58.125 11:46:18 -- common/autotest_common.sh@10 -- # set +x 00:21:58.125 11:46:18 -- nvmf/common.sh@469 -- # nvmfpid=3871721 00:21:58.125 11:46:18 -- nvmf/common.sh@470 -- # waitforlisten 3871721 00:21:58.125 11:46:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:21:58.125 11:46:18 -- common/autotest_common.sh@829 -- # '[' -z 3871721 ']' 00:21:58.125 11:46:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:58.125 11:46:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:58.125 11:46:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:58.125 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:58.125 11:46:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:58.125 11:46:18 -- common/autotest_common.sh@10 -- # set +x 00:21:58.125 [2024-11-28 11:46:18.094334] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:58.125 [2024-11-28 11:46:18.094408] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:58.125 EAL: No free 2048 kB hugepages reported on node 1 00:21:58.125 [2024-11-28 11:46:18.162093] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:58.383 [2024-11-28 11:46:18.279643] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:58.383 [2024-11-28 11:46:18.279802] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:58.383 [2024-11-28 11:46:18.279829] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:58.383 [2024-11-28 11:46:18.279844] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:58.383 [2024-11-28 11:46:18.279952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:58.383 [2024-11-28 11:46:18.280065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:58.383 [2024-11-28 11:46:18.280124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:58.383 [2024-11-28 11:46:18.280126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:59.315 11:46:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:59.315 11:46:19 -- common/autotest_common.sh@862 -- # return 0 00:21:59.315 11:46:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:59.315 11:46:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:59.315 11:46:19 -- common/autotest_common.sh@10 -- # set +x 00:21:59.315 11:46:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:59.315 11:46:19 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:59.315 11:46:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.315 11:46:19 -- common/autotest_common.sh@10 -- # set +x 00:21:59.315 [2024-11-28 11:46:19.088110] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:59.315 11:46:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.315 11:46:19 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:21:59.315 11:46:19 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:21:59.315 11:46:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:59.315 11:46:19 -- common/autotest_common.sh@10 -- # set +x 00:21:59.315 11:46:19 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:59.316 11:46:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.316 11:46:19 -- target/shutdown.sh@28 -- # cat 00:21:59.316 11:46:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.316 11:46:19 -- target/shutdown.sh@28 -- # cat 00:21:59.316 11:46:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.316 11:46:19 -- target/shutdown.sh@28 -- # cat 00:21:59.316 11:46:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.316 11:46:19 -- target/shutdown.sh@28 -- # cat 00:21:59.316 11:46:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.316 11:46:19 -- target/shutdown.sh@28 -- # cat 00:21:59.316 11:46:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.316 11:46:19 -- target/shutdown.sh@28 -- # cat 00:21:59.316 11:46:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.316 11:46:19 -- target/shutdown.sh@28 -- # cat 00:21:59.316 11:46:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.316 11:46:19 -- target/shutdown.sh@28 -- # cat 00:21:59.316 11:46:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.316 11:46:19 -- target/shutdown.sh@28 -- # cat 00:21:59.316 11:46:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:59.316 11:46:19 -- target/shutdown.sh@28 -- # cat 00:21:59.316 11:46:19 -- target/shutdown.sh@35 -- # rpc_cmd 00:21:59.316 11:46:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.316 11:46:19 -- common/autotest_common.sh@10 -- # set +x 00:21:59.316 Malloc1 00:21:59.316 [2024-11-28 11:46:19.177693] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:59.316 Malloc2 00:21:59.316 Malloc3 00:21:59.316 Malloc4 00:21:59.316 Malloc5 00:21:59.574 Malloc6 00:21:59.574 Malloc7 00:21:59.574 Malloc8 00:21:59.574 Malloc9 00:21:59.574 Malloc10 00:21:59.574 11:46:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.574 11:46:19 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:21:59.574 11:46:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:59.574 11:46:19 -- common/autotest_common.sh@10 -- # set +x 00:21:59.833 11:46:19 -- target/shutdown.sh@78 -- # perfpid=3871921 00:21:59.833 11:46:19 -- target/shutdown.sh@79 -- # waitforlisten 3871921 /var/tmp/bdevperf.sock 00:21:59.833 11:46:19 -- common/autotest_common.sh@829 -- # '[' -z 3871921 ']' 00:21:59.833 11:46:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:59.833 11:46:19 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:21:59.833 11:46:19 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:59.833 11:46:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:59.833 11:46:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:59.833 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:59.833 11:46:19 -- nvmf/common.sh@520 -- # config=() 00:21:59.833 11:46:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:59.833 11:46:19 -- nvmf/common.sh@520 -- # local subsystem config 00:21:59.833 11:46:19 -- common/autotest_common.sh@10 -- # set +x 00:21:59.833 11:46:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:59.833 11:46:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:59.833 { 00:21:59.833 "params": { 00:21:59.833 "name": "Nvme$subsystem", 00:21:59.833 "trtype": "$TEST_TRANSPORT", 00:21:59.833 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:59.833 "adrfam": "ipv4", 00:21:59.833 "trsvcid": "$NVMF_PORT", 00:21:59.833 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:59.833 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:59.833 "hdgst": ${hdgst:-false}, 00:21:59.833 "ddgst": ${ddgst:-false} 00:21:59.833 }, 00:21:59.833 "method": "bdev_nvme_attach_controller" 00:21:59.833 } 00:21:59.833 EOF 00:21:59.833 )") 00:21:59.833 11:46:19 -- nvmf/common.sh@542 -- # cat 00:21:59.833 11:46:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:59.833 11:46:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:59.833 { 00:21:59.833 "params": { 00:21:59.833 "name": "Nvme$subsystem", 00:21:59.833 "trtype": "$TEST_TRANSPORT", 00:21:59.833 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:59.833 "adrfam": "ipv4", 00:21:59.833 "trsvcid": "$NVMF_PORT", 00:21:59.833 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:59.833 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:59.833 "hdgst": ${hdgst:-false}, 00:21:59.833 "ddgst": ${ddgst:-false} 00:21:59.833 }, 00:21:59.833 "method": "bdev_nvme_attach_controller" 00:21:59.833 } 00:21:59.833 EOF 00:21:59.833 )") 00:21:59.833 11:46:19 -- nvmf/common.sh@542 -- # cat 00:21:59.833 11:46:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:59.833 11:46:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:59.833 { 00:21:59.833 "params": { 00:21:59.833 "name": "Nvme$subsystem", 00:21:59.833 "trtype": "$TEST_TRANSPORT", 00:21:59.833 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:59.833 "adrfam": "ipv4", 00:21:59.833 "trsvcid": "$NVMF_PORT", 00:21:59.833 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:59.833 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:59.833 "hdgst": ${hdgst:-false}, 00:21:59.833 "ddgst": ${ddgst:-false} 00:21:59.833 }, 00:21:59.833 "method": "bdev_nvme_attach_controller" 00:21:59.833 } 00:21:59.833 EOF 00:21:59.833 )") 00:21:59.833 11:46:19 -- nvmf/common.sh@542 -- # cat 00:21:59.833 11:46:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:59.833 11:46:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:59.833 { 00:21:59.833 "params": { 00:21:59.833 "name": "Nvme$subsystem", 00:21:59.833 "trtype": "$TEST_TRANSPORT", 00:21:59.833 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:59.834 "adrfam": "ipv4", 00:21:59.834 "trsvcid": "$NVMF_PORT", 00:21:59.834 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:59.834 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:59.834 "hdgst": ${hdgst:-false}, 00:21:59.834 "ddgst": ${ddgst:-false} 00:21:59.834 }, 00:21:59.834 "method": "bdev_nvme_attach_controller" 00:21:59.834 } 00:21:59.834 EOF 00:21:59.834 )") 00:21:59.834 11:46:19 -- nvmf/common.sh@542 -- # cat 00:21:59.834 11:46:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:59.834 11:46:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:59.834 { 00:21:59.834 "params": { 00:21:59.834 "name": "Nvme$subsystem", 00:21:59.834 "trtype": "$TEST_TRANSPORT", 00:21:59.834 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:59.834 "adrfam": "ipv4", 00:21:59.834 "trsvcid": "$NVMF_PORT", 00:21:59.834 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:59.834 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:59.834 "hdgst": ${hdgst:-false}, 00:21:59.834 "ddgst": ${ddgst:-false} 00:21:59.834 }, 00:21:59.834 "method": "bdev_nvme_attach_controller" 00:21:59.834 } 00:21:59.834 EOF 00:21:59.834 )") 00:21:59.834 11:46:19 -- nvmf/common.sh@542 -- # cat 00:21:59.834 11:46:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:59.834 11:46:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:59.834 { 00:21:59.834 "params": { 00:21:59.834 "name": "Nvme$subsystem", 00:21:59.834 "trtype": "$TEST_TRANSPORT", 00:21:59.834 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:59.834 "adrfam": "ipv4", 00:21:59.834 "trsvcid": "$NVMF_PORT", 00:21:59.834 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:59.834 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:59.834 "hdgst": ${hdgst:-false}, 00:21:59.834 "ddgst": ${ddgst:-false} 00:21:59.834 }, 00:21:59.834 "method": "bdev_nvme_attach_controller" 00:21:59.834 } 00:21:59.834 EOF 00:21:59.834 )") 00:21:59.834 11:46:19 -- nvmf/common.sh@542 -- # cat 00:21:59.834 11:46:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:59.834 11:46:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:59.834 { 00:21:59.834 "params": { 00:21:59.834 "name": "Nvme$subsystem", 00:21:59.834 "trtype": "$TEST_TRANSPORT", 00:21:59.834 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:59.834 "adrfam": "ipv4", 00:21:59.834 "trsvcid": "$NVMF_PORT", 00:21:59.834 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:59.834 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:59.834 "hdgst": ${hdgst:-false}, 00:21:59.834 "ddgst": ${ddgst:-false} 00:21:59.834 }, 00:21:59.834 "method": "bdev_nvme_attach_controller" 00:21:59.834 } 00:21:59.834 EOF 00:21:59.834 )") 00:21:59.834 11:46:19 -- nvmf/common.sh@542 -- # cat 00:21:59.834 11:46:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:59.834 11:46:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:59.834 { 00:21:59.834 "params": { 00:21:59.834 "name": "Nvme$subsystem", 00:21:59.834 "trtype": "$TEST_TRANSPORT", 00:21:59.834 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:59.834 "adrfam": "ipv4", 00:21:59.834 "trsvcid": "$NVMF_PORT", 00:21:59.834 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:59.834 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:59.834 "hdgst": ${hdgst:-false}, 00:21:59.834 "ddgst": ${ddgst:-false} 00:21:59.834 }, 00:21:59.834 "method": "bdev_nvme_attach_controller" 00:21:59.834 } 00:21:59.834 EOF 00:21:59.834 )") 00:21:59.834 11:46:19 -- nvmf/common.sh@542 -- # cat 00:21:59.834 11:46:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:59.834 11:46:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:59.834 { 00:21:59.834 "params": { 00:21:59.834 "name": "Nvme$subsystem", 00:21:59.834 "trtype": "$TEST_TRANSPORT", 00:21:59.834 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:59.834 "adrfam": "ipv4", 00:21:59.834 "trsvcid": "$NVMF_PORT", 00:21:59.834 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:59.834 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:59.834 "hdgst": ${hdgst:-false}, 00:21:59.834 "ddgst": ${ddgst:-false} 00:21:59.834 }, 00:21:59.834 "method": "bdev_nvme_attach_controller" 00:21:59.834 } 00:21:59.834 EOF 00:21:59.834 )") 00:21:59.834 11:46:19 -- nvmf/common.sh@542 -- # cat 00:21:59.834 11:46:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:59.834 11:46:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:59.834 { 00:21:59.834 "params": { 00:21:59.834 "name": "Nvme$subsystem", 00:21:59.834 "trtype": "$TEST_TRANSPORT", 00:21:59.834 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:59.834 "adrfam": "ipv4", 00:21:59.834 "trsvcid": "$NVMF_PORT", 00:21:59.834 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:59.834 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:59.834 "hdgst": ${hdgst:-false}, 00:21:59.834 "ddgst": ${ddgst:-false} 00:21:59.834 }, 00:21:59.834 "method": "bdev_nvme_attach_controller" 00:21:59.834 } 00:21:59.834 EOF 00:21:59.834 )") 00:21:59.834 11:46:19 -- nvmf/common.sh@542 -- # cat 00:21:59.834 11:46:19 -- nvmf/common.sh@544 -- # jq . 00:21:59.834 11:46:19 -- nvmf/common.sh@545 -- # IFS=, 00:21:59.834 11:46:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:21:59.834 "params": { 00:21:59.834 "name": "Nvme1", 00:21:59.834 "trtype": "tcp", 00:21:59.834 "traddr": "10.0.0.2", 00:21:59.834 "adrfam": "ipv4", 00:21:59.834 "trsvcid": "4420", 00:21:59.834 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:59.834 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:59.834 "hdgst": false, 00:21:59.834 "ddgst": false 00:21:59.834 }, 00:21:59.834 "method": "bdev_nvme_attach_controller" 00:21:59.834 },{ 00:21:59.834 "params": { 00:21:59.834 "name": "Nvme2", 00:21:59.834 "trtype": "tcp", 00:21:59.834 "traddr": "10.0.0.2", 00:21:59.834 "adrfam": "ipv4", 00:21:59.834 "trsvcid": "4420", 00:21:59.834 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:59.834 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:59.834 "hdgst": false, 00:21:59.834 "ddgst": false 00:21:59.834 }, 00:21:59.834 "method": "bdev_nvme_attach_controller" 00:21:59.834 },{ 00:21:59.834 "params": { 00:21:59.834 "name": "Nvme3", 00:21:59.834 "trtype": "tcp", 00:21:59.834 "traddr": "10.0.0.2", 00:21:59.834 "adrfam": "ipv4", 00:21:59.834 "trsvcid": "4420", 00:21:59.834 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:59.834 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:59.834 "hdgst": false, 00:21:59.834 "ddgst": false 00:21:59.834 }, 00:21:59.834 "method": "bdev_nvme_attach_controller" 00:21:59.834 },{ 00:21:59.834 "params": { 00:21:59.834 "name": "Nvme4", 00:21:59.834 "trtype": "tcp", 00:21:59.834 "traddr": "10.0.0.2", 00:21:59.834 "adrfam": "ipv4", 00:21:59.834 "trsvcid": "4420", 00:21:59.834 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:59.834 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:59.834 "hdgst": false, 00:21:59.834 "ddgst": false 00:21:59.834 }, 00:21:59.834 "method": "bdev_nvme_attach_controller" 00:21:59.834 },{ 00:21:59.834 "params": { 00:21:59.834 "name": "Nvme5", 00:21:59.834 "trtype": "tcp", 00:21:59.834 "traddr": "10.0.0.2", 00:21:59.835 "adrfam": "ipv4", 00:21:59.835 "trsvcid": "4420", 00:21:59.835 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:59.835 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:59.835 "hdgst": false, 00:21:59.835 "ddgst": false 00:21:59.835 }, 00:21:59.835 "method": "bdev_nvme_attach_controller" 00:21:59.835 },{ 00:21:59.835 "params": { 00:21:59.835 "name": "Nvme6", 00:21:59.835 "trtype": "tcp", 00:21:59.835 "traddr": "10.0.0.2", 00:21:59.835 "adrfam": "ipv4", 00:21:59.835 "trsvcid": "4420", 00:21:59.835 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:59.835 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:59.835 "hdgst": false, 00:21:59.835 "ddgst": false 00:21:59.835 }, 00:21:59.835 "method": "bdev_nvme_attach_controller" 00:21:59.835 },{ 00:21:59.835 "params": { 00:21:59.835 "name": "Nvme7", 00:21:59.835 "trtype": "tcp", 00:21:59.835 "traddr": "10.0.0.2", 00:21:59.835 "adrfam": "ipv4", 00:21:59.835 "trsvcid": "4420", 00:21:59.835 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:59.835 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:59.835 "hdgst": false, 00:21:59.835 "ddgst": false 00:21:59.835 }, 00:21:59.835 "method": "bdev_nvme_attach_controller" 00:21:59.835 },{ 00:21:59.835 "params": { 00:21:59.835 "name": "Nvme8", 00:21:59.835 "trtype": "tcp", 00:21:59.835 "traddr": "10.0.0.2", 00:21:59.835 "adrfam": "ipv4", 00:21:59.835 "trsvcid": "4420", 00:21:59.835 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:59.835 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:59.835 "hdgst": false, 00:21:59.835 "ddgst": false 00:21:59.835 }, 00:21:59.835 "method": "bdev_nvme_attach_controller" 00:21:59.835 },{ 00:21:59.835 "params": { 00:21:59.835 "name": "Nvme9", 00:21:59.835 "trtype": "tcp", 00:21:59.835 "traddr": "10.0.0.2", 00:21:59.835 "adrfam": "ipv4", 00:21:59.835 "trsvcid": "4420", 00:21:59.835 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:59.835 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:59.835 "hdgst": false, 00:21:59.835 "ddgst": false 00:21:59.835 }, 00:21:59.835 "method": "bdev_nvme_attach_controller" 00:21:59.835 },{ 00:21:59.835 "params": { 00:21:59.835 "name": "Nvme10", 00:21:59.835 "trtype": "tcp", 00:21:59.835 "traddr": "10.0.0.2", 00:21:59.835 "adrfam": "ipv4", 00:21:59.835 "trsvcid": "4420", 00:21:59.835 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:59.835 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:59.835 "hdgst": false, 00:21:59.835 "ddgst": false 00:21:59.835 }, 00:21:59.835 "method": "bdev_nvme_attach_controller" 00:21:59.835 }' 00:21:59.835 [2024-11-28 11:46:19.694721] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:59.835 [2024-11-28 11:46:19.694798] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:21:59.835 EAL: No free 2048 kB hugepages reported on node 1 00:21:59.835 [2024-11-28 11:46:19.769488] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:00.093 [2024-11-28 11:46:19.904128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:02.622 11:46:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:02.622 11:46:22 -- common/autotest_common.sh@862 -- # return 0 00:22:02.622 11:46:22 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:02.622 11:46:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:02.622 11:46:22 -- common/autotest_common.sh@10 -- # set +x 00:22:02.622 11:46:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:02.622 11:46:22 -- target/shutdown.sh@83 -- # kill -9 3871921 00:22:02.622 11:46:22 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:02.622 11:46:22 -- target/shutdown.sh@87 -- # sleep 1 00:22:03.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 3871921 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:03.192 11:46:23 -- target/shutdown.sh@88 -- # kill -0 3871721 00:22:03.192 11:46:23 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:03.192 11:46:23 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:03.192 11:46:23 -- nvmf/common.sh@520 -- # config=() 00:22:03.192 11:46:23 -- nvmf/common.sh@520 -- # local subsystem config 00:22:03.192 11:46:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.192 11:46:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.192 { 00:22:03.192 "params": { 00:22:03.192 "name": "Nvme$subsystem", 00:22:03.192 "trtype": "$TEST_TRANSPORT", 00:22:03.192 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.192 "adrfam": "ipv4", 00:22:03.192 "trsvcid": "$NVMF_PORT", 00:22:03.192 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.192 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.192 "hdgst": ${hdgst:-false}, 00:22:03.192 "ddgst": ${ddgst:-false} 00:22:03.192 }, 00:22:03.192 "method": "bdev_nvme_attach_controller" 00:22:03.192 } 00:22:03.192 EOF 00:22:03.192 )") 00:22:03.192 11:46:23 -- nvmf/common.sh@542 -- # cat 00:22:03.192 11:46:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.192 11:46:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.192 { 00:22:03.192 "params": { 00:22:03.192 "name": "Nvme$subsystem", 00:22:03.192 "trtype": "$TEST_TRANSPORT", 00:22:03.192 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.192 "adrfam": "ipv4", 00:22:03.192 "trsvcid": "$NVMF_PORT", 00:22:03.192 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.192 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.192 "hdgst": ${hdgst:-false}, 00:22:03.192 "ddgst": ${ddgst:-false} 00:22:03.192 }, 00:22:03.192 "method": "bdev_nvme_attach_controller" 00:22:03.192 } 00:22:03.192 EOF 00:22:03.192 )") 00:22:03.192 11:46:23 -- nvmf/common.sh@542 -- # cat 00:22:03.192 11:46:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.192 11:46:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.192 { 00:22:03.192 "params": { 00:22:03.192 "name": "Nvme$subsystem", 00:22:03.192 "trtype": "$TEST_TRANSPORT", 00:22:03.192 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.192 "adrfam": "ipv4", 00:22:03.192 "trsvcid": "$NVMF_PORT", 00:22:03.192 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.192 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.192 "hdgst": ${hdgst:-false}, 00:22:03.192 "ddgst": ${ddgst:-false} 00:22:03.192 }, 00:22:03.192 "method": "bdev_nvme_attach_controller" 00:22:03.192 } 00:22:03.192 EOF 00:22:03.192 )") 00:22:03.192 11:46:23 -- nvmf/common.sh@542 -- # cat 00:22:03.192 11:46:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.192 11:46:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.192 { 00:22:03.192 "params": { 00:22:03.192 "name": "Nvme$subsystem", 00:22:03.192 "trtype": "$TEST_TRANSPORT", 00:22:03.192 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.192 "adrfam": "ipv4", 00:22:03.192 "trsvcid": "$NVMF_PORT", 00:22:03.192 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.192 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.192 "hdgst": ${hdgst:-false}, 00:22:03.192 "ddgst": ${ddgst:-false} 00:22:03.192 }, 00:22:03.192 "method": "bdev_nvme_attach_controller" 00:22:03.192 } 00:22:03.192 EOF 00:22:03.192 )") 00:22:03.193 11:46:23 -- nvmf/common.sh@542 -- # cat 00:22:03.193 11:46:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.193 11:46:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.193 { 00:22:03.193 "params": { 00:22:03.193 "name": "Nvme$subsystem", 00:22:03.193 "trtype": "$TEST_TRANSPORT", 00:22:03.193 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.193 "adrfam": "ipv4", 00:22:03.193 "trsvcid": "$NVMF_PORT", 00:22:03.193 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.193 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.193 "hdgst": ${hdgst:-false}, 00:22:03.193 "ddgst": ${ddgst:-false} 00:22:03.193 }, 00:22:03.193 "method": "bdev_nvme_attach_controller" 00:22:03.193 } 00:22:03.193 EOF 00:22:03.193 )") 00:22:03.193 11:46:23 -- nvmf/common.sh@542 -- # cat 00:22:03.193 11:46:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.193 11:46:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.193 { 00:22:03.193 "params": { 00:22:03.193 "name": "Nvme$subsystem", 00:22:03.193 "trtype": "$TEST_TRANSPORT", 00:22:03.193 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.193 "adrfam": "ipv4", 00:22:03.193 "trsvcid": "$NVMF_PORT", 00:22:03.193 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.193 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.193 "hdgst": ${hdgst:-false}, 00:22:03.193 "ddgst": ${ddgst:-false} 00:22:03.193 }, 00:22:03.193 "method": "bdev_nvme_attach_controller" 00:22:03.193 } 00:22:03.193 EOF 00:22:03.193 )") 00:22:03.193 11:46:23 -- nvmf/common.sh@542 -- # cat 00:22:03.193 11:46:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.193 11:46:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.193 { 00:22:03.193 "params": { 00:22:03.193 "name": "Nvme$subsystem", 00:22:03.193 "trtype": "$TEST_TRANSPORT", 00:22:03.193 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.193 "adrfam": "ipv4", 00:22:03.193 "trsvcid": "$NVMF_PORT", 00:22:03.193 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.193 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.193 "hdgst": ${hdgst:-false}, 00:22:03.193 "ddgst": ${ddgst:-false} 00:22:03.193 }, 00:22:03.193 "method": "bdev_nvme_attach_controller" 00:22:03.193 } 00:22:03.193 EOF 00:22:03.193 )") 00:22:03.193 11:46:23 -- nvmf/common.sh@542 -- # cat 00:22:03.193 11:46:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.193 11:46:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.193 { 00:22:03.193 "params": { 00:22:03.193 "name": "Nvme$subsystem", 00:22:03.193 "trtype": "$TEST_TRANSPORT", 00:22:03.193 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.193 "adrfam": "ipv4", 00:22:03.193 "trsvcid": "$NVMF_PORT", 00:22:03.193 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.193 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.193 "hdgst": ${hdgst:-false}, 00:22:03.193 "ddgst": ${ddgst:-false} 00:22:03.193 }, 00:22:03.193 "method": "bdev_nvme_attach_controller" 00:22:03.193 } 00:22:03.193 EOF 00:22:03.193 )") 00:22:03.193 11:46:23 -- nvmf/common.sh@542 -- # cat 00:22:03.193 11:46:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.193 11:46:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.193 { 00:22:03.193 "params": { 00:22:03.193 "name": "Nvme$subsystem", 00:22:03.193 "trtype": "$TEST_TRANSPORT", 00:22:03.193 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.193 "adrfam": "ipv4", 00:22:03.193 "trsvcid": "$NVMF_PORT", 00:22:03.193 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.193 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.193 "hdgst": ${hdgst:-false}, 00:22:03.193 "ddgst": ${ddgst:-false} 00:22:03.193 }, 00:22:03.193 "method": "bdev_nvme_attach_controller" 00:22:03.193 } 00:22:03.193 EOF 00:22:03.193 )") 00:22:03.193 11:46:23 -- nvmf/common.sh@542 -- # cat 00:22:03.193 11:46:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.193 11:46:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.193 { 00:22:03.193 "params": { 00:22:03.193 "name": "Nvme$subsystem", 00:22:03.193 "trtype": "$TEST_TRANSPORT", 00:22:03.193 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.193 "adrfam": "ipv4", 00:22:03.193 "trsvcid": "$NVMF_PORT", 00:22:03.193 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.193 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.193 "hdgst": ${hdgst:-false}, 00:22:03.193 "ddgst": ${ddgst:-false} 00:22:03.193 }, 00:22:03.193 "method": "bdev_nvme_attach_controller" 00:22:03.193 } 00:22:03.193 EOF 00:22:03.193 )") 00:22:03.452 11:46:23 -- nvmf/common.sh@542 -- # cat 00:22:03.452 11:46:23 -- nvmf/common.sh@544 -- # jq . 00:22:03.452 11:46:23 -- nvmf/common.sh@545 -- # IFS=, 00:22:03.452 11:46:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:03.452 "params": { 00:22:03.452 "name": "Nvme1", 00:22:03.452 "trtype": "tcp", 00:22:03.452 "traddr": "10.0.0.2", 00:22:03.452 "adrfam": "ipv4", 00:22:03.452 "trsvcid": "4420", 00:22:03.452 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:03.452 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:03.452 "hdgst": false, 00:22:03.453 "ddgst": false 00:22:03.453 }, 00:22:03.453 "method": "bdev_nvme_attach_controller" 00:22:03.453 },{ 00:22:03.453 "params": { 00:22:03.453 "name": "Nvme2", 00:22:03.453 "trtype": "tcp", 00:22:03.453 "traddr": "10.0.0.2", 00:22:03.453 "adrfam": "ipv4", 00:22:03.453 "trsvcid": "4420", 00:22:03.453 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:03.453 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:03.453 "hdgst": false, 00:22:03.453 "ddgst": false 00:22:03.453 }, 00:22:03.453 "method": "bdev_nvme_attach_controller" 00:22:03.453 },{ 00:22:03.453 "params": { 00:22:03.453 "name": "Nvme3", 00:22:03.453 "trtype": "tcp", 00:22:03.453 "traddr": "10.0.0.2", 00:22:03.453 "adrfam": "ipv4", 00:22:03.453 "trsvcid": "4420", 00:22:03.453 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:03.453 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:03.453 "hdgst": false, 00:22:03.453 "ddgst": false 00:22:03.453 }, 00:22:03.453 "method": "bdev_nvme_attach_controller" 00:22:03.453 },{ 00:22:03.453 "params": { 00:22:03.453 "name": "Nvme4", 00:22:03.453 "trtype": "tcp", 00:22:03.453 "traddr": "10.0.0.2", 00:22:03.453 "adrfam": "ipv4", 00:22:03.453 "trsvcid": "4420", 00:22:03.453 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:03.453 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:03.453 "hdgst": false, 00:22:03.453 "ddgst": false 00:22:03.453 }, 00:22:03.453 "method": "bdev_nvme_attach_controller" 00:22:03.453 },{ 00:22:03.453 "params": { 00:22:03.453 "name": "Nvme5", 00:22:03.453 "trtype": "tcp", 00:22:03.453 "traddr": "10.0.0.2", 00:22:03.453 "adrfam": "ipv4", 00:22:03.453 "trsvcid": "4420", 00:22:03.453 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:03.453 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:03.453 "hdgst": false, 00:22:03.453 "ddgst": false 00:22:03.453 }, 00:22:03.453 "method": "bdev_nvme_attach_controller" 00:22:03.453 },{ 00:22:03.453 "params": { 00:22:03.453 "name": "Nvme6", 00:22:03.453 "trtype": "tcp", 00:22:03.453 "traddr": "10.0.0.2", 00:22:03.453 "adrfam": "ipv4", 00:22:03.453 "trsvcid": "4420", 00:22:03.453 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:03.453 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:03.453 "hdgst": false, 00:22:03.453 "ddgst": false 00:22:03.453 }, 00:22:03.453 "method": "bdev_nvme_attach_controller" 00:22:03.453 },{ 00:22:03.453 "params": { 00:22:03.453 "name": "Nvme7", 00:22:03.453 "trtype": "tcp", 00:22:03.453 "traddr": "10.0.0.2", 00:22:03.453 "adrfam": "ipv4", 00:22:03.453 "trsvcid": "4420", 00:22:03.453 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:03.453 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:03.453 "hdgst": false, 00:22:03.453 "ddgst": false 00:22:03.453 }, 00:22:03.453 "method": "bdev_nvme_attach_controller" 00:22:03.453 },{ 00:22:03.453 "params": { 00:22:03.453 "name": "Nvme8", 00:22:03.453 "trtype": "tcp", 00:22:03.453 "traddr": "10.0.0.2", 00:22:03.453 "adrfam": "ipv4", 00:22:03.453 "trsvcid": "4420", 00:22:03.453 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:03.453 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:03.453 "hdgst": false, 00:22:03.453 "ddgst": false 00:22:03.453 }, 00:22:03.453 "method": "bdev_nvme_attach_controller" 00:22:03.453 },{ 00:22:03.453 "params": { 00:22:03.453 "name": "Nvme9", 00:22:03.453 "trtype": "tcp", 00:22:03.453 "traddr": "10.0.0.2", 00:22:03.453 "adrfam": "ipv4", 00:22:03.453 "trsvcid": "4420", 00:22:03.453 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:03.453 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:03.453 "hdgst": false, 00:22:03.453 "ddgst": false 00:22:03.453 }, 00:22:03.453 "method": "bdev_nvme_attach_controller" 00:22:03.453 },{ 00:22:03.453 "params": { 00:22:03.453 "name": "Nvme10", 00:22:03.453 "trtype": "tcp", 00:22:03.453 "traddr": "10.0.0.2", 00:22:03.453 "adrfam": "ipv4", 00:22:03.453 "trsvcid": "4420", 00:22:03.453 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:03.453 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:03.453 "hdgst": false, 00:22:03.453 "ddgst": false 00:22:03.453 }, 00:22:03.453 "method": "bdev_nvme_attach_controller" 00:22:03.453 }' 00:22:03.453 [2024-11-28 11:46:23.256028] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:03.453 [2024-11-28 11:46:23.256114] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3872359 ] 00:22:03.453 EAL: No free 2048 kB hugepages reported on node 1 00:22:03.453 [2024-11-28 11:46:23.323293] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:03.453 [2024-11-28 11:46:23.433213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:04.829 Running I/O for 1 seconds... 00:22:06.202 00:22:06.202 Latency(us) 00:22:06.202 [2024-11-28T10:46:26.258Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:06.202 [2024-11-28T10:46:26.258Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.202 Verification LBA range: start 0x0 length 0x400 00:22:06.202 Nvme1n1 : 1.09 399.42 24.96 0.00 0.00 156814.48 23981.32 124275.67 00:22:06.202 [2024-11-28T10:46:26.258Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.202 Verification LBA range: start 0x0 length 0x400 00:22:06.202 Nvme2n1 : 1.08 368.65 23.04 0.00 0.00 168514.24 33787.45 161558.38 00:22:06.202 [2024-11-28T10:46:26.258Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.202 Verification LBA range: start 0x0 length 0x400 00:22:06.202 Nvme3n1 : 1.09 398.41 24.90 0.00 0.00 155515.40 19223.89 118838.61 00:22:06.202 [2024-11-28T10:46:26.258Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.202 Verification LBA range: start 0x0 length 0x400 00:22:06.202 Nvme4n1 : 1.09 397.96 24.87 0.00 0.00 153956.02 24855.13 121945.51 00:22:06.202 [2024-11-28T10:46:26.258Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.202 Verification LBA range: start 0x0 length 0x400 00:22:06.202 Nvme5n1 : 1.10 396.16 24.76 0.00 0.00 153809.16 23010.42 119615.34 00:22:06.202 [2024-11-28T10:46:26.258Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.202 Verification LBA range: start 0x0 length 0x400 00:22:06.202 Nvme6n1 : 1.11 392.36 24.52 0.00 0.00 155248.96 13592.65 128936.01 00:22:06.202 [2024-11-28T10:46:26.258Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.202 Verification LBA range: start 0x0 length 0x400 00:22:06.202 Nvme7n1 : 1.10 395.19 24.70 0.00 0.00 152052.58 22622.06 118838.61 00:22:06.202 [2024-11-28T10:46:26.258Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.202 Verification LBA range: start 0x0 length 0x400 00:22:06.202 Nvme8n1 : 1.10 394.08 24.63 0.00 0.00 151899.79 18641.35 125052.40 00:22:06.202 [2024-11-28T10:46:26.258Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.202 Verification LBA range: start 0x0 length 0x400 00:22:06.202 Nvme9n1 : 1.10 393.13 24.57 0.00 0.00 151206.06 18641.35 125052.40 00:22:06.202 [2024-11-28T10:46:26.258Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.202 Verification LBA range: start 0x0 length 0x400 00:22:06.202 Nvme10n1 : 1.11 414.78 25.92 0.00 0.00 143344.41 3398.16 125052.40 00:22:06.202 [2024-11-28T10:46:26.258Z] =================================================================================================================== 00:22:06.202 [2024-11-28T10:46:26.258Z] Total : 3950.16 246.88 0.00 0.00 154052.00 3398.16 161558.38 00:22:06.460 11:46:26 -- target/shutdown.sh@93 -- # stoptarget 00:22:06.460 11:46:26 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:06.460 11:46:26 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:06.460 11:46:26 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:06.460 11:46:26 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:06.460 11:46:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:06.460 11:46:26 -- nvmf/common.sh@116 -- # sync 00:22:06.460 11:46:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:06.460 11:46:26 -- nvmf/common.sh@119 -- # set +e 00:22:06.460 11:46:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:06.460 11:46:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:06.460 rmmod nvme_tcp 00:22:06.460 rmmod nvme_fabrics 00:22:06.460 rmmod nvme_keyring 00:22:06.460 11:46:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:06.460 11:46:26 -- nvmf/common.sh@123 -- # set -e 00:22:06.460 11:46:26 -- nvmf/common.sh@124 -- # return 0 00:22:06.460 11:46:26 -- nvmf/common.sh@477 -- # '[' -n 3871721 ']' 00:22:06.460 11:46:26 -- nvmf/common.sh@478 -- # killprocess 3871721 00:22:06.460 11:46:26 -- common/autotest_common.sh@936 -- # '[' -z 3871721 ']' 00:22:06.460 11:46:26 -- common/autotest_common.sh@940 -- # kill -0 3871721 00:22:06.460 11:46:26 -- common/autotest_common.sh@941 -- # uname 00:22:06.460 11:46:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:06.460 11:46:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3871721 00:22:06.460 11:46:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:06.460 11:46:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:06.460 11:46:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3871721' 00:22:06.460 killing process with pid 3871721 00:22:06.460 11:46:26 -- common/autotest_common.sh@955 -- # kill 3871721 00:22:06.460 11:46:26 -- common/autotest_common.sh@960 -- # wait 3871721 00:22:07.026 11:46:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:07.026 11:46:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:07.026 11:46:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:07.026 11:46:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:07.026 11:46:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:07.026 11:46:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:07.026 11:46:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:07.026 11:46:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:08.933 11:46:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:08.933 00:22:08.933 real 0m13.161s 00:22:08.933 user 0m40.294s 00:22:08.933 sys 0m3.386s 00:22:08.933 11:46:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:08.933 11:46:28 -- common/autotest_common.sh@10 -- # set +x 00:22:08.933 ************************************ 00:22:08.933 END TEST nvmf_shutdown_tc1 00:22:08.933 ************************************ 00:22:09.192 11:46:29 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:09.192 11:46:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:09.192 11:46:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:09.192 11:46:29 -- common/autotest_common.sh@10 -- # set +x 00:22:09.192 ************************************ 00:22:09.192 START TEST nvmf_shutdown_tc2 00:22:09.192 ************************************ 00:22:09.192 11:46:29 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:09.192 11:46:29 -- target/shutdown.sh@98 -- # starttarget 00:22:09.192 11:46:29 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:09.192 11:46:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:09.192 11:46:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:09.192 11:46:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:09.192 11:46:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:09.192 11:46:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:09.192 11:46:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:09.192 11:46:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:09.192 11:46:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:09.192 11:46:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:09.192 11:46:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:09.192 11:46:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:09.192 11:46:29 -- common/autotest_common.sh@10 -- # set +x 00:22:09.192 11:46:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:09.192 11:46:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:09.192 11:46:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:09.192 11:46:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:09.192 11:46:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:09.192 11:46:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:09.192 11:46:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:09.192 11:46:29 -- nvmf/common.sh@294 -- # net_devs=() 00:22:09.192 11:46:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:09.192 11:46:29 -- nvmf/common.sh@295 -- # e810=() 00:22:09.192 11:46:29 -- nvmf/common.sh@295 -- # local -ga e810 00:22:09.192 11:46:29 -- nvmf/common.sh@296 -- # x722=() 00:22:09.192 11:46:29 -- nvmf/common.sh@296 -- # local -ga x722 00:22:09.192 11:46:29 -- nvmf/common.sh@297 -- # mlx=() 00:22:09.192 11:46:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:09.192 11:46:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:09.192 11:46:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:09.192 11:46:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:09.192 11:46:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:09.192 11:46:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:09.193 11:46:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:09.193 11:46:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:09.193 11:46:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:09.193 11:46:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:09.193 11:46:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:09.193 11:46:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:09.193 11:46:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:09.193 11:46:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:09.193 11:46:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:09.193 11:46:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:09.193 11:46:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:09.193 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:09.193 11:46:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:09.193 11:46:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:09.193 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:09.193 11:46:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:09.193 11:46:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:09.193 11:46:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:09.193 11:46:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:09.193 11:46:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:09.193 11:46:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:09.193 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:09.193 11:46:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:09.193 11:46:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:09.193 11:46:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:09.193 11:46:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:09.193 11:46:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:09.193 11:46:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:09.193 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:09.193 11:46:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:09.193 11:46:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:09.193 11:46:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:09.193 11:46:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:09.193 11:46:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:09.193 11:46:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:09.193 11:46:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:09.193 11:46:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:09.193 11:46:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:09.193 11:46:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:09.193 11:46:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:09.193 11:46:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:09.193 11:46:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:09.193 11:46:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:09.193 11:46:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:09.193 11:46:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:09.193 11:46:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:09.193 11:46:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:09.193 11:46:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:09.193 11:46:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:09.193 11:46:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:09.193 11:46:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:09.193 11:46:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:09.193 11:46:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:09.193 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:09.193 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:22:09.193 00:22:09.193 --- 10.0.0.2 ping statistics --- 00:22:09.193 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:09.193 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:22:09.193 11:46:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:09.193 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:09.193 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.131 ms 00:22:09.193 00:22:09.193 --- 10.0.0.1 ping statistics --- 00:22:09.193 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:09.193 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:22:09.193 11:46:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:09.193 11:46:29 -- nvmf/common.sh@410 -- # return 0 00:22:09.193 11:46:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:09.193 11:46:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:09.193 11:46:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:09.193 11:46:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:09.193 11:46:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:09.193 11:46:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:09.193 11:46:29 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:09.193 11:46:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:09.193 11:46:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:09.193 11:46:29 -- common/autotest_common.sh@10 -- # set +x 00:22:09.193 11:46:29 -- nvmf/common.sh@469 -- # nvmfpid=3873262 00:22:09.193 11:46:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:09.193 11:46:29 -- nvmf/common.sh@470 -- # waitforlisten 3873262 00:22:09.193 11:46:29 -- common/autotest_common.sh@829 -- # '[' -z 3873262 ']' 00:22:09.193 11:46:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:09.193 11:46:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:09.193 11:46:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:09.193 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:09.193 11:46:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:09.193 11:46:29 -- common/autotest_common.sh@10 -- # set +x 00:22:09.193 [2024-11-28 11:46:29.217485] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:09.193 [2024-11-28 11:46:29.217571] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:09.451 EAL: No free 2048 kB hugepages reported on node 1 00:22:09.451 [2024-11-28 11:46:29.285336] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:09.451 [2024-11-28 11:46:29.401990] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:09.451 [2024-11-28 11:46:29.402155] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:09.451 [2024-11-28 11:46:29.402175] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:09.451 [2024-11-28 11:46:29.402189] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:09.451 [2024-11-28 11:46:29.402248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:09.451 [2024-11-28 11:46:29.402317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:09.451 [2024-11-28 11:46:29.402388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:09.451 [2024-11-28 11:46:29.402392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:10.384 11:46:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:10.384 11:46:30 -- common/autotest_common.sh@862 -- # return 0 00:22:10.384 11:46:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:10.384 11:46:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:10.384 11:46:30 -- common/autotest_common.sh@10 -- # set +x 00:22:10.384 11:46:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:10.384 11:46:30 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:10.384 11:46:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.384 11:46:30 -- common/autotest_common.sh@10 -- # set +x 00:22:10.385 [2024-11-28 11:46:30.256226] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:10.385 11:46:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.385 11:46:30 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:10.385 11:46:30 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:10.385 11:46:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:10.385 11:46:30 -- common/autotest_common.sh@10 -- # set +x 00:22:10.385 11:46:30 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:10.385 11:46:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.385 11:46:30 -- target/shutdown.sh@28 -- # cat 00:22:10.385 11:46:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.385 11:46:30 -- target/shutdown.sh@28 -- # cat 00:22:10.385 11:46:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.385 11:46:30 -- target/shutdown.sh@28 -- # cat 00:22:10.385 11:46:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.385 11:46:30 -- target/shutdown.sh@28 -- # cat 00:22:10.385 11:46:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.385 11:46:30 -- target/shutdown.sh@28 -- # cat 00:22:10.385 11:46:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.385 11:46:30 -- target/shutdown.sh@28 -- # cat 00:22:10.385 11:46:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.385 11:46:30 -- target/shutdown.sh@28 -- # cat 00:22:10.385 11:46:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.385 11:46:30 -- target/shutdown.sh@28 -- # cat 00:22:10.385 11:46:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.385 11:46:30 -- target/shutdown.sh@28 -- # cat 00:22:10.385 11:46:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.385 11:46:30 -- target/shutdown.sh@28 -- # cat 00:22:10.385 11:46:30 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:10.385 11:46:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.385 11:46:30 -- common/autotest_common.sh@10 -- # set +x 00:22:10.385 Malloc1 00:22:10.385 [2024-11-28 11:46:30.332083] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:10.385 Malloc2 00:22:10.385 Malloc3 00:22:10.643 Malloc4 00:22:10.643 Malloc5 00:22:10.643 Malloc6 00:22:10.643 Malloc7 00:22:10.643 Malloc8 00:22:10.643 Malloc9 00:22:10.902 Malloc10 00:22:10.902 11:46:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.902 11:46:30 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:10.902 11:46:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:10.902 11:46:30 -- common/autotest_common.sh@10 -- # set +x 00:22:10.902 11:46:30 -- target/shutdown.sh@102 -- # perfpid=3873458 00:22:10.902 11:46:30 -- target/shutdown.sh@103 -- # waitforlisten 3873458 /var/tmp/bdevperf.sock 00:22:10.902 11:46:30 -- common/autotest_common.sh@829 -- # '[' -z 3873458 ']' 00:22:10.902 11:46:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:10.902 11:46:30 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:10.902 11:46:30 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:10.902 11:46:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:10.902 11:46:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:10.902 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:10.902 11:46:30 -- nvmf/common.sh@520 -- # config=() 00:22:10.902 11:46:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:10.902 11:46:30 -- nvmf/common.sh@520 -- # local subsystem config 00:22:10.902 11:46:30 -- common/autotest_common.sh@10 -- # set +x 00:22:10.902 11:46:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.902 11:46:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.902 { 00:22:10.902 "params": { 00:22:10.902 "name": "Nvme$subsystem", 00:22:10.902 "trtype": "$TEST_TRANSPORT", 00:22:10.902 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.902 "adrfam": "ipv4", 00:22:10.902 "trsvcid": "$NVMF_PORT", 00:22:10.902 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.902 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.902 "hdgst": ${hdgst:-false}, 00:22:10.902 "ddgst": ${ddgst:-false} 00:22:10.902 }, 00:22:10.902 "method": "bdev_nvme_attach_controller" 00:22:10.902 } 00:22:10.902 EOF 00:22:10.902 )") 00:22:10.902 11:46:30 -- nvmf/common.sh@542 -- # cat 00:22:10.902 11:46:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.902 11:46:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.902 { 00:22:10.902 "params": { 00:22:10.902 "name": "Nvme$subsystem", 00:22:10.902 "trtype": "$TEST_TRANSPORT", 00:22:10.902 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.902 "adrfam": "ipv4", 00:22:10.902 "trsvcid": "$NVMF_PORT", 00:22:10.902 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.902 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.902 "hdgst": ${hdgst:-false}, 00:22:10.902 "ddgst": ${ddgst:-false} 00:22:10.902 }, 00:22:10.902 "method": "bdev_nvme_attach_controller" 00:22:10.902 } 00:22:10.902 EOF 00:22:10.902 )") 00:22:10.902 11:46:30 -- nvmf/common.sh@542 -- # cat 00:22:10.902 11:46:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.902 11:46:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.902 { 00:22:10.902 "params": { 00:22:10.902 "name": "Nvme$subsystem", 00:22:10.902 "trtype": "$TEST_TRANSPORT", 00:22:10.902 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.902 "adrfam": "ipv4", 00:22:10.902 "trsvcid": "$NVMF_PORT", 00:22:10.902 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.902 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.902 "hdgst": ${hdgst:-false}, 00:22:10.902 "ddgst": ${ddgst:-false} 00:22:10.902 }, 00:22:10.902 "method": "bdev_nvme_attach_controller" 00:22:10.902 } 00:22:10.902 EOF 00:22:10.902 )") 00:22:10.902 11:46:30 -- nvmf/common.sh@542 -- # cat 00:22:10.902 11:46:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.902 11:46:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.902 { 00:22:10.902 "params": { 00:22:10.902 "name": "Nvme$subsystem", 00:22:10.902 "trtype": "$TEST_TRANSPORT", 00:22:10.902 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.902 "adrfam": "ipv4", 00:22:10.902 "trsvcid": "$NVMF_PORT", 00:22:10.902 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.902 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.902 "hdgst": ${hdgst:-false}, 00:22:10.902 "ddgst": ${ddgst:-false} 00:22:10.902 }, 00:22:10.902 "method": "bdev_nvme_attach_controller" 00:22:10.902 } 00:22:10.902 EOF 00:22:10.902 )") 00:22:10.902 11:46:30 -- nvmf/common.sh@542 -- # cat 00:22:10.902 11:46:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.902 11:46:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.902 { 00:22:10.902 "params": { 00:22:10.902 "name": "Nvme$subsystem", 00:22:10.902 "trtype": "$TEST_TRANSPORT", 00:22:10.902 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "$NVMF_PORT", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.903 "hdgst": ${hdgst:-false}, 00:22:10.903 "ddgst": ${ddgst:-false} 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 } 00:22:10.903 EOF 00:22:10.903 )") 00:22:10.903 11:46:30 -- nvmf/common.sh@542 -- # cat 00:22:10.903 11:46:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.903 11:46:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.903 { 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme$subsystem", 00:22:10.903 "trtype": "$TEST_TRANSPORT", 00:22:10.903 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "$NVMF_PORT", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.903 "hdgst": ${hdgst:-false}, 00:22:10.903 "ddgst": ${ddgst:-false} 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 } 00:22:10.903 EOF 00:22:10.903 )") 00:22:10.903 11:46:30 -- nvmf/common.sh@542 -- # cat 00:22:10.903 11:46:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.903 11:46:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.903 { 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme$subsystem", 00:22:10.903 "trtype": "$TEST_TRANSPORT", 00:22:10.903 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "$NVMF_PORT", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.903 "hdgst": ${hdgst:-false}, 00:22:10.903 "ddgst": ${ddgst:-false} 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 } 00:22:10.903 EOF 00:22:10.903 )") 00:22:10.903 11:46:30 -- nvmf/common.sh@542 -- # cat 00:22:10.903 11:46:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.903 11:46:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.903 { 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme$subsystem", 00:22:10.903 "trtype": "$TEST_TRANSPORT", 00:22:10.903 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "$NVMF_PORT", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.903 "hdgst": ${hdgst:-false}, 00:22:10.903 "ddgst": ${ddgst:-false} 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 } 00:22:10.903 EOF 00:22:10.903 )") 00:22:10.903 11:46:30 -- nvmf/common.sh@542 -- # cat 00:22:10.903 11:46:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.903 11:46:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.903 { 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme$subsystem", 00:22:10.903 "trtype": "$TEST_TRANSPORT", 00:22:10.903 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "$NVMF_PORT", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.903 "hdgst": ${hdgst:-false}, 00:22:10.903 "ddgst": ${ddgst:-false} 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 } 00:22:10.903 EOF 00:22:10.903 )") 00:22:10.903 11:46:30 -- nvmf/common.sh@542 -- # cat 00:22:10.903 11:46:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.903 11:46:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.903 { 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme$subsystem", 00:22:10.903 "trtype": "$TEST_TRANSPORT", 00:22:10.903 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "$NVMF_PORT", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.903 "hdgst": ${hdgst:-false}, 00:22:10.903 "ddgst": ${ddgst:-false} 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 } 00:22:10.903 EOF 00:22:10.903 )") 00:22:10.903 11:46:30 -- nvmf/common.sh@542 -- # cat 00:22:10.903 11:46:30 -- nvmf/common.sh@544 -- # jq . 00:22:10.903 11:46:30 -- nvmf/common.sh@545 -- # IFS=, 00:22:10.903 11:46:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme1", 00:22:10.903 "trtype": "tcp", 00:22:10.903 "traddr": "10.0.0.2", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "4420", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:10.903 "hdgst": false, 00:22:10.903 "ddgst": false 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 },{ 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme2", 00:22:10.903 "trtype": "tcp", 00:22:10.903 "traddr": "10.0.0.2", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "4420", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:10.903 "hdgst": false, 00:22:10.903 "ddgst": false 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 },{ 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme3", 00:22:10.903 "trtype": "tcp", 00:22:10.903 "traddr": "10.0.0.2", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "4420", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:10.903 "hdgst": false, 00:22:10.903 "ddgst": false 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 },{ 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme4", 00:22:10.903 "trtype": "tcp", 00:22:10.903 "traddr": "10.0.0.2", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "4420", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:10.903 "hdgst": false, 00:22:10.903 "ddgst": false 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 },{ 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme5", 00:22:10.903 "trtype": "tcp", 00:22:10.903 "traddr": "10.0.0.2", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "4420", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:10.903 "hdgst": false, 00:22:10.903 "ddgst": false 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 },{ 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme6", 00:22:10.903 "trtype": "tcp", 00:22:10.903 "traddr": "10.0.0.2", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "4420", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:10.903 "hdgst": false, 00:22:10.903 "ddgst": false 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 },{ 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme7", 00:22:10.903 "trtype": "tcp", 00:22:10.903 "traddr": "10.0.0.2", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "4420", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:10.903 "hdgst": false, 00:22:10.903 "ddgst": false 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 },{ 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme8", 00:22:10.903 "trtype": "tcp", 00:22:10.903 "traddr": "10.0.0.2", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "4420", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:10.903 "hdgst": false, 00:22:10.903 "ddgst": false 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 },{ 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme9", 00:22:10.903 "trtype": "tcp", 00:22:10.903 "traddr": "10.0.0.2", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "4420", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:10.903 "hdgst": false, 00:22:10.903 "ddgst": false 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 },{ 00:22:10.903 "params": { 00:22:10.903 "name": "Nvme10", 00:22:10.903 "trtype": "tcp", 00:22:10.903 "traddr": "10.0.0.2", 00:22:10.903 "adrfam": "ipv4", 00:22:10.903 "trsvcid": "4420", 00:22:10.903 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:10.903 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:10.903 "hdgst": false, 00:22:10.903 "ddgst": false 00:22:10.903 }, 00:22:10.903 "method": "bdev_nvme_attach_controller" 00:22:10.903 }' 00:22:10.903 [2024-11-28 11:46:30.822026] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:10.903 [2024-11-28 11:46:30.822101] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3873458 ] 00:22:10.903 EAL: No free 2048 kB hugepages reported on node 1 00:22:10.904 [2024-11-28 11:46:30.884935] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:11.162 [2024-11-28 11:46:30.994774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:12.534 Running I/O for 10 seconds... 00:22:12.792 11:46:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:12.792 11:46:32 -- common/autotest_common.sh@862 -- # return 0 00:22:12.792 11:46:32 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:12.792 11:46:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.792 11:46:32 -- common/autotest_common.sh@10 -- # set +x 00:22:12.792 11:46:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.792 11:46:32 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:12.792 11:46:32 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:12.792 11:46:32 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:12.792 11:46:32 -- target/shutdown.sh@57 -- # local ret=1 00:22:12.792 11:46:32 -- target/shutdown.sh@58 -- # local i 00:22:12.792 11:46:32 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:12.792 11:46:32 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:12.792 11:46:32 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:12.792 11:46:32 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:12.792 11:46:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.792 11:46:32 -- common/autotest_common.sh@10 -- # set +x 00:22:12.792 11:46:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.792 11:46:32 -- target/shutdown.sh@60 -- # read_io_count=3 00:22:12.792 11:46:32 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:22:12.792 11:46:32 -- target/shutdown.sh@67 -- # sleep 0.25 00:22:13.050 11:46:32 -- target/shutdown.sh@59 -- # (( i-- )) 00:22:13.050 11:46:32 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:13.050 11:46:32 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:13.050 11:46:32 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:13.050 11:46:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.050 11:46:32 -- common/autotest_common.sh@10 -- # set +x 00:22:13.050 11:46:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.050 11:46:32 -- target/shutdown.sh@60 -- # read_io_count=129 00:22:13.050 11:46:32 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:22:13.050 11:46:32 -- target/shutdown.sh@64 -- # ret=0 00:22:13.050 11:46:33 -- target/shutdown.sh@65 -- # break 00:22:13.050 11:46:33 -- target/shutdown.sh@69 -- # return 0 00:22:13.050 11:46:33 -- target/shutdown.sh@109 -- # killprocess 3873458 00:22:13.050 11:46:33 -- common/autotest_common.sh@936 -- # '[' -z 3873458 ']' 00:22:13.050 11:46:33 -- common/autotest_common.sh@940 -- # kill -0 3873458 00:22:13.050 11:46:33 -- common/autotest_common.sh@941 -- # uname 00:22:13.050 11:46:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:13.050 11:46:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3873458 00:22:13.050 11:46:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:13.050 11:46:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:13.050 11:46:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3873458' 00:22:13.050 killing process with pid 3873458 00:22:13.050 11:46:33 -- common/autotest_common.sh@955 -- # kill 3873458 00:22:13.050 11:46:33 -- common/autotest_common.sh@960 -- # wait 3873458 00:22:13.308 Received shutdown signal, test time was about 0.545256 seconds 00:22:13.308 00:22:13.308 Latency(us) 00:22:13.308 [2024-11-28T10:46:33.364Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:13.308 [2024-11-28T10:46:33.364Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.308 Verification LBA range: start 0x0 length 0x400 00:22:13.308 Nvme1n1 : 0.54 424.31 26.52 0.00 0.00 146072.04 17476.27 121168.78 00:22:13.308 [2024-11-28T10:46:33.364Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.308 Verification LBA range: start 0x0 length 0x400 00:22:13.308 Nvme2n1 : 0.54 423.30 26.46 0.00 0.00 144378.92 17573.36 119615.34 00:22:13.308 [2024-11-28T10:46:33.364Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.308 Verification LBA range: start 0x0 length 0x400 00:22:13.308 Nvme3n1 : 0.54 422.30 26.39 0.00 0.00 142699.42 16893.72 118061.89 00:22:13.308 [2024-11-28T10:46:33.364Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.308 Verification LBA range: start 0x0 length 0x400 00:22:13.308 Nvme4n1 : 0.54 421.26 26.33 0.00 0.00 140970.53 17282.09 117285.17 00:22:13.308 [2024-11-28T10:46:33.364Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.308 Verification LBA range: start 0x0 length 0x400 00:22:13.308 Nvme5n1 : 0.54 418.80 26.17 0.00 0.00 139496.29 18155.90 118838.61 00:22:13.308 [2024-11-28T10:46:33.364Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.308 Verification LBA range: start 0x0 length 0x400 00:22:13.308 Nvme6n1 : 0.51 375.15 23.45 0.00 0.00 151004.14 26796.94 118838.61 00:22:13.308 [2024-11-28T10:46:33.365Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.309 Verification LBA range: start 0x0 length 0x400 00:22:13.309 Nvme7n1 : 0.51 371.92 23.25 0.00 0.00 149829.86 27379.48 123498.95 00:22:13.309 [2024-11-28T10:46:33.365Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.309 Verification LBA range: start 0x0 length 0x400 00:22:13.309 Nvme8n1 : 0.52 368.36 23.02 0.00 0.00 149517.13 24855.13 126605.84 00:22:13.309 [2024-11-28T10:46:33.365Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.309 Verification LBA range: start 0x0 length 0x400 00:22:13.309 Nvme9n1 : 0.53 360.14 22.51 0.00 0.00 149167.60 27185.30 125829.12 00:22:13.309 [2024-11-28T10:46:33.365Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.309 Verification LBA range: start 0x0 length 0x400 00:22:13.309 Nvme10n1 : 0.53 361.77 22.61 0.00 0.00 146828.96 3131.16 126605.84 00:22:13.309 [2024-11-28T10:46:33.365Z] =================================================================================================================== 00:22:13.309 [2024-11-28T10:46:33.365Z] Total : 3947.32 246.71 0.00 0.00 145700.02 3131.16 126605.84 00:22:13.567 11:46:33 -- target/shutdown.sh@112 -- # sleep 1 00:22:14.500 11:46:34 -- target/shutdown.sh@113 -- # kill -0 3873262 00:22:14.500 11:46:34 -- target/shutdown.sh@115 -- # stoptarget 00:22:14.500 11:46:34 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:14.500 11:46:34 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:14.500 11:46:34 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:14.500 11:46:34 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:14.500 11:46:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:14.500 11:46:34 -- nvmf/common.sh@116 -- # sync 00:22:14.500 11:46:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:14.500 11:46:34 -- nvmf/common.sh@119 -- # set +e 00:22:14.500 11:46:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:14.500 11:46:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:14.500 rmmod nvme_tcp 00:22:14.500 rmmod nvme_fabrics 00:22:14.500 rmmod nvme_keyring 00:22:14.500 11:46:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:14.500 11:46:34 -- nvmf/common.sh@123 -- # set -e 00:22:14.500 11:46:34 -- nvmf/common.sh@124 -- # return 0 00:22:14.500 11:46:34 -- nvmf/common.sh@477 -- # '[' -n 3873262 ']' 00:22:14.500 11:46:34 -- nvmf/common.sh@478 -- # killprocess 3873262 00:22:14.500 11:46:34 -- common/autotest_common.sh@936 -- # '[' -z 3873262 ']' 00:22:14.500 11:46:34 -- common/autotest_common.sh@940 -- # kill -0 3873262 00:22:14.500 11:46:34 -- common/autotest_common.sh@941 -- # uname 00:22:14.500 11:46:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:14.500 11:46:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3873262 00:22:14.500 11:46:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:14.500 11:46:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:14.500 11:46:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3873262' 00:22:14.500 killing process with pid 3873262 00:22:14.500 11:46:34 -- common/autotest_common.sh@955 -- # kill 3873262 00:22:14.500 11:46:34 -- common/autotest_common.sh@960 -- # wait 3873262 00:22:15.066 11:46:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:15.066 11:46:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:15.066 11:46:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:15.066 11:46:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:15.066 11:46:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:15.066 11:46:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:15.066 11:46:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:15.066 11:46:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.601 11:46:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:17.601 00:22:17.601 real 0m8.118s 00:22:17.601 user 0m25.100s 00:22:17.601 sys 0m1.449s 00:22:17.601 11:46:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:17.601 11:46:37 -- common/autotest_common.sh@10 -- # set +x 00:22:17.601 ************************************ 00:22:17.601 END TEST nvmf_shutdown_tc2 00:22:17.601 ************************************ 00:22:17.601 11:46:37 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:17.601 11:46:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:17.601 11:46:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:17.601 11:46:37 -- common/autotest_common.sh@10 -- # set +x 00:22:17.601 ************************************ 00:22:17.601 START TEST nvmf_shutdown_tc3 00:22:17.601 ************************************ 00:22:17.601 11:46:37 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:17.601 11:46:37 -- target/shutdown.sh@120 -- # starttarget 00:22:17.601 11:46:37 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:17.601 11:46:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:17.601 11:46:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:17.601 11:46:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:17.601 11:46:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:17.601 11:46:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:17.601 11:46:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:17.601 11:46:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:17.601 11:46:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.601 11:46:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:17.601 11:46:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:17.601 11:46:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:17.601 11:46:37 -- common/autotest_common.sh@10 -- # set +x 00:22:17.601 11:46:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:17.601 11:46:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:17.601 11:46:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:17.601 11:46:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:17.601 11:46:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:17.601 11:46:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:17.601 11:46:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:17.601 11:46:37 -- nvmf/common.sh@294 -- # net_devs=() 00:22:17.601 11:46:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:17.601 11:46:37 -- nvmf/common.sh@295 -- # e810=() 00:22:17.601 11:46:37 -- nvmf/common.sh@295 -- # local -ga e810 00:22:17.601 11:46:37 -- nvmf/common.sh@296 -- # x722=() 00:22:17.601 11:46:37 -- nvmf/common.sh@296 -- # local -ga x722 00:22:17.601 11:46:37 -- nvmf/common.sh@297 -- # mlx=() 00:22:17.601 11:46:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:17.601 11:46:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:17.601 11:46:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:17.601 11:46:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:17.601 11:46:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:17.601 11:46:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:17.601 11:46:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:17.601 11:46:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:17.601 11:46:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:17.601 11:46:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:17.601 11:46:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:17.601 11:46:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:17.601 11:46:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:17.601 11:46:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:17.601 11:46:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:17.601 11:46:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:17.601 11:46:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:17.601 11:46:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:17.601 11:46:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.601 11:46:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:17.601 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:17.601 11:46:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.601 11:46:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.602 11:46:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:17.602 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:17.602 11:46:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:17.602 11:46:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.602 11:46:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.602 11:46:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.602 11:46:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.602 11:46:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:17.602 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:17.602 11:46:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.602 11:46:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.602 11:46:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.602 11:46:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.602 11:46:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.602 11:46:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:17.602 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:17.602 11:46:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.602 11:46:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:17.602 11:46:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:17.602 11:46:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:17.602 11:46:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:17.602 11:46:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:17.602 11:46:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:17.602 11:46:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:17.602 11:46:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:17.602 11:46:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:17.602 11:46:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:17.602 11:46:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:17.602 11:46:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:17.602 11:46:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:17.602 11:46:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:17.602 11:46:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:17.602 11:46:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:17.602 11:46:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:17.602 11:46:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:17.602 11:46:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:17.602 11:46:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:17.602 11:46:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:17.602 11:46:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:17.602 11:46:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:17.602 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:17.602 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.143 ms 00:22:17.602 00:22:17.602 --- 10.0.0.2 ping statistics --- 00:22:17.602 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:17.602 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:22:17.602 11:46:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:17.602 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:17.602 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:22:17.602 00:22:17.602 --- 10.0.0.1 ping statistics --- 00:22:17.602 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:17.602 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:22:17.602 11:46:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:17.602 11:46:37 -- nvmf/common.sh@410 -- # return 0 00:22:17.602 11:46:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:17.602 11:46:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:17.602 11:46:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:17.602 11:46:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:17.602 11:46:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:17.602 11:46:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:17.602 11:46:37 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:17.602 11:46:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:17.602 11:46:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:17.602 11:46:37 -- common/autotest_common.sh@10 -- # set +x 00:22:17.602 11:46:37 -- nvmf/common.sh@469 -- # nvmfpid=3874389 00:22:17.602 11:46:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:17.602 11:46:37 -- nvmf/common.sh@470 -- # waitforlisten 3874389 00:22:17.602 11:46:37 -- common/autotest_common.sh@829 -- # '[' -z 3874389 ']' 00:22:17.602 11:46:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:17.602 11:46:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:17.602 11:46:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:17.602 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:17.602 11:46:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:17.602 11:46:37 -- common/autotest_common.sh@10 -- # set +x 00:22:17.602 [2024-11-28 11:46:37.345743] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:17.602 [2024-11-28 11:46:37.345813] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:17.602 EAL: No free 2048 kB hugepages reported on node 1 00:22:17.602 [2024-11-28 11:46:37.411842] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:17.602 [2024-11-28 11:46:37.520145] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:17.602 [2024-11-28 11:46:37.520300] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:17.602 [2024-11-28 11:46:37.520324] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:17.602 [2024-11-28 11:46:37.520336] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:17.602 [2024-11-28 11:46:37.520421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:17.602 [2024-11-28 11:46:37.520485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:17.602 [2024-11-28 11:46:37.520543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:17.602 [2024-11-28 11:46:37.520546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:18.537 11:46:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:18.537 11:46:38 -- common/autotest_common.sh@862 -- # return 0 00:22:18.537 11:46:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:18.537 11:46:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:18.537 11:46:38 -- common/autotest_common.sh@10 -- # set +x 00:22:18.537 11:46:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:18.537 11:46:38 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:18.537 11:46:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.537 11:46:38 -- common/autotest_common.sh@10 -- # set +x 00:22:18.537 [2024-11-28 11:46:38.410306] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:18.537 11:46:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.537 11:46:38 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:18.537 11:46:38 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:18.537 11:46:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:18.537 11:46:38 -- common/autotest_common.sh@10 -- # set +x 00:22:18.537 11:46:38 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:18.537 11:46:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.537 11:46:38 -- target/shutdown.sh@28 -- # cat 00:22:18.537 11:46:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.537 11:46:38 -- target/shutdown.sh@28 -- # cat 00:22:18.537 11:46:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.537 11:46:38 -- target/shutdown.sh@28 -- # cat 00:22:18.537 11:46:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.537 11:46:38 -- target/shutdown.sh@28 -- # cat 00:22:18.537 11:46:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.537 11:46:38 -- target/shutdown.sh@28 -- # cat 00:22:18.537 11:46:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.537 11:46:38 -- target/shutdown.sh@28 -- # cat 00:22:18.537 11:46:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.537 11:46:38 -- target/shutdown.sh@28 -- # cat 00:22:18.537 11:46:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.537 11:46:38 -- target/shutdown.sh@28 -- # cat 00:22:18.537 11:46:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.537 11:46:38 -- target/shutdown.sh@28 -- # cat 00:22:18.537 11:46:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:18.537 11:46:38 -- target/shutdown.sh@28 -- # cat 00:22:18.537 11:46:38 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:18.537 11:46:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.537 11:46:38 -- common/autotest_common.sh@10 -- # set +x 00:22:18.537 Malloc1 00:22:18.537 [2024-11-28 11:46:38.499448] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:18.537 Malloc2 00:22:18.537 Malloc3 00:22:18.796 Malloc4 00:22:18.796 Malloc5 00:22:18.796 Malloc6 00:22:18.796 Malloc7 00:22:18.796 Malloc8 00:22:19.054 Malloc9 00:22:19.054 Malloc10 00:22:19.054 11:46:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.054 11:46:38 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:19.054 11:46:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:19.054 11:46:38 -- common/autotest_common.sh@10 -- # set +x 00:22:19.054 11:46:38 -- target/shutdown.sh@124 -- # perfpid=3874586 00:22:19.054 11:46:38 -- target/shutdown.sh@125 -- # waitforlisten 3874586 /var/tmp/bdevperf.sock 00:22:19.054 11:46:38 -- common/autotest_common.sh@829 -- # '[' -z 3874586 ']' 00:22:19.054 11:46:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:19.054 11:46:38 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:19.054 11:46:38 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:19.054 11:46:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:19.055 11:46:38 -- nvmf/common.sh@520 -- # config=() 00:22:19.055 11:46:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:19.055 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:19.055 11:46:38 -- nvmf/common.sh@520 -- # local subsystem config 00:22:19.055 11:46:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:19.055 11:46:38 -- common/autotest_common.sh@10 -- # set +x 00:22:19.055 11:46:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.055 { 00:22:19.055 "params": { 00:22:19.055 "name": "Nvme$subsystem", 00:22:19.055 "trtype": "$TEST_TRANSPORT", 00:22:19.055 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.055 "adrfam": "ipv4", 00:22:19.055 "trsvcid": "$NVMF_PORT", 00:22:19.055 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.055 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.055 "hdgst": ${hdgst:-false}, 00:22:19.055 "ddgst": ${ddgst:-false} 00:22:19.055 }, 00:22:19.055 "method": "bdev_nvme_attach_controller" 00:22:19.055 } 00:22:19.055 EOF 00:22:19.055 )") 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # cat 00:22:19.055 11:46:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.055 { 00:22:19.055 "params": { 00:22:19.055 "name": "Nvme$subsystem", 00:22:19.055 "trtype": "$TEST_TRANSPORT", 00:22:19.055 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.055 "adrfam": "ipv4", 00:22:19.055 "trsvcid": "$NVMF_PORT", 00:22:19.055 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.055 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.055 "hdgst": ${hdgst:-false}, 00:22:19.055 "ddgst": ${ddgst:-false} 00:22:19.055 }, 00:22:19.055 "method": "bdev_nvme_attach_controller" 00:22:19.055 } 00:22:19.055 EOF 00:22:19.055 )") 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # cat 00:22:19.055 11:46:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.055 { 00:22:19.055 "params": { 00:22:19.055 "name": "Nvme$subsystem", 00:22:19.055 "trtype": "$TEST_TRANSPORT", 00:22:19.055 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.055 "adrfam": "ipv4", 00:22:19.055 "trsvcid": "$NVMF_PORT", 00:22:19.055 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.055 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.055 "hdgst": ${hdgst:-false}, 00:22:19.055 "ddgst": ${ddgst:-false} 00:22:19.055 }, 00:22:19.055 "method": "bdev_nvme_attach_controller" 00:22:19.055 } 00:22:19.055 EOF 00:22:19.055 )") 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # cat 00:22:19.055 11:46:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.055 { 00:22:19.055 "params": { 00:22:19.055 "name": "Nvme$subsystem", 00:22:19.055 "trtype": "$TEST_TRANSPORT", 00:22:19.055 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.055 "adrfam": "ipv4", 00:22:19.055 "trsvcid": "$NVMF_PORT", 00:22:19.055 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.055 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.055 "hdgst": ${hdgst:-false}, 00:22:19.055 "ddgst": ${ddgst:-false} 00:22:19.055 }, 00:22:19.055 "method": "bdev_nvme_attach_controller" 00:22:19.055 } 00:22:19.055 EOF 00:22:19.055 )") 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # cat 00:22:19.055 11:46:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.055 { 00:22:19.055 "params": { 00:22:19.055 "name": "Nvme$subsystem", 00:22:19.055 "trtype": "$TEST_TRANSPORT", 00:22:19.055 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.055 "adrfam": "ipv4", 00:22:19.055 "trsvcid": "$NVMF_PORT", 00:22:19.055 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.055 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.055 "hdgst": ${hdgst:-false}, 00:22:19.055 "ddgst": ${ddgst:-false} 00:22:19.055 }, 00:22:19.055 "method": "bdev_nvme_attach_controller" 00:22:19.055 } 00:22:19.055 EOF 00:22:19.055 )") 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # cat 00:22:19.055 11:46:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.055 { 00:22:19.055 "params": { 00:22:19.055 "name": "Nvme$subsystem", 00:22:19.055 "trtype": "$TEST_TRANSPORT", 00:22:19.055 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.055 "adrfam": "ipv4", 00:22:19.055 "trsvcid": "$NVMF_PORT", 00:22:19.055 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.055 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.055 "hdgst": ${hdgst:-false}, 00:22:19.055 "ddgst": ${ddgst:-false} 00:22:19.055 }, 00:22:19.055 "method": "bdev_nvme_attach_controller" 00:22:19.055 } 00:22:19.055 EOF 00:22:19.055 )") 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # cat 00:22:19.055 11:46:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.055 { 00:22:19.055 "params": { 00:22:19.055 "name": "Nvme$subsystem", 00:22:19.055 "trtype": "$TEST_TRANSPORT", 00:22:19.055 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.055 "adrfam": "ipv4", 00:22:19.055 "trsvcid": "$NVMF_PORT", 00:22:19.055 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.055 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.055 "hdgst": ${hdgst:-false}, 00:22:19.055 "ddgst": ${ddgst:-false} 00:22:19.055 }, 00:22:19.055 "method": "bdev_nvme_attach_controller" 00:22:19.055 } 00:22:19.055 EOF 00:22:19.055 )") 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # cat 00:22:19.055 11:46:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.055 { 00:22:19.055 "params": { 00:22:19.055 "name": "Nvme$subsystem", 00:22:19.055 "trtype": "$TEST_TRANSPORT", 00:22:19.055 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.055 "adrfam": "ipv4", 00:22:19.055 "trsvcid": "$NVMF_PORT", 00:22:19.055 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.055 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.055 "hdgst": ${hdgst:-false}, 00:22:19.055 "ddgst": ${ddgst:-false} 00:22:19.055 }, 00:22:19.055 "method": "bdev_nvme_attach_controller" 00:22:19.055 } 00:22:19.055 EOF 00:22:19.055 )") 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # cat 00:22:19.055 11:46:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.055 { 00:22:19.055 "params": { 00:22:19.055 "name": "Nvme$subsystem", 00:22:19.055 "trtype": "$TEST_TRANSPORT", 00:22:19.055 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.055 "adrfam": "ipv4", 00:22:19.055 "trsvcid": "$NVMF_PORT", 00:22:19.055 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.055 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.055 "hdgst": ${hdgst:-false}, 00:22:19.055 "ddgst": ${ddgst:-false} 00:22:19.055 }, 00:22:19.055 "method": "bdev_nvme_attach_controller" 00:22:19.055 } 00:22:19.055 EOF 00:22:19.055 )") 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # cat 00:22:19.055 11:46:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.055 { 00:22:19.055 "params": { 00:22:19.055 "name": "Nvme$subsystem", 00:22:19.055 "trtype": "$TEST_TRANSPORT", 00:22:19.055 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.055 "adrfam": "ipv4", 00:22:19.055 "trsvcid": "$NVMF_PORT", 00:22:19.055 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.055 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.055 "hdgst": ${hdgst:-false}, 00:22:19.055 "ddgst": ${ddgst:-false} 00:22:19.055 }, 00:22:19.055 "method": "bdev_nvme_attach_controller" 00:22:19.055 } 00:22:19.055 EOF 00:22:19.055 )") 00:22:19.055 11:46:38 -- nvmf/common.sh@542 -- # cat 00:22:19.055 11:46:38 -- nvmf/common.sh@544 -- # jq . 00:22:19.055 11:46:38 -- nvmf/common.sh@545 -- # IFS=, 00:22:19.055 11:46:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:19.055 "params": { 00:22:19.055 "name": "Nvme1", 00:22:19.055 "trtype": "tcp", 00:22:19.055 "traddr": "10.0.0.2", 00:22:19.055 "adrfam": "ipv4", 00:22:19.055 "trsvcid": "4420", 00:22:19.055 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:19.055 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:19.055 "hdgst": false, 00:22:19.055 "ddgst": false 00:22:19.055 }, 00:22:19.055 "method": "bdev_nvme_attach_controller" 00:22:19.055 },{ 00:22:19.055 "params": { 00:22:19.055 "name": "Nvme2", 00:22:19.055 "trtype": "tcp", 00:22:19.055 "traddr": "10.0.0.2", 00:22:19.055 "adrfam": "ipv4", 00:22:19.055 "trsvcid": "4420", 00:22:19.055 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:19.055 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:19.055 "hdgst": false, 00:22:19.055 "ddgst": false 00:22:19.055 }, 00:22:19.055 "method": "bdev_nvme_attach_controller" 00:22:19.055 },{ 00:22:19.055 "params": { 00:22:19.055 "name": "Nvme3", 00:22:19.055 "trtype": "tcp", 00:22:19.055 "traddr": "10.0.0.2", 00:22:19.056 "adrfam": "ipv4", 00:22:19.056 "trsvcid": "4420", 00:22:19.056 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:19.056 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:19.056 "hdgst": false, 00:22:19.056 "ddgst": false 00:22:19.056 }, 00:22:19.056 "method": "bdev_nvme_attach_controller" 00:22:19.056 },{ 00:22:19.056 "params": { 00:22:19.056 "name": "Nvme4", 00:22:19.056 "trtype": "tcp", 00:22:19.056 "traddr": "10.0.0.2", 00:22:19.056 "adrfam": "ipv4", 00:22:19.056 "trsvcid": "4420", 00:22:19.056 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:19.056 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:19.056 "hdgst": false, 00:22:19.056 "ddgst": false 00:22:19.056 }, 00:22:19.056 "method": "bdev_nvme_attach_controller" 00:22:19.056 },{ 00:22:19.056 "params": { 00:22:19.056 "name": "Nvme5", 00:22:19.056 "trtype": "tcp", 00:22:19.056 "traddr": "10.0.0.2", 00:22:19.056 "adrfam": "ipv4", 00:22:19.056 "trsvcid": "4420", 00:22:19.056 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:19.056 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:19.056 "hdgst": false, 00:22:19.056 "ddgst": false 00:22:19.056 }, 00:22:19.056 "method": "bdev_nvme_attach_controller" 00:22:19.056 },{ 00:22:19.056 "params": { 00:22:19.056 "name": "Nvme6", 00:22:19.056 "trtype": "tcp", 00:22:19.056 "traddr": "10.0.0.2", 00:22:19.056 "adrfam": "ipv4", 00:22:19.056 "trsvcid": "4420", 00:22:19.056 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:19.056 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:19.056 "hdgst": false, 00:22:19.056 "ddgst": false 00:22:19.056 }, 00:22:19.056 "method": "bdev_nvme_attach_controller" 00:22:19.056 },{ 00:22:19.056 "params": { 00:22:19.056 "name": "Nvme7", 00:22:19.056 "trtype": "tcp", 00:22:19.056 "traddr": "10.0.0.2", 00:22:19.056 "adrfam": "ipv4", 00:22:19.056 "trsvcid": "4420", 00:22:19.056 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:19.056 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:19.056 "hdgst": false, 00:22:19.056 "ddgst": false 00:22:19.056 }, 00:22:19.056 "method": "bdev_nvme_attach_controller" 00:22:19.056 },{ 00:22:19.056 "params": { 00:22:19.056 "name": "Nvme8", 00:22:19.056 "trtype": "tcp", 00:22:19.056 "traddr": "10.0.0.2", 00:22:19.056 "adrfam": "ipv4", 00:22:19.056 "trsvcid": "4420", 00:22:19.056 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:19.056 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:19.056 "hdgst": false, 00:22:19.056 "ddgst": false 00:22:19.056 }, 00:22:19.056 "method": "bdev_nvme_attach_controller" 00:22:19.056 },{ 00:22:19.056 "params": { 00:22:19.056 "name": "Nvme9", 00:22:19.056 "trtype": "tcp", 00:22:19.056 "traddr": "10.0.0.2", 00:22:19.056 "adrfam": "ipv4", 00:22:19.056 "trsvcid": "4420", 00:22:19.056 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:19.056 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:19.056 "hdgst": false, 00:22:19.056 "ddgst": false 00:22:19.056 }, 00:22:19.056 "method": "bdev_nvme_attach_controller" 00:22:19.056 },{ 00:22:19.056 "params": { 00:22:19.056 "name": "Nvme10", 00:22:19.056 "trtype": "tcp", 00:22:19.056 "traddr": "10.0.0.2", 00:22:19.056 "adrfam": "ipv4", 00:22:19.056 "trsvcid": "4420", 00:22:19.056 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:19.056 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:19.056 "hdgst": false, 00:22:19.056 "ddgst": false 00:22:19.056 }, 00:22:19.056 "method": "bdev_nvme_attach_controller" 00:22:19.056 }' 00:22:19.056 [2024-11-28 11:46:38.995260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:19.056 [2024-11-28 11:46:38.995335] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3874586 ] 00:22:19.056 EAL: No free 2048 kB hugepages reported on node 1 00:22:19.056 [2024-11-28 11:46:39.057997] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:19.314 [2024-11-28 11:46:39.166785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:20.689 Running I/O for 10 seconds... 00:22:20.689 11:46:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:20.689 11:46:40 -- common/autotest_common.sh@862 -- # return 0 00:22:20.689 11:46:40 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:20.689 11:46:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.689 11:46:40 -- common/autotest_common.sh@10 -- # set +x 00:22:20.947 11:46:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.948 11:46:40 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:20.948 11:46:40 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:20.948 11:46:40 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:20.948 11:46:40 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:20.948 11:46:40 -- target/shutdown.sh@57 -- # local ret=1 00:22:20.948 11:46:40 -- target/shutdown.sh@58 -- # local i 00:22:20.948 11:46:40 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:20.948 11:46:40 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:20.948 11:46:40 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:20.948 11:46:40 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:20.948 11:46:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.948 11:46:40 -- common/autotest_common.sh@10 -- # set +x 00:22:20.948 11:46:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.948 11:46:40 -- target/shutdown.sh@60 -- # read_io_count=3 00:22:20.948 11:46:40 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:22:20.948 11:46:40 -- target/shutdown.sh@67 -- # sleep 0.25 00:22:21.217 11:46:41 -- target/shutdown.sh@59 -- # (( i-- )) 00:22:21.217 11:46:41 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:21.217 11:46:41 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:21.217 11:46:41 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:21.217 11:46:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:21.217 11:46:41 -- common/autotest_common.sh@10 -- # set +x 00:22:21.217 11:46:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:21.218 11:46:41 -- target/shutdown.sh@60 -- # read_io_count=129 00:22:21.218 11:46:41 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:22:21.218 11:46:41 -- target/shutdown.sh@64 -- # ret=0 00:22:21.218 11:46:41 -- target/shutdown.sh@65 -- # break 00:22:21.218 11:46:41 -- target/shutdown.sh@69 -- # return 0 00:22:21.218 11:46:41 -- target/shutdown.sh@134 -- # killprocess 3874389 00:22:21.218 11:46:41 -- common/autotest_common.sh@936 -- # '[' -z 3874389 ']' 00:22:21.218 11:46:41 -- common/autotest_common.sh@940 -- # kill -0 3874389 00:22:21.218 11:46:41 -- common/autotest_common.sh@941 -- # uname 00:22:21.218 11:46:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:21.218 11:46:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3874389 00:22:21.218 11:46:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:21.218 11:46:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:21.218 11:46:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3874389' 00:22:21.218 killing process with pid 3874389 00:22:21.218 11:46:41 -- common/autotest_common.sh@955 -- # kill 3874389 00:22:21.218 11:46:41 -- common/autotest_common.sh@960 -- # wait 3874389 00:22:21.218 [2024-11-28 11:46:41.159573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.159991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.160444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9cb0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.162298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e7c40 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.162986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e80d0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.163339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8580 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.163376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8580 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.164726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.164754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.164769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.164781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.164793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.218 [2024-11-28 11:46:41.164804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.164996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165132] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.165476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e8ee0 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.219 [2024-11-28 11:46:41.166918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.166934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.166945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.166957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.166968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.166980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.166991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167095] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.167332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9370 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168502] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.220 [2024-11-28 11:46:41.168658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.168841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e9800 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.194041] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194135] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194163] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194191] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194217] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf3b490 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.194291] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194339] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194367] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194394] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a3c70 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.194469] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194505] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194550] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194582] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf19690 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.194655] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194690] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194718] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194744] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a4150 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.194821] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194856] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194882] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194908] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.194921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.194934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x108f0a0 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.194980] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.195001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.195015] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.195028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.195042] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.195055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.195068] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.195081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.195093] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf46590 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.195139] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.195159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.195174] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.195187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.195200] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.195213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.195226] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.195244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.221 [2024-11-28 11:46:41.195257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x109ea60 is same with the state(5) to be set 00:22:21.221 [2024-11-28 11:46:41.195303] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.221 [2024-11-28 11:46:41.195324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195338] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.222 [2024-11-28 11:46:41.195351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195364] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.222 [2024-11-28 11:46:41.195377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195391] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.222 [2024-11-28 11:46:41.195403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf101b0 is same with the state(5) to be set 00:22:21.222 [2024-11-28 11:46:41.195459] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.222 [2024-11-28 11:46:41.195479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195494] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.222 [2024-11-28 11:46:41.195508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195521] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.222 [2024-11-28 11:46:41.195544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195558] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.222 [2024-11-28 11:46:41.195570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10b4600 is same with the state(5) to be set 00:22:21.222 [2024-11-28 11:46:41.195629] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.222 [2024-11-28 11:46:41.195651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195666] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.222 [2024-11-28 11:46:41.195679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195692] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.222 [2024-11-28 11:46:41.195705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195722] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.222 [2024-11-28 11:46:41.195736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xeedf70 is same with the state(5) to be set 00:22:21.222 [2024-11-28 11:46:41.195846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.195868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.195911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.195942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.195972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.195987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.222 [2024-11-28 11:46:41.196474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.222 [2024-11-28 11:46:41.196488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.196974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.196990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.223 [2024-11-28 11:46:41.197677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.223 [2024-11-28 11:46:41.197690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.197714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.197728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.197744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.197757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.197771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.197785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.197799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1132260 is same with the state(5) to be set 00:22:21.224 [2024-11-28 11:46:41.197887] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1132260 was disconnected and freed. reset controller. 00:22:21.224 [2024-11-28 11:46:41.197954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.197975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.197996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.198983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.224 [2024-11-28 11:46:41.198996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.224 [2024-11-28 11:46:41.199012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.199850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.199864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xede550 is same with the state(5) to be set 00:22:21.225 [2024-11-28 11:46:41.199937] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xede550 was disconnected and freed. reset controller. 00:22:21.225 [2024-11-28 11:46:41.199986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.200007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.200026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.200041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.200058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.200071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.200086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.200099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.200115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.200128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.200143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.200156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.200181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.200196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.200212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.200225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.200241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.200254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.200269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.225 [2024-11-28 11:46:41.200283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.225 [2024-11-28 11:46:41.200298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.200980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.200994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.201009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.201022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.201037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.201050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.201065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.201078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.201093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.201106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.201121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.201135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.201150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.201163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.201178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.201191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.201207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.201220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.201235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.201248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.201263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.201277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.226 [2024-11-28 11:46:41.201295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.226 [2024-11-28 11:46:41.201309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.201860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.201945] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x107a1a0 was disconnected and freed. reset controller. 00:22:21.227 [2024-11-28 11:46:41.202005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.227 [2024-11-28 11:46:41.202590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.227 [2024-11-28 11:46:41.202605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.202620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.202634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.202650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.202663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.202679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.202692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.202708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.202721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.202737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.202750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.202766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.202779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.202794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.202807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.202823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.202836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.202852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.202865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.202881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.202898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.202914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.202928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.202943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.202957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.202972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.202986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.228 [2024-11-28 11:46:41.203797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.228 [2024-11-28 11:46:41.203810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.203825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.203839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.203854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.203868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.203883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.203897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.203912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.203925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.203940] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x107b6f0 is same with the state(5) to be set 00:22:21.229 [2024-11-28 11:46:41.204013] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x107b6f0 was disconnected and freed. reset controller. 00:22:21.229 [2024-11-28 11:46:41.204067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.204088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.204108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.204123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.204144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.204158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.204174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.204187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.204202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.204215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.204231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.204244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.204259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.204273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.204288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.204301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.204316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.204330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.204345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.204358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.204373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.204386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.210975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.210989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.211005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.229 [2024-11-28 11:46:41.211018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.229 [2024-11-28 11:46:41.211034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.211915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.211930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x113d950 is same with the state(5) to be set 00:22:21.230 [2024-11-28 11:46:41.212034] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x113d950 was disconnected and freed. reset controller. 00:22:21.230 [2024-11-28 11:46:41.212561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf3b490 (9): Bad file descriptor 00:22:21.230 [2024-11-28 11:46:41.212601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10a3c70 (9): Bad file descriptor 00:22:21.230 [2024-11-28 11:46:41.212628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf19690 (9): Bad file descriptor 00:22:21.230 [2024-11-28 11:46:41.212652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10a4150 (9): Bad file descriptor 00:22:21.230 [2024-11-28 11:46:41.212674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x108f0a0 (9): Bad file descriptor 00:22:21.230 [2024-11-28 11:46:41.212697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf46590 (9): Bad file descriptor 00:22:21.230 [2024-11-28 11:46:41.212720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x109ea60 (9): Bad file descriptor 00:22:21.230 [2024-11-28 11:46:41.212742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf101b0 (9): Bad file descriptor 00:22:21.230 [2024-11-28 11:46:41.212765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10b4600 (9): Bad file descriptor 00:22:21.230 [2024-11-28 11:46:41.212787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xeedf70 (9): Bad file descriptor 00:22:21.230 [2024-11-28 11:46:41.219604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:21.230 [2024-11-28 11:46:41.219910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.219940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.219966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.219983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.219999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.220013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.220029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.230 [2024-11-28 11:46:41.220043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.230 [2024-11-28 11:46:41.220058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.220698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.220712] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x113ee00 is same with the state(5) to be set 00:22:21.231 [2024-11-28 11:46:41.220790] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x113ee00 was disconnected and freed. reset controller. 00:22:21.231 [2024-11-28 11:46:41.221878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:21.231 [2024-11-28 11:46:41.221910] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:21.231 [2024-11-28 11:46:41.221929] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:21.231 [2024-11-28 11:46:41.222102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.231 [2024-11-28 11:46:41.222221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.231 [2024-11-28 11:46:41.222247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xeedf70 with addr=10.0.0.2, port=4420 00:22:21.231 [2024-11-28 11:46:41.222263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xeedf70 is same with the state(5) to be set 00:22:21.231 [2024-11-28 11:46:41.224653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.224682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.224705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.224721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.224737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.224756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.224773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.224787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.224803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.224816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.224831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.224844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.224859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.224872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.224887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.224900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.224914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.224928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.231 [2024-11-28 11:46:41.224943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.231 [2024-11-28 11:46:41.224956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.224971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.224984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.224999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.225472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.225490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11403e0 is same with the state(5) to be set 00:22:21.232 [2024-11-28 11:46:41.225574] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x11403e0 was disconnected and freed. reset controller. 00:22:21.232 [2024-11-28 11:46:41.225651] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:21.232 [2024-11-28 11:46:41.225726] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:21.232 [2024-11-28 11:46:41.225796] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:21.232 [2024-11-28 11:46:41.225824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:21.232 [2024-11-28 11:46:41.225982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.232 [2024-11-28 11:46:41.226086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.232 [2024-11-28 11:46:41.226110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10b4600 with addr=10.0.0.2, port=4420 00:22:21.232 [2024-11-28 11:46:41.226126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10b4600 is same with the state(5) to be set 00:22:21.232 [2024-11-28 11:46:41.226237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.232 [2024-11-28 11:46:41.226330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.232 [2024-11-28 11:46:41.226354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf101b0 with addr=10.0.0.2, port=4420 00:22:21.232 [2024-11-28 11:46:41.226369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf101b0 is same with the state(5) to be set 00:22:21.232 [2024-11-28 11:46:41.226461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.232 [2024-11-28 11:46:41.226565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.232 [2024-11-28 11:46:41.226590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf19690 with addr=10.0.0.2, port=4420 00:22:21.232 [2024-11-28 11:46:41.226605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf19690 is same with the state(5) to be set 00:22:21.232 [2024-11-28 11:46:41.226627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xeedf70 (9): Bad file descriptor 00:22:21.232 [2024-11-28 11:46:41.226674] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:21.232 [2024-11-28 11:46:41.226703] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:21.232 [2024-11-28 11:46:41.227821] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:21.232 [2024-11-28 11:46:41.227851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:21.232 [2024-11-28 11:46:41.228018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.232 [2024-11-28 11:46:41.228131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.232 [2024-11-28 11:46:41.228157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10a4150 with addr=10.0.0.2, port=4420 00:22:21.232 [2024-11-28 11:46:41.228173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a4150 is same with the state(5) to be set 00:22:21.232 [2024-11-28 11:46:41.228191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10b4600 (9): Bad file descriptor 00:22:21.232 [2024-11-28 11:46:41.228209] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf101b0 (9): Bad file descriptor 00:22:21.232 [2024-11-28 11:46:41.228227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf19690 (9): Bad file descriptor 00:22:21.232 [2024-11-28 11:46:41.228243] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:21.232 [2024-11-28 11:46:41.228267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:21.232 [2024-11-28 11:46:41.228283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:21.232 [2024-11-28 11:46:41.228675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.228699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.228721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.228737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.228762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.228780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.228797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.228810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.228825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.228839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.228854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.228868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.228883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.232 [2024-11-28 11:46:41.228896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.232 [2024-11-28 11:46:41.228910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.228923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.228939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.228952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.228967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.228980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.228995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.229978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.229991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.230006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.230019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.230034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.233 [2024-11-28 11:46:41.230047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.233 [2024-11-28 11:46:41.230062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.230576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.230590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11419c0 is same with the state(5) to be set 00:22:21.234 [2024-11-28 11:46:41.231833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.231856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.231876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.231891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.231906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.231921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.231936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.231949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.231964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.231978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.231993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.234 [2024-11-28 11:46:41.232468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.234 [2024-11-28 11:46:41.232487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.232978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.232992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.235 [2024-11-28 11:46:41.233468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.235 [2024-11-28 11:46:41.233481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.233496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.233509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.233530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.233545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.233561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.233575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.233590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.233603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.233622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.233636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.233651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.233664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.233679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.233693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.233709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.233722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.233736] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1143000 is same with the state(5) to be set 00:22:21.236 [2024-11-28 11:46:41.235456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.235981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.235997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.236010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.236025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.236039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.236053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.236067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.236082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.236099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.236115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.236128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.236144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.236157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.236172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.236186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.236202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.236215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.236230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.236243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.236259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.236272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.236288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.236301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.236317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.236331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.236346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.236359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.236375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.236 [2024-11-28 11:46:41.236388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.236 [2024-11-28 11:46:41.236403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.236986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.236999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.237014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.237027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.237043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.237056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.237071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.237084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.237099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.237113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.237128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.237141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.237156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.237169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.237185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.237198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.237217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.237231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.237246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.237259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.237274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.237287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.237302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.237315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.237330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.237343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.237358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:21.237 [2024-11-28 11:46:41.237371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:21.237 [2024-11-28 11:46:41.237385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1144610 is same with the state(5) to be set 00:22:21.237 [2024-11-28 11:46:41.239714] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:21.237 [2024-11-28 11:46:41.239743] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:21.237 [2024-11-28 11:46:41.239769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:21.237 task offset: 24320 on job bdev=Nvme1n1 fails 00:22:21.237 00:22:21.237 Latency(us) 00:22:21.237 [2024-11-28T10:46:41.293Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:21.237 [2024-11-28T10:46:41.293Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:21.237 [2024-11-28T10:46:41.293Z] Job: Nvme1n1 ended in about 0.50 seconds with error 00:22:21.237 Verification LBA range: start 0x0 length 0x400 00:22:21.237 Nvme1n1 : 0.50 325.54 20.35 127.04 0.00 140122.70 48545.19 123498.95 00:22:21.237 [2024-11-28T10:46:41.293Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:21.237 [2024-11-28T10:46:41.293Z] Job: Nvme2n1 ended in about 0.50 seconds with error 00:22:21.237 Verification LBA range: start 0x0 length 0x400 00:22:21.237 Nvme2n1 : 0.50 324.82 20.30 126.76 0.00 138269.46 42331.40 122722.23 00:22:21.237 [2024-11-28T10:46:41.293Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:21.237 [2024-11-28T10:46:41.293Z] Job: Nvme3n1 ended in about 0.51 seconds with error 00:22:21.237 Verification LBA range: start 0x0 length 0x400 00:22:21.237 Nvme3n1 : 0.51 324.12 20.26 126.49 0.00 136428.15 36117.62 153791.15 00:22:21.237 [2024-11-28T10:46:41.293Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:21.237 [2024-11-28T10:46:41.294Z] Job: Nvme4n1 ended in about 0.51 seconds with error 00:22:21.238 Verification LBA range: start 0x0 length 0x400 00:22:21.238 Nvme4n1 : 0.51 323.43 20.21 126.22 0.00 134583.44 30098.01 120392.06 00:22:21.238 [2024-11-28T10:46:41.294Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:21.238 [2024-11-28T10:46:41.294Z] Job: Nvme5n1 ended in about 0.51 seconds with error 00:22:21.238 Verification LBA range: start 0x0 length 0x400 00:22:21.238 Nvme5n1 : 0.51 322.73 20.17 125.94 0.00 132785.56 23981.32 121945.51 00:22:21.238 [2024-11-28T10:46:41.294Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:21.238 [2024-11-28T10:46:41.294Z] Job: Nvme6n1 ended in about 0.51 seconds with error 00:22:21.238 Verification LBA range: start 0x0 length 0x400 00:22:21.238 Nvme6n1 : 0.51 318.85 19.93 50.55 0.00 158007.55 4660.34 138256.69 00:22:21.238 [2024-11-28T10:46:41.294Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:21.238 [2024-11-28T10:46:41.294Z] Job: Nvme7n1 ended in about 0.52 seconds with error 00:22:21.238 Verification LBA range: start 0x0 length 0x400 00:22:21.238 Nvme7n1 : 0.52 313.01 19.56 54.10 0.00 156400.32 5242.88 128159.29 00:22:21.238 [2024-11-28T10:46:41.294Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:21.238 [2024-11-28T10:46:41.294Z] Job: Nvme8n1 ended in about 0.52 seconds with error 00:22:21.238 Verification LBA range: start 0x0 length 0x400 00:22:21.238 Nvme8n1 : 0.52 241.61 15.10 122.72 0.00 156276.66 101750.71 126605.84 00:22:21.238 [2024-11-28T10:46:41.294Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:21.238 [2024-11-28T10:46:41.294Z] Job: Nvme9n1 ended in about 0.52 seconds with error 00:22:21.238 Verification LBA range: start 0x0 length 0x400 00:22:21.238 Nvme9n1 : 0.52 240.16 15.01 121.99 0.00 154911.26 106411.05 128159.29 00:22:21.238 [2024-11-28T10:46:41.294Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:21.238 [2024-11-28T10:46:41.294Z] Job: Nvme10n1 ended in about 0.53 seconds with error 00:22:21.238 Verification LBA range: start 0x0 length 0x400 00:22:21.238 Nvme10n1 : 0.53 238.51 14.91 121.15 0.00 153803.41 100197.26 128936.01 00:22:21.238 [2024-11-28T10:46:41.294Z] =================================================================================================================== 00:22:21.238 [2024-11-28T10:46:41.294Z] Total : 2972.77 185.80 1102.95 0.00 145275.12 4660.34 153791.15 00:22:21.498 [2024-11-28 11:46:41.267271] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:21.498 [2024-11-28 11:46:41.267351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:21.498 [2024-11-28 11:46:41.267637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.498 [2024-11-28 11:46:41.267754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.498 [2024-11-28 11:46:41.267781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x108f0a0 with addr=10.0.0.2, port=4420 00:22:21.498 [2024-11-28 11:46:41.267801] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x108f0a0 is same with the state(5) to be set 00:22:21.498 [2024-11-28 11:46:41.267915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.498 [2024-11-28 11:46:41.268026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.498 [2024-11-28 11:46:41.268052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x109ea60 with addr=10.0.0.2, port=4420 00:22:21.498 [2024-11-28 11:46:41.268069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x109ea60 is same with the state(5) to be set 00:22:21.498 [2024-11-28 11:46:41.268095] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10a4150 (9): Bad file descriptor 00:22:21.498 [2024-11-28 11:46:41.268117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:21.498 [2024-11-28 11:46:41.268130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:21.498 [2024-11-28 11:46:41.268148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:21.498 [2024-11-28 11:46:41.268175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:21.498 [2024-11-28 11:46:41.268189] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:21.498 [2024-11-28 11:46:41.268201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:21.498 [2024-11-28 11:46:41.268232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:21.498 [2024-11-28 11:46:41.268247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:21.498 [2024-11-28 11:46:41.268260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:21.498 [2024-11-28 11:46:41.268323] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:21.498 [2024-11-28 11:46:41.268347] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:21.498 [2024-11-28 11:46:41.268369] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:21.498 [2024-11-28 11:46:41.268394] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:21.498 [2024-11-28 11:46:41.268416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x109ea60 (9): Bad file descriptor 00:22:21.498 [2024-11-28 11:46:41.268442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x108f0a0 (9): Bad file descriptor 00:22:21.498 [2024-11-28 11:46:41.268885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:21.498 [2024-11-28 11:46:41.268910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:21.498 [2024-11-28 11:46:41.268923] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:21.498 [2024-11-28 11:46:41.269075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.498 [2024-11-28 11:46:41.269186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.498 [2024-11-28 11:46:41.269212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10a3c70 with addr=10.0.0.2, port=4420 00:22:21.498 [2024-11-28 11:46:41.269228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a3c70 is same with the state(5) to be set 00:22:21.498 [2024-11-28 11:46:41.269330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.498 [2024-11-28 11:46:41.269440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.498 [2024-11-28 11:46:41.269465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf3b490 with addr=10.0.0.2, port=4420 00:22:21.498 [2024-11-28 11:46:41.269481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf3b490 is same with the state(5) to be set 00:22:21.498 [2024-11-28 11:46:41.269616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.498 [2024-11-28 11:46:41.269726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.498 [2024-11-28 11:46:41.269752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf46590 with addr=10.0.0.2, port=4420 00:22:21.498 [2024-11-28 11:46:41.269767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf46590 is same with the state(5) to be set 00:22:21.498 [2024-11-28 11:46:41.269785] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:21.498 [2024-11-28 11:46:41.269799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:21.498 [2024-11-28 11:46:41.269814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:21.498 [2024-11-28 11:46:41.269851] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:21.498 [2024-11-28 11:46:41.269890] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:21.498 [2024-11-28 11:46:41.269910] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:21.498 [2024-11-28 11:46:41.269928] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:21.498 [2024-11-28 11:46:41.270797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:21.498 [2024-11-28 11:46:41.270857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:21.498 [2024-11-28 11:46:41.270901] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10a3c70 (9): Bad file descriptor 00:22:21.498 [2024-11-28 11:46:41.270925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf3b490 (9): Bad file descriptor 00:22:21.499 [2024-11-28 11:46:41.270943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf46590 (9): Bad file descriptor 00:22:21.499 [2024-11-28 11:46:41.270958] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:21.499 [2024-11-28 11:46:41.270970] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:21.499 [2024-11-28 11:46:41.270983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:21.499 [2024-11-28 11:46:41.271000] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:21.499 [2024-11-28 11:46:41.271013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:21.499 [2024-11-28 11:46:41.271026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:21.499 [2024-11-28 11:46:41.271102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:21.499 [2024-11-28 11:46:41.271126] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:21.499 [2024-11-28 11:46:41.271143] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:21.499 [2024-11-28 11:46:41.271158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:21.499 [2024-11-28 11:46:41.271171] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:21.499 [2024-11-28 11:46:41.271303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.499 [2024-11-28 11:46:41.271413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.499 [2024-11-28 11:46:41.271439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xeedf70 with addr=10.0.0.2, port=4420 00:22:21.499 [2024-11-28 11:46:41.271455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xeedf70 is same with the state(5) to be set 00:22:21.499 [2024-11-28 11:46:41.271469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:21.499 [2024-11-28 11:46:41.271482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:21.499 [2024-11-28 11:46:41.271494] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:21.499 [2024-11-28 11:46:41.271512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:21.499 [2024-11-28 11:46:41.271533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:21.499 [2024-11-28 11:46:41.271548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:21.499 [2024-11-28 11:46:41.271567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:21.499 [2024-11-28 11:46:41.271581] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:21.499 [2024-11-28 11:46:41.271593] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:21.499 [2024-11-28 11:46:41.271661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:21.499 [2024-11-28 11:46:41.271680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:21.499 [2024-11-28 11:46:41.271706] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:21.499 [2024-11-28 11:46:41.271873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.499 [2024-11-28 11:46:41.271973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.499 [2024-11-28 11:46:41.272000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf19690 with addr=10.0.0.2, port=4420 00:22:21.499 [2024-11-28 11:46:41.272015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf19690 is same with the state(5) to be set 00:22:21.499 [2024-11-28 11:46:41.272108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.499 [2024-11-28 11:46:41.272209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.499 [2024-11-28 11:46:41.272235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf101b0 with addr=10.0.0.2, port=4420 00:22:21.499 [2024-11-28 11:46:41.272251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf101b0 is same with the state(5) to be set 00:22:21.499 [2024-11-28 11:46:41.272336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.499 [2024-11-28 11:46:41.272434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:21.499 [2024-11-28 11:46:41.272459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10b4600 with addr=10.0.0.2, port=4420 00:22:21.499 [2024-11-28 11:46:41.272474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10b4600 is same with the state(5) to be set 00:22:21.499 [2024-11-28 11:46:41.272492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xeedf70 (9): Bad file descriptor 00:22:21.499 [2024-11-28 11:46:41.272543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf19690 (9): Bad file descriptor 00:22:21.499 [2024-11-28 11:46:41.272578] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf101b0 (9): Bad file descriptor 00:22:21.499 [2024-11-28 11:46:41.272597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10b4600 (9): Bad file descriptor 00:22:21.499 [2024-11-28 11:46:41.272612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:21.499 [2024-11-28 11:46:41.272624] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:21.499 [2024-11-28 11:46:41.272636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:21.499 [2024-11-28 11:46:41.272678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:21.499 [2024-11-28 11:46:41.272697] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:21.499 [2024-11-28 11:46:41.272710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:21.499 [2024-11-28 11:46:41.272723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:21.499 [2024-11-28 11:46:41.272738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:21.499 [2024-11-28 11:46:41.272751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:21.499 [2024-11-28 11:46:41.272765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:21.499 [2024-11-28 11:46:41.272780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:21.499 [2024-11-28 11:46:41.272793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:21.499 [2024-11-28 11:46:41.272805] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:21.499 [2024-11-28 11:46:41.272852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:21.499 [2024-11-28 11:46:41.272874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:21.499 [2024-11-28 11:46:41.272887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:21.793 11:46:41 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:21.793 11:46:41 -- target/shutdown.sh@138 -- # sleep 1 00:22:22.753 11:46:42 -- target/shutdown.sh@141 -- # kill -9 3874586 00:22:22.753 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (3874586) - No such process 00:22:22.753 11:46:42 -- target/shutdown.sh@141 -- # true 00:22:22.753 11:46:42 -- target/shutdown.sh@143 -- # stoptarget 00:22:22.753 11:46:42 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:22.753 11:46:42 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:22.753 11:46:42 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:22.753 11:46:42 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:22.753 11:46:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:22.753 11:46:42 -- nvmf/common.sh@116 -- # sync 00:22:22.753 11:46:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:22.753 11:46:42 -- nvmf/common.sh@119 -- # set +e 00:22:22.753 11:46:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:22.753 11:46:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:22.753 rmmod nvme_tcp 00:22:22.753 rmmod nvme_fabrics 00:22:22.753 rmmod nvme_keyring 00:22:23.012 11:46:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:23.012 11:46:42 -- nvmf/common.sh@123 -- # set -e 00:22:23.012 11:46:42 -- nvmf/common.sh@124 -- # return 0 00:22:23.012 11:46:42 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:23.012 11:46:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:23.012 11:46:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:23.012 11:46:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:23.012 11:46:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:23.012 11:46:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:23.012 11:46:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:23.012 11:46:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:23.012 11:46:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:24.916 11:46:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:24.916 00:22:24.916 real 0m7.705s 00:22:24.916 user 0m19.347s 00:22:24.916 sys 0m1.318s 00:22:24.916 11:46:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:24.916 11:46:44 -- common/autotest_common.sh@10 -- # set +x 00:22:24.916 ************************************ 00:22:24.916 END TEST nvmf_shutdown_tc3 00:22:24.916 ************************************ 00:22:24.916 11:46:44 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:24.916 00:22:24.916 real 0m29.248s 00:22:24.916 user 1m24.896s 00:22:24.916 sys 0m6.286s 00:22:24.916 11:46:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:24.916 11:46:44 -- common/autotest_common.sh@10 -- # set +x 00:22:24.916 ************************************ 00:22:24.916 END TEST nvmf_shutdown 00:22:24.916 ************************************ 00:22:24.916 11:46:44 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:24.916 11:46:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:24.916 11:46:44 -- common/autotest_common.sh@10 -- # set +x 00:22:24.916 11:46:44 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:24.916 11:46:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:24.916 11:46:44 -- common/autotest_common.sh@10 -- # set +x 00:22:24.916 11:46:44 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:24.916 11:46:44 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:24.916 11:46:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:24.916 11:46:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:24.916 11:46:44 -- common/autotest_common.sh@10 -- # set +x 00:22:24.916 ************************************ 00:22:24.916 START TEST nvmf_multicontroller 00:22:24.916 ************************************ 00:22:24.916 11:46:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:25.175 * Looking for test storage... 00:22:25.175 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:25.175 11:46:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:25.175 11:46:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:25.175 11:46:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:25.175 11:46:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:25.175 11:46:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:25.175 11:46:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:25.175 11:46:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:25.175 11:46:45 -- scripts/common.sh@335 -- # IFS=.-: 00:22:25.175 11:46:45 -- scripts/common.sh@335 -- # read -ra ver1 00:22:25.175 11:46:45 -- scripts/common.sh@336 -- # IFS=.-: 00:22:25.175 11:46:45 -- scripts/common.sh@336 -- # read -ra ver2 00:22:25.175 11:46:45 -- scripts/common.sh@337 -- # local 'op=<' 00:22:25.175 11:46:45 -- scripts/common.sh@339 -- # ver1_l=2 00:22:25.175 11:46:45 -- scripts/common.sh@340 -- # ver2_l=1 00:22:25.175 11:46:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:25.175 11:46:45 -- scripts/common.sh@343 -- # case "$op" in 00:22:25.175 11:46:45 -- scripts/common.sh@344 -- # : 1 00:22:25.175 11:46:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:25.175 11:46:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:25.175 11:46:45 -- scripts/common.sh@364 -- # decimal 1 00:22:25.175 11:46:45 -- scripts/common.sh@352 -- # local d=1 00:22:25.175 11:46:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:25.175 11:46:45 -- scripts/common.sh@354 -- # echo 1 00:22:25.175 11:46:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:25.175 11:46:45 -- scripts/common.sh@365 -- # decimal 2 00:22:25.175 11:46:45 -- scripts/common.sh@352 -- # local d=2 00:22:25.175 11:46:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:25.175 11:46:45 -- scripts/common.sh@354 -- # echo 2 00:22:25.175 11:46:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:25.175 11:46:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:25.175 11:46:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:25.175 11:46:45 -- scripts/common.sh@367 -- # return 0 00:22:25.175 11:46:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:25.175 11:46:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:25.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:25.175 --rc genhtml_branch_coverage=1 00:22:25.175 --rc genhtml_function_coverage=1 00:22:25.175 --rc genhtml_legend=1 00:22:25.176 --rc geninfo_all_blocks=1 00:22:25.176 --rc geninfo_unexecuted_blocks=1 00:22:25.176 00:22:25.176 ' 00:22:25.176 11:46:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:25.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:25.176 --rc genhtml_branch_coverage=1 00:22:25.176 --rc genhtml_function_coverage=1 00:22:25.176 --rc genhtml_legend=1 00:22:25.176 --rc geninfo_all_blocks=1 00:22:25.176 --rc geninfo_unexecuted_blocks=1 00:22:25.176 00:22:25.176 ' 00:22:25.176 11:46:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:25.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:25.176 --rc genhtml_branch_coverage=1 00:22:25.176 --rc genhtml_function_coverage=1 00:22:25.176 --rc genhtml_legend=1 00:22:25.176 --rc geninfo_all_blocks=1 00:22:25.176 --rc geninfo_unexecuted_blocks=1 00:22:25.176 00:22:25.176 ' 00:22:25.176 11:46:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:25.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:25.176 --rc genhtml_branch_coverage=1 00:22:25.176 --rc genhtml_function_coverage=1 00:22:25.176 --rc genhtml_legend=1 00:22:25.176 --rc geninfo_all_blocks=1 00:22:25.176 --rc geninfo_unexecuted_blocks=1 00:22:25.176 00:22:25.176 ' 00:22:25.176 11:46:45 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:25.176 11:46:45 -- nvmf/common.sh@7 -- # uname -s 00:22:25.176 11:46:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:25.176 11:46:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:25.176 11:46:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:25.176 11:46:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:25.176 11:46:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:25.176 11:46:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:25.176 11:46:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:25.176 11:46:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:25.176 11:46:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:25.176 11:46:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:25.176 11:46:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:25.176 11:46:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:25.176 11:46:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:25.176 11:46:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:25.176 11:46:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:25.176 11:46:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:25.176 11:46:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:25.176 11:46:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:25.176 11:46:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:25.176 11:46:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.176 11:46:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.176 11:46:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.176 11:46:45 -- paths/export.sh@5 -- # export PATH 00:22:25.176 11:46:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.176 11:46:45 -- nvmf/common.sh@46 -- # : 0 00:22:25.176 11:46:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:25.176 11:46:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:25.176 11:46:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:25.176 11:46:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:25.176 11:46:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:25.176 11:46:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:25.176 11:46:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:25.176 11:46:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:25.176 11:46:45 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:25.176 11:46:45 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:25.176 11:46:45 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:25.176 11:46:45 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:25.176 11:46:45 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:25.176 11:46:45 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:25.176 11:46:45 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:25.176 11:46:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:25.176 11:46:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:25.176 11:46:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:25.176 11:46:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:25.176 11:46:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:25.176 11:46:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:25.176 11:46:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:25.176 11:46:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:25.176 11:46:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:25.176 11:46:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:25.176 11:46:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:25.176 11:46:45 -- common/autotest_common.sh@10 -- # set +x 00:22:27.708 11:46:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:27.708 11:46:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:27.708 11:46:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:27.708 11:46:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:27.708 11:46:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:27.708 11:46:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:27.708 11:46:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:27.708 11:46:47 -- nvmf/common.sh@294 -- # net_devs=() 00:22:27.708 11:46:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:27.708 11:46:47 -- nvmf/common.sh@295 -- # e810=() 00:22:27.708 11:46:47 -- nvmf/common.sh@295 -- # local -ga e810 00:22:27.708 11:46:47 -- nvmf/common.sh@296 -- # x722=() 00:22:27.708 11:46:47 -- nvmf/common.sh@296 -- # local -ga x722 00:22:27.708 11:46:47 -- nvmf/common.sh@297 -- # mlx=() 00:22:27.708 11:46:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:27.708 11:46:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:27.708 11:46:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:27.708 11:46:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:27.708 11:46:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:27.708 11:46:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:27.708 11:46:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:27.708 11:46:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:27.708 11:46:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:27.708 11:46:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:27.708 11:46:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:27.708 11:46:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:27.708 11:46:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:27.708 11:46:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:27.708 11:46:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:27.708 11:46:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:27.708 11:46:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:27.708 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:27.708 11:46:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:27.708 11:46:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:27.708 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:27.708 11:46:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:27.708 11:46:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:27.708 11:46:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:27.708 11:46:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:27.708 11:46:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:27.708 11:46:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:27.708 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:27.708 11:46:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:27.708 11:46:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:27.708 11:46:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:27.708 11:46:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:27.708 11:46:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:27.708 11:46:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:27.708 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:27.708 11:46:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:27.708 11:46:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:27.708 11:46:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:27.708 11:46:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:27.708 11:46:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:27.708 11:46:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:27.708 11:46:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:27.708 11:46:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:27.708 11:46:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:27.708 11:46:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:27.708 11:46:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:27.708 11:46:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:27.708 11:46:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:27.708 11:46:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:27.708 11:46:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:27.708 11:46:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:27.708 11:46:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:27.709 11:46:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:27.709 11:46:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:27.709 11:46:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:27.709 11:46:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:27.709 11:46:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:27.709 11:46:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:27.709 11:46:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:27.709 11:46:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:27.709 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:27.709 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.260 ms 00:22:27.709 00:22:27.709 --- 10.0.0.2 ping statistics --- 00:22:27.709 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:27.709 rtt min/avg/max/mdev = 0.260/0.260/0.260/0.000 ms 00:22:27.709 11:46:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:27.709 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:27.709 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:22:27.709 00:22:27.709 --- 10.0.0.1 ping statistics --- 00:22:27.709 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:27.709 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:22:27.709 11:46:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:27.709 11:46:47 -- nvmf/common.sh@410 -- # return 0 00:22:27.709 11:46:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:27.709 11:46:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:27.709 11:46:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:27.709 11:46:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:27.709 11:46:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:27.709 11:46:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:27.709 11:46:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:27.709 11:46:47 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:27.709 11:46:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:27.709 11:46:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:27.709 11:46:47 -- common/autotest_common.sh@10 -- # set +x 00:22:27.709 11:46:47 -- nvmf/common.sh@469 -- # nvmfpid=3877136 00:22:27.709 11:46:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:27.709 11:46:47 -- nvmf/common.sh@470 -- # waitforlisten 3877136 00:22:27.709 11:46:47 -- common/autotest_common.sh@829 -- # '[' -z 3877136 ']' 00:22:27.709 11:46:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:27.709 11:46:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:27.709 11:46:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:27.709 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:27.709 11:46:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:27.709 11:46:47 -- common/autotest_common.sh@10 -- # set +x 00:22:27.709 [2024-11-28 11:46:47.371815] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:27.709 [2024-11-28 11:46:47.371915] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:27.709 EAL: No free 2048 kB hugepages reported on node 1 00:22:27.709 [2024-11-28 11:46:47.434072] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:27.709 [2024-11-28 11:46:47.540492] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:27.709 [2024-11-28 11:46:47.540640] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:27.709 [2024-11-28 11:46:47.540658] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:27.709 [2024-11-28 11:46:47.540670] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:27.709 [2024-11-28 11:46:47.540768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:27.709 [2024-11-28 11:46:47.540815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:27.709 [2024-11-28 11:46:47.540819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:28.643 11:46:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:28.643 11:46:48 -- common/autotest_common.sh@862 -- # return 0 00:22:28.643 11:46:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:28.643 11:46:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:28.643 11:46:48 -- common/autotest_common.sh@10 -- # set +x 00:22:28.643 11:46:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:28.643 11:46:48 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:28.643 11:46:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.643 11:46:48 -- common/autotest_common.sh@10 -- # set +x 00:22:28.643 [2024-11-28 11:46:48.416017] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:28.643 11:46:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.643 11:46:48 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:28.643 11:46:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.643 11:46:48 -- common/autotest_common.sh@10 -- # set +x 00:22:28.643 Malloc0 00:22:28.643 11:46:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.643 11:46:48 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:28.643 11:46:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.643 11:46:48 -- common/autotest_common.sh@10 -- # set +x 00:22:28.643 11:46:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.643 11:46:48 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:28.643 11:46:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.643 11:46:48 -- common/autotest_common.sh@10 -- # set +x 00:22:28.643 11:46:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.643 11:46:48 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:28.643 11:46:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.643 11:46:48 -- common/autotest_common.sh@10 -- # set +x 00:22:28.643 [2024-11-28 11:46:48.473642] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:28.643 11:46:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.643 11:46:48 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:28.643 11:46:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.643 11:46:48 -- common/autotest_common.sh@10 -- # set +x 00:22:28.643 [2024-11-28 11:46:48.481498] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:28.643 11:46:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.643 11:46:48 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:28.643 11:46:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.643 11:46:48 -- common/autotest_common.sh@10 -- # set +x 00:22:28.643 Malloc1 00:22:28.643 11:46:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.643 11:46:48 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:28.643 11:46:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.643 11:46:48 -- common/autotest_common.sh@10 -- # set +x 00:22:28.643 11:46:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.643 11:46:48 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:28.643 11:46:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.643 11:46:48 -- common/autotest_common.sh@10 -- # set +x 00:22:28.643 11:46:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.643 11:46:48 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:28.643 11:46:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.643 11:46:48 -- common/autotest_common.sh@10 -- # set +x 00:22:28.643 11:46:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.643 11:46:48 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:28.643 11:46:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.643 11:46:48 -- common/autotest_common.sh@10 -- # set +x 00:22:28.643 11:46:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.643 11:46:48 -- host/multicontroller.sh@44 -- # bdevperf_pid=3877291 00:22:28.643 11:46:48 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:28.643 11:46:48 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:28.643 11:46:48 -- host/multicontroller.sh@47 -- # waitforlisten 3877291 /var/tmp/bdevperf.sock 00:22:28.643 11:46:48 -- common/autotest_common.sh@829 -- # '[' -z 3877291 ']' 00:22:28.643 11:46:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:28.643 11:46:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:28.643 11:46:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:28.643 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:28.643 11:46:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:28.643 11:46:48 -- common/autotest_common.sh@10 -- # set +x 00:22:29.577 11:46:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:29.577 11:46:49 -- common/autotest_common.sh@862 -- # return 0 00:22:29.577 11:46:49 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:29.577 11:46:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.577 11:46:49 -- common/autotest_common.sh@10 -- # set +x 00:22:29.835 NVMe0n1 00:22:29.835 11:46:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.835 11:46:49 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:29.835 11:46:49 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:22:29.835 11:46:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.835 11:46:49 -- common/autotest_common.sh@10 -- # set +x 00:22:29.835 11:46:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.835 1 00:22:29.835 11:46:49 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:29.835 11:46:49 -- common/autotest_common.sh@650 -- # local es=0 00:22:29.835 11:46:49 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:29.835 11:46:49 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:29.835 11:46:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:29.835 11:46:49 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:29.835 11:46:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:29.835 11:46:49 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:29.835 11:46:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.835 11:46:49 -- common/autotest_common.sh@10 -- # set +x 00:22:29.835 request: 00:22:29.835 { 00:22:29.835 "name": "NVMe0", 00:22:29.835 "trtype": "tcp", 00:22:29.835 "traddr": "10.0.0.2", 00:22:29.835 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:22:29.835 "hostaddr": "10.0.0.2", 00:22:29.835 "hostsvcid": "60000", 00:22:29.835 "adrfam": "ipv4", 00:22:29.835 "trsvcid": "4420", 00:22:29.835 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:29.835 "method": "bdev_nvme_attach_controller", 00:22:29.835 "req_id": 1 00:22:29.835 } 00:22:29.835 Got JSON-RPC error response 00:22:29.835 response: 00:22:29.835 { 00:22:29.835 "code": -114, 00:22:29.835 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:29.835 } 00:22:29.835 11:46:49 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:29.835 11:46:49 -- common/autotest_common.sh@653 -- # es=1 00:22:29.835 11:46:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:29.835 11:46:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:29.835 11:46:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:29.835 11:46:49 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:29.835 11:46:49 -- common/autotest_common.sh@650 -- # local es=0 00:22:29.835 11:46:49 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:29.835 11:46:49 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:29.835 11:46:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:29.835 11:46:49 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:29.835 11:46:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:29.835 11:46:49 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:29.835 11:46:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.835 11:46:49 -- common/autotest_common.sh@10 -- # set +x 00:22:29.835 request: 00:22:29.835 { 00:22:29.835 "name": "NVMe0", 00:22:29.835 "trtype": "tcp", 00:22:29.835 "traddr": "10.0.0.2", 00:22:29.835 "hostaddr": "10.0.0.2", 00:22:29.836 "hostsvcid": "60000", 00:22:29.836 "adrfam": "ipv4", 00:22:29.836 "trsvcid": "4420", 00:22:29.836 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:29.836 "method": "bdev_nvme_attach_controller", 00:22:29.836 "req_id": 1 00:22:29.836 } 00:22:29.836 Got JSON-RPC error response 00:22:29.836 response: 00:22:29.836 { 00:22:29.836 "code": -114, 00:22:29.836 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:29.836 } 00:22:29.836 11:46:49 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:29.836 11:46:49 -- common/autotest_common.sh@653 -- # es=1 00:22:29.836 11:46:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:29.836 11:46:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:29.836 11:46:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:29.836 11:46:49 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:29.836 11:46:49 -- common/autotest_common.sh@650 -- # local es=0 00:22:29.836 11:46:49 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:29.836 11:46:49 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:29.836 11:46:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:29.836 11:46:49 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:29.836 11:46:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:29.836 11:46:49 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:29.836 11:46:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.836 11:46:49 -- common/autotest_common.sh@10 -- # set +x 00:22:29.836 request: 00:22:29.836 { 00:22:29.836 "name": "NVMe0", 00:22:29.836 "trtype": "tcp", 00:22:29.836 "traddr": "10.0.0.2", 00:22:29.836 "hostaddr": "10.0.0.2", 00:22:29.836 "hostsvcid": "60000", 00:22:29.836 "adrfam": "ipv4", 00:22:29.836 "trsvcid": "4420", 00:22:29.836 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:29.836 "multipath": "disable", 00:22:29.836 "method": "bdev_nvme_attach_controller", 00:22:29.836 "req_id": 1 00:22:29.836 } 00:22:29.836 Got JSON-RPC error response 00:22:29.836 response: 00:22:29.836 { 00:22:29.836 "code": -114, 00:22:29.836 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:22:29.836 } 00:22:29.836 11:46:49 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:29.836 11:46:49 -- common/autotest_common.sh@653 -- # es=1 00:22:29.836 11:46:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:29.836 11:46:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:29.836 11:46:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:29.836 11:46:49 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:29.836 11:46:49 -- common/autotest_common.sh@650 -- # local es=0 00:22:29.836 11:46:49 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:29.836 11:46:49 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:29.836 11:46:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:29.836 11:46:49 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:29.836 11:46:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:29.836 11:46:49 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:29.836 11:46:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.836 11:46:49 -- common/autotest_common.sh@10 -- # set +x 00:22:30.094 request: 00:22:30.094 { 00:22:30.094 "name": "NVMe0", 00:22:30.094 "trtype": "tcp", 00:22:30.094 "traddr": "10.0.0.2", 00:22:30.094 "hostaddr": "10.0.0.2", 00:22:30.094 "hostsvcid": "60000", 00:22:30.094 "adrfam": "ipv4", 00:22:30.094 "trsvcid": "4420", 00:22:30.094 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:30.094 "multipath": "failover", 00:22:30.094 "method": "bdev_nvme_attach_controller", 00:22:30.094 "req_id": 1 00:22:30.094 } 00:22:30.094 Got JSON-RPC error response 00:22:30.094 response: 00:22:30.094 { 00:22:30.094 "code": -114, 00:22:30.094 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:30.094 } 00:22:30.094 11:46:49 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:30.094 11:46:49 -- common/autotest_common.sh@653 -- # es=1 00:22:30.094 11:46:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:30.094 11:46:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:30.094 11:46:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:30.094 11:46:49 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:30.094 11:46:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.094 11:46:49 -- common/autotest_common.sh@10 -- # set +x 00:22:30.094 00:22:30.094 11:46:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.094 11:46:50 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:30.094 11:46:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.094 11:46:50 -- common/autotest_common.sh@10 -- # set +x 00:22:30.094 11:46:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.094 11:46:50 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:30.094 11:46:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.094 11:46:50 -- common/autotest_common.sh@10 -- # set +x 00:22:30.352 00:22:30.352 11:46:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.352 11:46:50 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:30.352 11:46:50 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:22:30.352 11:46:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.352 11:46:50 -- common/autotest_common.sh@10 -- # set +x 00:22:30.352 11:46:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.352 11:46:50 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:22:30.352 11:46:50 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:31.725 0 00:22:31.725 11:46:51 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:22:31.725 11:46:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.725 11:46:51 -- common/autotest_common.sh@10 -- # set +x 00:22:31.725 11:46:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.725 11:46:51 -- host/multicontroller.sh@100 -- # killprocess 3877291 00:22:31.725 11:46:51 -- common/autotest_common.sh@936 -- # '[' -z 3877291 ']' 00:22:31.725 11:46:51 -- common/autotest_common.sh@940 -- # kill -0 3877291 00:22:31.725 11:46:51 -- common/autotest_common.sh@941 -- # uname 00:22:31.725 11:46:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:31.725 11:46:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3877291 00:22:31.725 11:46:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:31.725 11:46:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:31.725 11:46:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3877291' 00:22:31.725 killing process with pid 3877291 00:22:31.725 11:46:51 -- common/autotest_common.sh@955 -- # kill 3877291 00:22:31.725 11:46:51 -- common/autotest_common.sh@960 -- # wait 3877291 00:22:31.725 11:46:51 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:31.725 11:46:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.725 11:46:51 -- common/autotest_common.sh@10 -- # set +x 00:22:31.725 11:46:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.725 11:46:51 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:31.725 11:46:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.725 11:46:51 -- common/autotest_common.sh@10 -- # set +x 00:22:31.725 11:46:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.725 11:46:51 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:22:31.725 11:46:51 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:31.725 11:46:51 -- common/autotest_common.sh@1607 -- # read -r file 00:22:31.725 11:46:51 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:22:31.725 11:46:51 -- common/autotest_common.sh@1606 -- # sort -u 00:22:31.725 11:46:51 -- common/autotest_common.sh@1608 -- # cat 00:22:31.725 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:31.725 [2024-11-28 11:46:48.582393] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:31.725 [2024-11-28 11:46:48.582474] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3877291 ] 00:22:31.725 EAL: No free 2048 kB hugepages reported on node 1 00:22:31.725 [2024-11-28 11:46:48.642336] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:31.725 [2024-11-28 11:46:48.750605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:31.725 [2024-11-28 11:46:50.235793] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name e85617d0-549a-42ce-bbf6-f4f646828134 already exists 00:22:31.725 [2024-11-28 11:46:50.235852] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:e85617d0-549a-42ce-bbf6-f4f646828134 alias for bdev NVMe1n1 00:22:31.725 [2024-11-28 11:46:50.235874] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:22:31.725 Running I/O for 1 seconds... 00:22:31.725 00:22:31.725 Latency(us) 00:22:31.725 [2024-11-28T10:46:51.781Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:31.725 [2024-11-28T10:46:51.781Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:22:31.725 NVMe0n1 : 1.00 19559.53 76.40 0.00 0.00 6534.49 2245.21 12281.93 00:22:31.725 [2024-11-28T10:46:51.781Z] =================================================================================================================== 00:22:31.725 [2024-11-28T10:46:51.781Z] Total : 19559.53 76.40 0.00 0.00 6534.49 2245.21 12281.93 00:22:31.725 Received shutdown signal, test time was about 1.000000 seconds 00:22:31.725 00:22:31.725 Latency(us) 00:22:31.725 [2024-11-28T10:46:51.781Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:31.725 [2024-11-28T10:46:51.781Z] =================================================================================================================== 00:22:31.725 [2024-11-28T10:46:51.781Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:31.725 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:31.725 11:46:51 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:31.725 11:46:51 -- common/autotest_common.sh@1607 -- # read -r file 00:22:31.725 11:46:51 -- host/multicontroller.sh@108 -- # nvmftestfini 00:22:31.725 11:46:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:31.725 11:46:51 -- nvmf/common.sh@116 -- # sync 00:22:31.725 11:46:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:31.725 11:46:51 -- nvmf/common.sh@119 -- # set +e 00:22:31.725 11:46:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:31.725 11:46:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:31.725 rmmod nvme_tcp 00:22:31.725 rmmod nvme_fabrics 00:22:31.725 rmmod nvme_keyring 00:22:31.983 11:46:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:31.983 11:46:51 -- nvmf/common.sh@123 -- # set -e 00:22:31.983 11:46:51 -- nvmf/common.sh@124 -- # return 0 00:22:31.983 11:46:51 -- nvmf/common.sh@477 -- # '[' -n 3877136 ']' 00:22:31.983 11:46:51 -- nvmf/common.sh@478 -- # killprocess 3877136 00:22:31.983 11:46:51 -- common/autotest_common.sh@936 -- # '[' -z 3877136 ']' 00:22:31.983 11:46:51 -- common/autotest_common.sh@940 -- # kill -0 3877136 00:22:31.983 11:46:51 -- common/autotest_common.sh@941 -- # uname 00:22:31.983 11:46:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:31.983 11:46:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3877136 00:22:31.983 11:46:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:31.984 11:46:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:31.984 11:46:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3877136' 00:22:31.984 killing process with pid 3877136 00:22:31.984 11:46:51 -- common/autotest_common.sh@955 -- # kill 3877136 00:22:31.984 11:46:51 -- common/autotest_common.sh@960 -- # wait 3877136 00:22:32.242 11:46:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:32.242 11:46:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:32.242 11:46:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:32.242 11:46:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:32.242 11:46:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:32.242 11:46:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:32.242 11:46:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:32.242 11:46:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:34.772 11:46:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:34.772 00:22:34.772 real 0m9.277s 00:22:34.772 user 0m18.110s 00:22:34.772 sys 0m2.459s 00:22:34.772 11:46:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:34.772 11:46:54 -- common/autotest_common.sh@10 -- # set +x 00:22:34.772 ************************************ 00:22:34.772 END TEST nvmf_multicontroller 00:22:34.772 ************************************ 00:22:34.772 11:46:54 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:34.772 11:46:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:34.772 11:46:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:34.772 11:46:54 -- common/autotest_common.sh@10 -- # set +x 00:22:34.772 ************************************ 00:22:34.772 START TEST nvmf_aer 00:22:34.773 ************************************ 00:22:34.773 11:46:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:34.773 * Looking for test storage... 00:22:34.773 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:34.773 11:46:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:34.773 11:46:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:34.773 11:46:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:34.773 11:46:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:34.773 11:46:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:34.773 11:46:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:34.773 11:46:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:34.773 11:46:54 -- scripts/common.sh@335 -- # IFS=.-: 00:22:34.773 11:46:54 -- scripts/common.sh@335 -- # read -ra ver1 00:22:34.773 11:46:54 -- scripts/common.sh@336 -- # IFS=.-: 00:22:34.773 11:46:54 -- scripts/common.sh@336 -- # read -ra ver2 00:22:34.773 11:46:54 -- scripts/common.sh@337 -- # local 'op=<' 00:22:34.773 11:46:54 -- scripts/common.sh@339 -- # ver1_l=2 00:22:34.773 11:46:54 -- scripts/common.sh@340 -- # ver2_l=1 00:22:34.773 11:46:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:34.773 11:46:54 -- scripts/common.sh@343 -- # case "$op" in 00:22:34.773 11:46:54 -- scripts/common.sh@344 -- # : 1 00:22:34.773 11:46:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:34.773 11:46:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:34.773 11:46:54 -- scripts/common.sh@364 -- # decimal 1 00:22:34.773 11:46:54 -- scripts/common.sh@352 -- # local d=1 00:22:34.773 11:46:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:34.773 11:46:54 -- scripts/common.sh@354 -- # echo 1 00:22:34.773 11:46:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:34.773 11:46:54 -- scripts/common.sh@365 -- # decimal 2 00:22:34.773 11:46:54 -- scripts/common.sh@352 -- # local d=2 00:22:34.773 11:46:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:34.773 11:46:54 -- scripts/common.sh@354 -- # echo 2 00:22:34.773 11:46:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:34.773 11:46:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:34.773 11:46:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:34.773 11:46:54 -- scripts/common.sh@367 -- # return 0 00:22:34.773 11:46:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:34.773 11:46:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:34.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:34.773 --rc genhtml_branch_coverage=1 00:22:34.773 --rc genhtml_function_coverage=1 00:22:34.773 --rc genhtml_legend=1 00:22:34.773 --rc geninfo_all_blocks=1 00:22:34.773 --rc geninfo_unexecuted_blocks=1 00:22:34.773 00:22:34.773 ' 00:22:34.773 11:46:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:34.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:34.773 --rc genhtml_branch_coverage=1 00:22:34.773 --rc genhtml_function_coverage=1 00:22:34.773 --rc genhtml_legend=1 00:22:34.773 --rc geninfo_all_blocks=1 00:22:34.773 --rc geninfo_unexecuted_blocks=1 00:22:34.773 00:22:34.773 ' 00:22:34.773 11:46:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:34.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:34.773 --rc genhtml_branch_coverage=1 00:22:34.773 --rc genhtml_function_coverage=1 00:22:34.773 --rc genhtml_legend=1 00:22:34.773 --rc geninfo_all_blocks=1 00:22:34.773 --rc geninfo_unexecuted_blocks=1 00:22:34.773 00:22:34.773 ' 00:22:34.773 11:46:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:34.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:34.773 --rc genhtml_branch_coverage=1 00:22:34.773 --rc genhtml_function_coverage=1 00:22:34.773 --rc genhtml_legend=1 00:22:34.773 --rc geninfo_all_blocks=1 00:22:34.773 --rc geninfo_unexecuted_blocks=1 00:22:34.773 00:22:34.773 ' 00:22:34.773 11:46:54 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:34.773 11:46:54 -- nvmf/common.sh@7 -- # uname -s 00:22:34.773 11:46:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:34.773 11:46:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:34.773 11:46:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:34.773 11:46:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:34.773 11:46:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:34.773 11:46:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:34.773 11:46:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:34.773 11:46:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:34.773 11:46:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:34.773 11:46:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:34.773 11:46:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:34.773 11:46:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:34.773 11:46:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:34.773 11:46:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:34.773 11:46:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:34.773 11:46:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:34.773 11:46:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:34.773 11:46:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:34.773 11:46:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:34.773 11:46:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:34.773 11:46:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:34.773 11:46:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:34.773 11:46:54 -- paths/export.sh@5 -- # export PATH 00:22:34.773 11:46:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:34.773 11:46:54 -- nvmf/common.sh@46 -- # : 0 00:22:34.773 11:46:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:34.773 11:46:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:34.773 11:46:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:34.773 11:46:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:34.773 11:46:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:34.773 11:46:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:34.773 11:46:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:34.773 11:46:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:34.773 11:46:54 -- host/aer.sh@11 -- # nvmftestinit 00:22:34.773 11:46:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:34.773 11:46:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:34.773 11:46:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:34.773 11:46:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:34.773 11:46:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:34.773 11:46:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:34.773 11:46:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:34.773 11:46:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:34.773 11:46:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:34.773 11:46:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:34.773 11:46:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:34.773 11:46:54 -- common/autotest_common.sh@10 -- # set +x 00:22:36.673 11:46:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:36.673 11:46:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:36.673 11:46:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:36.673 11:46:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:36.673 11:46:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:36.673 11:46:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:36.673 11:46:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:36.673 11:46:56 -- nvmf/common.sh@294 -- # net_devs=() 00:22:36.673 11:46:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:36.673 11:46:56 -- nvmf/common.sh@295 -- # e810=() 00:22:36.673 11:46:56 -- nvmf/common.sh@295 -- # local -ga e810 00:22:36.673 11:46:56 -- nvmf/common.sh@296 -- # x722=() 00:22:36.673 11:46:56 -- nvmf/common.sh@296 -- # local -ga x722 00:22:36.673 11:46:56 -- nvmf/common.sh@297 -- # mlx=() 00:22:36.673 11:46:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:36.673 11:46:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:36.673 11:46:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:36.673 11:46:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:36.673 11:46:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:36.673 11:46:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:36.673 11:46:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:36.673 11:46:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:36.673 11:46:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:36.673 11:46:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:36.673 11:46:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:36.673 11:46:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:36.673 11:46:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:36.673 11:46:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:36.673 11:46:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:36.673 11:46:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:36.673 11:46:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:36.673 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:36.673 11:46:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:36.673 11:46:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:36.673 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:36.673 11:46:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:36.673 11:46:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:36.673 11:46:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:36.673 11:46:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:36.673 11:46:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:36.673 11:46:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:36.673 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:36.673 11:46:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:36.673 11:46:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:36.673 11:46:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:36.673 11:46:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:36.673 11:46:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:36.673 11:46:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:36.673 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:36.673 11:46:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:36.673 11:46:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:36.673 11:46:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:36.673 11:46:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:36.673 11:46:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:36.673 11:46:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:36.673 11:46:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:36.673 11:46:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:36.673 11:46:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:36.673 11:46:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:36.673 11:46:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:36.673 11:46:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:36.673 11:46:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:36.673 11:46:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:36.673 11:46:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:36.673 11:46:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:36.673 11:46:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:36.673 11:46:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:36.673 11:46:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:36.673 11:46:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:36.673 11:46:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:36.673 11:46:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:36.673 11:46:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:36.673 11:46:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:36.673 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:36.673 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.192 ms 00:22:36.673 00:22:36.673 --- 10.0.0.2 ping statistics --- 00:22:36.673 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:36.673 rtt min/avg/max/mdev = 0.192/0.192/0.192/0.000 ms 00:22:36.673 11:46:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:36.673 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:36.673 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.087 ms 00:22:36.673 00:22:36.673 --- 10.0.0.1 ping statistics --- 00:22:36.673 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:36.673 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:22:36.673 11:46:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:36.673 11:46:56 -- nvmf/common.sh@410 -- # return 0 00:22:36.673 11:46:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:36.673 11:46:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:36.673 11:46:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:36.673 11:46:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:36.673 11:46:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:36.673 11:46:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:36.673 11:46:56 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:22:36.673 11:46:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:36.673 11:46:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:36.673 11:46:56 -- common/autotest_common.sh@10 -- # set +x 00:22:36.673 11:46:56 -- nvmf/common.sh@469 -- # nvmfpid=3879665 00:22:36.673 11:46:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:36.673 11:46:56 -- nvmf/common.sh@470 -- # waitforlisten 3879665 00:22:36.673 11:46:56 -- common/autotest_common.sh@829 -- # '[' -z 3879665 ']' 00:22:36.673 11:46:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:36.673 11:46:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:36.673 11:46:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:36.674 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:36.674 11:46:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:36.674 11:46:56 -- common/autotest_common.sh@10 -- # set +x 00:22:36.674 [2024-11-28 11:46:56.590584] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:36.674 [2024-11-28 11:46:56.590652] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:36.674 EAL: No free 2048 kB hugepages reported on node 1 00:22:36.674 [2024-11-28 11:46:56.656618] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:36.932 [2024-11-28 11:46:56.769110] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:36.932 [2024-11-28 11:46:56.769273] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:36.932 [2024-11-28 11:46:56.769293] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:36.932 [2024-11-28 11:46:56.769306] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:36.932 [2024-11-28 11:46:56.769369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:36.932 [2024-11-28 11:46:56.769433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:36.932 [2024-11-28 11:46:56.769496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:36.932 [2024-11-28 11:46:56.769499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:37.866 11:46:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:37.866 11:46:57 -- common/autotest_common.sh@862 -- # return 0 00:22:37.866 11:46:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:37.866 11:46:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:37.866 11:46:57 -- common/autotest_common.sh@10 -- # set +x 00:22:37.866 11:46:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:37.866 11:46:57 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:37.866 11:46:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:37.866 11:46:57 -- common/autotest_common.sh@10 -- # set +x 00:22:37.866 [2024-11-28 11:46:57.644286] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:37.866 11:46:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:37.866 11:46:57 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:22:37.866 11:46:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:37.866 11:46:57 -- common/autotest_common.sh@10 -- # set +x 00:22:37.866 Malloc0 00:22:37.866 11:46:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:37.866 11:46:57 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:22:37.866 11:46:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:37.866 11:46:57 -- common/autotest_common.sh@10 -- # set +x 00:22:37.866 11:46:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:37.866 11:46:57 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:37.866 11:46:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:37.866 11:46:57 -- common/autotest_common.sh@10 -- # set +x 00:22:37.866 11:46:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:37.866 11:46:57 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:37.866 11:46:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:37.866 11:46:57 -- common/autotest_common.sh@10 -- # set +x 00:22:37.866 [2024-11-28 11:46:57.695467] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:37.866 11:46:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:37.866 11:46:57 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:22:37.866 11:46:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:37.866 11:46:57 -- common/autotest_common.sh@10 -- # set +x 00:22:37.866 [2024-11-28 11:46:57.703220] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:37.866 [ 00:22:37.866 { 00:22:37.866 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:37.866 "subtype": "Discovery", 00:22:37.866 "listen_addresses": [], 00:22:37.866 "allow_any_host": true, 00:22:37.866 "hosts": [] 00:22:37.866 }, 00:22:37.866 { 00:22:37.866 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:37.866 "subtype": "NVMe", 00:22:37.866 "listen_addresses": [ 00:22:37.866 { 00:22:37.866 "transport": "TCP", 00:22:37.866 "trtype": "TCP", 00:22:37.866 "adrfam": "IPv4", 00:22:37.866 "traddr": "10.0.0.2", 00:22:37.866 "trsvcid": "4420" 00:22:37.866 } 00:22:37.866 ], 00:22:37.866 "allow_any_host": true, 00:22:37.866 "hosts": [], 00:22:37.866 "serial_number": "SPDK00000000000001", 00:22:37.866 "model_number": "SPDK bdev Controller", 00:22:37.866 "max_namespaces": 2, 00:22:37.866 "min_cntlid": 1, 00:22:37.866 "max_cntlid": 65519, 00:22:37.866 "namespaces": [ 00:22:37.866 { 00:22:37.866 "nsid": 1, 00:22:37.866 "bdev_name": "Malloc0", 00:22:37.866 "name": "Malloc0", 00:22:37.866 "nguid": "458C2EA52F884BB68BA0B4CDD2E6706B", 00:22:37.866 "uuid": "458c2ea5-2f88-4bb6-8ba0-b4cdd2e6706b" 00:22:37.866 } 00:22:37.866 ] 00:22:37.866 } 00:22:37.866 ] 00:22:37.866 11:46:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:37.866 11:46:57 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:22:37.866 11:46:57 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:22:37.866 11:46:57 -- host/aer.sh@33 -- # aerpid=3879827 00:22:37.866 11:46:57 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:22:37.866 11:46:57 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:22:37.866 11:46:57 -- common/autotest_common.sh@1254 -- # local i=0 00:22:37.866 11:46:57 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:37.866 11:46:57 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:22:37.866 11:46:57 -- common/autotest_common.sh@1257 -- # i=1 00:22:37.866 11:46:57 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:37.866 EAL: No free 2048 kB hugepages reported on node 1 00:22:37.866 11:46:57 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:37.866 11:46:57 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:22:37.866 11:46:57 -- common/autotest_common.sh@1257 -- # i=2 00:22:37.866 11:46:57 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:37.866 11:46:57 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:37.866 11:46:57 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:37.866 11:46:57 -- common/autotest_common.sh@1265 -- # return 0 00:22:37.866 11:46:57 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:22:37.866 11:46:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:37.866 11:46:57 -- common/autotest_common.sh@10 -- # set +x 00:22:38.125 Malloc1 00:22:38.125 11:46:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:38.125 11:46:57 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:22:38.125 11:46:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:38.125 11:46:57 -- common/autotest_common.sh@10 -- # set +x 00:22:38.125 11:46:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:38.125 11:46:57 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:22:38.125 11:46:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:38.125 11:46:57 -- common/autotest_common.sh@10 -- # set +x 00:22:38.125 Asynchronous Event Request test 00:22:38.125 Attaching to 10.0.0.2 00:22:38.125 Attached to 10.0.0.2 00:22:38.125 Registering asynchronous event callbacks... 00:22:38.125 Starting namespace attribute notice tests for all controllers... 00:22:38.125 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:22:38.125 aer_cb - Changed Namespace 00:22:38.125 Cleaning up... 00:22:38.125 [ 00:22:38.125 { 00:22:38.125 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:38.125 "subtype": "Discovery", 00:22:38.125 "listen_addresses": [], 00:22:38.125 "allow_any_host": true, 00:22:38.125 "hosts": [] 00:22:38.125 }, 00:22:38.125 { 00:22:38.125 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:38.125 "subtype": "NVMe", 00:22:38.125 "listen_addresses": [ 00:22:38.125 { 00:22:38.125 "transport": "TCP", 00:22:38.125 "trtype": "TCP", 00:22:38.125 "adrfam": "IPv4", 00:22:38.125 "traddr": "10.0.0.2", 00:22:38.125 "trsvcid": "4420" 00:22:38.125 } 00:22:38.125 ], 00:22:38.125 "allow_any_host": true, 00:22:38.125 "hosts": [], 00:22:38.125 "serial_number": "SPDK00000000000001", 00:22:38.125 "model_number": "SPDK bdev Controller", 00:22:38.125 "max_namespaces": 2, 00:22:38.125 "min_cntlid": 1, 00:22:38.125 "max_cntlid": 65519, 00:22:38.125 "namespaces": [ 00:22:38.125 { 00:22:38.125 "nsid": 1, 00:22:38.125 "bdev_name": "Malloc0", 00:22:38.125 "name": "Malloc0", 00:22:38.125 "nguid": "458C2EA52F884BB68BA0B4CDD2E6706B", 00:22:38.125 "uuid": "458c2ea5-2f88-4bb6-8ba0-b4cdd2e6706b" 00:22:38.125 }, 00:22:38.125 { 00:22:38.125 "nsid": 2, 00:22:38.125 "bdev_name": "Malloc1", 00:22:38.125 "name": "Malloc1", 00:22:38.125 "nguid": "B3BE314AB14E49D69880809D7D371C00", 00:22:38.125 "uuid": "b3be314a-b14e-49d6-9880-809d7d371c00" 00:22:38.125 } 00:22:38.125 ] 00:22:38.125 } 00:22:38.125 ] 00:22:38.125 11:46:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:38.125 11:46:57 -- host/aer.sh@43 -- # wait 3879827 00:22:38.125 11:46:57 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:22:38.125 11:46:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:38.125 11:46:57 -- common/autotest_common.sh@10 -- # set +x 00:22:38.125 11:46:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:38.125 11:46:58 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:22:38.125 11:46:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:38.125 11:46:58 -- common/autotest_common.sh@10 -- # set +x 00:22:38.125 11:46:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:38.125 11:46:58 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:38.125 11:46:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:38.125 11:46:58 -- common/autotest_common.sh@10 -- # set +x 00:22:38.125 11:46:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:38.125 11:46:58 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:22:38.125 11:46:58 -- host/aer.sh@51 -- # nvmftestfini 00:22:38.125 11:46:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:38.125 11:46:58 -- nvmf/common.sh@116 -- # sync 00:22:38.125 11:46:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:38.125 11:46:58 -- nvmf/common.sh@119 -- # set +e 00:22:38.125 11:46:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:38.125 11:46:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:38.125 rmmod nvme_tcp 00:22:38.125 rmmod nvme_fabrics 00:22:38.125 rmmod nvme_keyring 00:22:38.125 11:46:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:38.125 11:46:58 -- nvmf/common.sh@123 -- # set -e 00:22:38.125 11:46:58 -- nvmf/common.sh@124 -- # return 0 00:22:38.125 11:46:58 -- nvmf/common.sh@477 -- # '[' -n 3879665 ']' 00:22:38.125 11:46:58 -- nvmf/common.sh@478 -- # killprocess 3879665 00:22:38.125 11:46:58 -- common/autotest_common.sh@936 -- # '[' -z 3879665 ']' 00:22:38.125 11:46:58 -- common/autotest_common.sh@940 -- # kill -0 3879665 00:22:38.125 11:46:58 -- common/autotest_common.sh@941 -- # uname 00:22:38.125 11:46:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:38.125 11:46:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3879665 00:22:38.125 11:46:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:38.125 11:46:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:38.125 11:46:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3879665' 00:22:38.125 killing process with pid 3879665 00:22:38.125 11:46:58 -- common/autotest_common.sh@955 -- # kill 3879665 00:22:38.125 [2024-11-28 11:46:58.150322] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:38.125 11:46:58 -- common/autotest_common.sh@960 -- # wait 3879665 00:22:38.384 11:46:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:38.384 11:46:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:38.384 11:46:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:38.384 11:46:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:38.384 11:46:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:38.384 11:46:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:38.384 11:46:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:38.384 11:46:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:40.916 11:47:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:40.916 00:22:40.916 real 0m6.218s 00:22:40.916 user 0m7.425s 00:22:40.916 sys 0m1.947s 00:22:40.916 11:47:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:40.916 11:47:00 -- common/autotest_common.sh@10 -- # set +x 00:22:40.916 ************************************ 00:22:40.916 END TEST nvmf_aer 00:22:40.916 ************************************ 00:22:40.916 11:47:00 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:22:40.916 11:47:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:40.916 11:47:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:40.916 11:47:00 -- common/autotest_common.sh@10 -- # set +x 00:22:40.916 ************************************ 00:22:40.916 START TEST nvmf_async_init 00:22:40.916 ************************************ 00:22:40.916 11:47:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:22:40.916 * Looking for test storage... 00:22:40.916 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:40.916 11:47:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:40.916 11:47:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:40.916 11:47:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:40.916 11:47:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:40.916 11:47:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:40.916 11:47:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:40.916 11:47:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:40.916 11:47:00 -- scripts/common.sh@335 -- # IFS=.-: 00:22:40.917 11:47:00 -- scripts/common.sh@335 -- # read -ra ver1 00:22:40.917 11:47:00 -- scripts/common.sh@336 -- # IFS=.-: 00:22:40.917 11:47:00 -- scripts/common.sh@336 -- # read -ra ver2 00:22:40.917 11:47:00 -- scripts/common.sh@337 -- # local 'op=<' 00:22:40.917 11:47:00 -- scripts/common.sh@339 -- # ver1_l=2 00:22:40.917 11:47:00 -- scripts/common.sh@340 -- # ver2_l=1 00:22:40.917 11:47:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:40.917 11:47:00 -- scripts/common.sh@343 -- # case "$op" in 00:22:40.917 11:47:00 -- scripts/common.sh@344 -- # : 1 00:22:40.917 11:47:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:40.917 11:47:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:40.917 11:47:00 -- scripts/common.sh@364 -- # decimal 1 00:22:40.917 11:47:00 -- scripts/common.sh@352 -- # local d=1 00:22:40.917 11:47:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:40.917 11:47:00 -- scripts/common.sh@354 -- # echo 1 00:22:40.917 11:47:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:40.917 11:47:00 -- scripts/common.sh@365 -- # decimal 2 00:22:40.917 11:47:00 -- scripts/common.sh@352 -- # local d=2 00:22:40.917 11:47:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:40.917 11:47:00 -- scripts/common.sh@354 -- # echo 2 00:22:40.917 11:47:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:40.917 11:47:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:40.917 11:47:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:40.917 11:47:00 -- scripts/common.sh@367 -- # return 0 00:22:40.917 11:47:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:40.917 11:47:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:40.917 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:40.917 --rc genhtml_branch_coverage=1 00:22:40.917 --rc genhtml_function_coverage=1 00:22:40.917 --rc genhtml_legend=1 00:22:40.917 --rc geninfo_all_blocks=1 00:22:40.917 --rc geninfo_unexecuted_blocks=1 00:22:40.917 00:22:40.917 ' 00:22:40.917 11:47:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:40.917 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:40.917 --rc genhtml_branch_coverage=1 00:22:40.917 --rc genhtml_function_coverage=1 00:22:40.917 --rc genhtml_legend=1 00:22:40.917 --rc geninfo_all_blocks=1 00:22:40.917 --rc geninfo_unexecuted_blocks=1 00:22:40.917 00:22:40.917 ' 00:22:40.917 11:47:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:40.917 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:40.917 --rc genhtml_branch_coverage=1 00:22:40.917 --rc genhtml_function_coverage=1 00:22:40.917 --rc genhtml_legend=1 00:22:40.917 --rc geninfo_all_blocks=1 00:22:40.917 --rc geninfo_unexecuted_blocks=1 00:22:40.917 00:22:40.917 ' 00:22:40.917 11:47:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:40.917 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:40.917 --rc genhtml_branch_coverage=1 00:22:40.917 --rc genhtml_function_coverage=1 00:22:40.917 --rc genhtml_legend=1 00:22:40.917 --rc geninfo_all_blocks=1 00:22:40.917 --rc geninfo_unexecuted_blocks=1 00:22:40.917 00:22:40.917 ' 00:22:40.917 11:47:00 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:40.917 11:47:00 -- nvmf/common.sh@7 -- # uname -s 00:22:40.917 11:47:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:40.917 11:47:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:40.917 11:47:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:40.917 11:47:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:40.917 11:47:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:40.917 11:47:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:40.917 11:47:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:40.917 11:47:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:40.917 11:47:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:40.917 11:47:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:40.917 11:47:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:40.917 11:47:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:40.917 11:47:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:40.917 11:47:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:40.917 11:47:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:40.917 11:47:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:40.917 11:47:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:40.917 11:47:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:40.917 11:47:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:40.917 11:47:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:40.917 11:47:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:40.917 11:47:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:40.917 11:47:00 -- paths/export.sh@5 -- # export PATH 00:22:40.917 11:47:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:40.917 11:47:00 -- nvmf/common.sh@46 -- # : 0 00:22:40.917 11:47:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:40.917 11:47:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:40.917 11:47:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:40.917 11:47:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:40.917 11:47:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:40.917 11:47:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:40.917 11:47:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:40.917 11:47:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:40.917 11:47:00 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:22:40.917 11:47:00 -- host/async_init.sh@14 -- # null_block_size=512 00:22:40.917 11:47:00 -- host/async_init.sh@15 -- # null_bdev=null0 00:22:40.917 11:47:00 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:22:40.917 11:47:00 -- host/async_init.sh@20 -- # uuidgen 00:22:40.917 11:47:00 -- host/async_init.sh@20 -- # tr -d - 00:22:40.917 11:47:00 -- host/async_init.sh@20 -- # nguid=4f22ff08b2294d03a64f5badd810efb6 00:22:40.917 11:47:00 -- host/async_init.sh@22 -- # nvmftestinit 00:22:40.917 11:47:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:40.917 11:47:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:40.917 11:47:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:40.917 11:47:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:40.917 11:47:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:40.917 11:47:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:40.917 11:47:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:40.917 11:47:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:40.917 11:47:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:40.917 11:47:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:40.917 11:47:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:40.917 11:47:00 -- common/autotest_common.sh@10 -- # set +x 00:22:42.816 11:47:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:42.816 11:47:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:42.816 11:47:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:42.816 11:47:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:42.816 11:47:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:42.816 11:47:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:42.816 11:47:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:42.816 11:47:02 -- nvmf/common.sh@294 -- # net_devs=() 00:22:42.816 11:47:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:42.816 11:47:02 -- nvmf/common.sh@295 -- # e810=() 00:22:42.816 11:47:02 -- nvmf/common.sh@295 -- # local -ga e810 00:22:42.816 11:47:02 -- nvmf/common.sh@296 -- # x722=() 00:22:42.817 11:47:02 -- nvmf/common.sh@296 -- # local -ga x722 00:22:42.817 11:47:02 -- nvmf/common.sh@297 -- # mlx=() 00:22:42.817 11:47:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:42.817 11:47:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:42.817 11:47:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:42.817 11:47:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:42.817 11:47:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:42.817 11:47:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:42.817 11:47:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:42.817 11:47:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:42.817 11:47:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:42.817 11:47:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:42.817 11:47:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:42.817 11:47:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:42.817 11:47:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:42.817 11:47:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:42.817 11:47:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:42.817 11:47:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:42.817 11:47:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:42.817 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:42.817 11:47:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:42.817 11:47:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:42.817 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:42.817 11:47:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:42.817 11:47:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:42.817 11:47:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:42.817 11:47:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:42.817 11:47:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:42.817 11:47:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:42.817 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:42.817 11:47:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:42.817 11:47:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:42.817 11:47:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:42.817 11:47:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:42.817 11:47:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:42.817 11:47:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:42.817 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:42.817 11:47:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:42.817 11:47:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:42.817 11:47:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:42.817 11:47:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:42.817 11:47:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:42.817 11:47:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:42.817 11:47:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:42.817 11:47:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:42.817 11:47:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:42.817 11:47:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:42.817 11:47:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:42.817 11:47:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:42.817 11:47:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:42.817 11:47:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:42.817 11:47:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:42.817 11:47:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:42.817 11:47:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:42.817 11:47:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:42.817 11:47:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:42.817 11:47:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:42.817 11:47:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:42.817 11:47:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:42.817 11:47:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:42.817 11:47:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:42.817 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:42.817 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:22:42.817 00:22:42.817 --- 10.0.0.2 ping statistics --- 00:22:42.817 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:42.817 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:22:42.817 11:47:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:42.817 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:42.817 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:22:42.817 00:22:42.817 --- 10.0.0.1 ping statistics --- 00:22:42.817 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:42.817 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:22:42.817 11:47:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:42.817 11:47:02 -- nvmf/common.sh@410 -- # return 0 00:22:42.817 11:47:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:42.817 11:47:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:42.817 11:47:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:42.817 11:47:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:42.817 11:47:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:42.817 11:47:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:42.817 11:47:02 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:22:42.817 11:47:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:42.817 11:47:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:42.817 11:47:02 -- common/autotest_common.sh@10 -- # set +x 00:22:42.817 11:47:02 -- nvmf/common.sh@469 -- # nvmfpid=3881776 00:22:42.817 11:47:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:22:42.817 11:47:02 -- nvmf/common.sh@470 -- # waitforlisten 3881776 00:22:42.817 11:47:02 -- common/autotest_common.sh@829 -- # '[' -z 3881776 ']' 00:22:42.817 11:47:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:42.817 11:47:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:42.817 11:47:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:42.817 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:42.817 11:47:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:42.817 11:47:02 -- common/autotest_common.sh@10 -- # set +x 00:22:42.817 [2024-11-28 11:47:02.744021] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:42.817 [2024-11-28 11:47:02.744098] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:42.817 EAL: No free 2048 kB hugepages reported on node 1 00:22:42.817 [2024-11-28 11:47:02.816410] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:43.076 [2024-11-28 11:47:02.930775] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:43.076 [2024-11-28 11:47:02.930943] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:43.076 [2024-11-28 11:47:02.930960] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:43.076 [2024-11-28 11:47:02.930982] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:43.076 [2024-11-28 11:47:02.931009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:44.008 11:47:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:44.008 11:47:03 -- common/autotest_common.sh@862 -- # return 0 00:22:44.008 11:47:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:44.008 11:47:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:44.008 11:47:03 -- common/autotest_common.sh@10 -- # set +x 00:22:44.008 11:47:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:44.008 11:47:03 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:22:44.008 11:47:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.008 11:47:03 -- common/autotest_common.sh@10 -- # set +x 00:22:44.008 [2024-11-28 11:47:03.808948] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:44.008 11:47:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.008 11:47:03 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:22:44.008 11:47:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.008 11:47:03 -- common/autotest_common.sh@10 -- # set +x 00:22:44.008 null0 00:22:44.008 11:47:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.008 11:47:03 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:22:44.008 11:47:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.008 11:47:03 -- common/autotest_common.sh@10 -- # set +x 00:22:44.008 11:47:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.008 11:47:03 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:22:44.008 11:47:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.008 11:47:03 -- common/autotest_common.sh@10 -- # set +x 00:22:44.008 11:47:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.008 11:47:03 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 4f22ff08b2294d03a64f5badd810efb6 00:22:44.008 11:47:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.008 11:47:03 -- common/autotest_common.sh@10 -- # set +x 00:22:44.008 11:47:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.008 11:47:03 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:22:44.008 11:47:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.008 11:47:03 -- common/autotest_common.sh@10 -- # set +x 00:22:44.008 [2024-11-28 11:47:03.849175] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:44.008 11:47:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.008 11:47:03 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:22:44.008 11:47:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.008 11:47:03 -- common/autotest_common.sh@10 -- # set +x 00:22:44.267 nvme0n1 00:22:44.267 11:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.267 11:47:04 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:44.267 11:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.267 11:47:04 -- common/autotest_common.sh@10 -- # set +x 00:22:44.267 [ 00:22:44.267 { 00:22:44.267 "name": "nvme0n1", 00:22:44.267 "aliases": [ 00:22:44.267 "4f22ff08-b229-4d03-a64f-5badd810efb6" 00:22:44.267 ], 00:22:44.267 "product_name": "NVMe disk", 00:22:44.267 "block_size": 512, 00:22:44.267 "num_blocks": 2097152, 00:22:44.267 "uuid": "4f22ff08-b229-4d03-a64f-5badd810efb6", 00:22:44.267 "assigned_rate_limits": { 00:22:44.267 "rw_ios_per_sec": 0, 00:22:44.267 "rw_mbytes_per_sec": 0, 00:22:44.267 "r_mbytes_per_sec": 0, 00:22:44.267 "w_mbytes_per_sec": 0 00:22:44.267 }, 00:22:44.267 "claimed": false, 00:22:44.267 "zoned": false, 00:22:44.267 "supported_io_types": { 00:22:44.267 "read": true, 00:22:44.267 "write": true, 00:22:44.267 "unmap": false, 00:22:44.267 "write_zeroes": true, 00:22:44.267 "flush": true, 00:22:44.267 "reset": true, 00:22:44.267 "compare": true, 00:22:44.267 "compare_and_write": true, 00:22:44.267 "abort": true, 00:22:44.267 "nvme_admin": true, 00:22:44.267 "nvme_io": true 00:22:44.267 }, 00:22:44.267 "driver_specific": { 00:22:44.267 "nvme": [ 00:22:44.267 { 00:22:44.267 "trid": { 00:22:44.267 "trtype": "TCP", 00:22:44.267 "adrfam": "IPv4", 00:22:44.267 "traddr": "10.0.0.2", 00:22:44.267 "trsvcid": "4420", 00:22:44.267 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:44.267 }, 00:22:44.267 "ctrlr_data": { 00:22:44.267 "cntlid": 1, 00:22:44.267 "vendor_id": "0x8086", 00:22:44.267 "model_number": "SPDK bdev Controller", 00:22:44.267 "serial_number": "00000000000000000000", 00:22:44.267 "firmware_revision": "24.01.1", 00:22:44.267 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:44.267 "oacs": { 00:22:44.267 "security": 0, 00:22:44.267 "format": 0, 00:22:44.267 "firmware": 0, 00:22:44.267 "ns_manage": 0 00:22:44.267 }, 00:22:44.267 "multi_ctrlr": true, 00:22:44.267 "ana_reporting": false 00:22:44.267 }, 00:22:44.267 "vs": { 00:22:44.267 "nvme_version": "1.3" 00:22:44.267 }, 00:22:44.267 "ns_data": { 00:22:44.267 "id": 1, 00:22:44.267 "can_share": true 00:22:44.267 } 00:22:44.267 } 00:22:44.267 ], 00:22:44.267 "mp_policy": "active_passive" 00:22:44.267 } 00:22:44.267 } 00:22:44.267 ] 00:22:44.267 11:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.267 11:47:04 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:22:44.267 11:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.267 11:47:04 -- common/autotest_common.sh@10 -- # set +x 00:22:44.267 [2024-11-28 11:47:04.097872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:22:44.267 [2024-11-28 11:47:04.097960] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1671ba0 (9): Bad file descriptor 00:22:44.267 [2024-11-28 11:47:04.229670] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:44.267 11:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.267 11:47:04 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:44.267 11:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.267 11:47:04 -- common/autotest_common.sh@10 -- # set +x 00:22:44.267 [ 00:22:44.267 { 00:22:44.267 "name": "nvme0n1", 00:22:44.267 "aliases": [ 00:22:44.267 "4f22ff08-b229-4d03-a64f-5badd810efb6" 00:22:44.267 ], 00:22:44.267 "product_name": "NVMe disk", 00:22:44.267 "block_size": 512, 00:22:44.267 "num_blocks": 2097152, 00:22:44.267 "uuid": "4f22ff08-b229-4d03-a64f-5badd810efb6", 00:22:44.267 "assigned_rate_limits": { 00:22:44.267 "rw_ios_per_sec": 0, 00:22:44.267 "rw_mbytes_per_sec": 0, 00:22:44.267 "r_mbytes_per_sec": 0, 00:22:44.267 "w_mbytes_per_sec": 0 00:22:44.267 }, 00:22:44.267 "claimed": false, 00:22:44.267 "zoned": false, 00:22:44.267 "supported_io_types": { 00:22:44.267 "read": true, 00:22:44.267 "write": true, 00:22:44.267 "unmap": false, 00:22:44.267 "write_zeroes": true, 00:22:44.267 "flush": true, 00:22:44.267 "reset": true, 00:22:44.267 "compare": true, 00:22:44.267 "compare_and_write": true, 00:22:44.267 "abort": true, 00:22:44.267 "nvme_admin": true, 00:22:44.267 "nvme_io": true 00:22:44.267 }, 00:22:44.267 "driver_specific": { 00:22:44.267 "nvme": [ 00:22:44.267 { 00:22:44.267 "trid": { 00:22:44.267 "trtype": "TCP", 00:22:44.267 "adrfam": "IPv4", 00:22:44.267 "traddr": "10.0.0.2", 00:22:44.267 "trsvcid": "4420", 00:22:44.267 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:44.267 }, 00:22:44.267 "ctrlr_data": { 00:22:44.267 "cntlid": 2, 00:22:44.267 "vendor_id": "0x8086", 00:22:44.267 "model_number": "SPDK bdev Controller", 00:22:44.267 "serial_number": "00000000000000000000", 00:22:44.267 "firmware_revision": "24.01.1", 00:22:44.267 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:44.267 "oacs": { 00:22:44.267 "security": 0, 00:22:44.267 "format": 0, 00:22:44.267 "firmware": 0, 00:22:44.267 "ns_manage": 0 00:22:44.267 }, 00:22:44.267 "multi_ctrlr": true, 00:22:44.267 "ana_reporting": false 00:22:44.267 }, 00:22:44.267 "vs": { 00:22:44.267 "nvme_version": "1.3" 00:22:44.267 }, 00:22:44.267 "ns_data": { 00:22:44.267 "id": 1, 00:22:44.267 "can_share": true 00:22:44.267 } 00:22:44.267 } 00:22:44.267 ], 00:22:44.267 "mp_policy": "active_passive" 00:22:44.267 } 00:22:44.267 } 00:22:44.267 ] 00:22:44.267 11:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.267 11:47:04 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:44.267 11:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.267 11:47:04 -- common/autotest_common.sh@10 -- # set +x 00:22:44.267 11:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.267 11:47:04 -- host/async_init.sh@53 -- # mktemp 00:22:44.267 11:47:04 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.heQi6JzzZy 00:22:44.267 11:47:04 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:22:44.267 11:47:04 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.heQi6JzzZy 00:22:44.268 11:47:04 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:22:44.268 11:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.268 11:47:04 -- common/autotest_common.sh@10 -- # set +x 00:22:44.268 11:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.268 11:47:04 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:22:44.268 11:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.268 11:47:04 -- common/autotest_common.sh@10 -- # set +x 00:22:44.268 [2024-11-28 11:47:04.274467] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:22:44.268 [2024-11-28 11:47:04.274683] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:44.268 11:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.268 11:47:04 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.heQi6JzzZy 00:22:44.268 11:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.268 11:47:04 -- common/autotest_common.sh@10 -- # set +x 00:22:44.268 11:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.268 11:47:04 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.heQi6JzzZy 00:22:44.268 11:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.268 11:47:04 -- common/autotest_common.sh@10 -- # set +x 00:22:44.268 [2024-11-28 11:47:04.290501] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:22:44.526 nvme0n1 00:22:44.526 11:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.526 11:47:04 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:44.526 11:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.526 11:47:04 -- common/autotest_common.sh@10 -- # set +x 00:22:44.526 [ 00:22:44.526 { 00:22:44.526 "name": "nvme0n1", 00:22:44.526 "aliases": [ 00:22:44.526 "4f22ff08-b229-4d03-a64f-5badd810efb6" 00:22:44.526 ], 00:22:44.526 "product_name": "NVMe disk", 00:22:44.526 "block_size": 512, 00:22:44.526 "num_blocks": 2097152, 00:22:44.526 "uuid": "4f22ff08-b229-4d03-a64f-5badd810efb6", 00:22:44.526 "assigned_rate_limits": { 00:22:44.526 "rw_ios_per_sec": 0, 00:22:44.526 "rw_mbytes_per_sec": 0, 00:22:44.526 "r_mbytes_per_sec": 0, 00:22:44.526 "w_mbytes_per_sec": 0 00:22:44.526 }, 00:22:44.526 "claimed": false, 00:22:44.526 "zoned": false, 00:22:44.526 "supported_io_types": { 00:22:44.526 "read": true, 00:22:44.526 "write": true, 00:22:44.526 "unmap": false, 00:22:44.526 "write_zeroes": true, 00:22:44.526 "flush": true, 00:22:44.526 "reset": true, 00:22:44.526 "compare": true, 00:22:44.526 "compare_and_write": true, 00:22:44.526 "abort": true, 00:22:44.526 "nvme_admin": true, 00:22:44.526 "nvme_io": true 00:22:44.526 }, 00:22:44.526 "driver_specific": { 00:22:44.526 "nvme": [ 00:22:44.526 { 00:22:44.526 "trid": { 00:22:44.526 "trtype": "TCP", 00:22:44.526 "adrfam": "IPv4", 00:22:44.526 "traddr": "10.0.0.2", 00:22:44.526 "trsvcid": "4421", 00:22:44.526 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:44.526 }, 00:22:44.526 "ctrlr_data": { 00:22:44.526 "cntlid": 3, 00:22:44.526 "vendor_id": "0x8086", 00:22:44.526 "model_number": "SPDK bdev Controller", 00:22:44.526 "serial_number": "00000000000000000000", 00:22:44.526 "firmware_revision": "24.01.1", 00:22:44.526 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:44.526 "oacs": { 00:22:44.526 "security": 0, 00:22:44.526 "format": 0, 00:22:44.526 "firmware": 0, 00:22:44.526 "ns_manage": 0 00:22:44.526 }, 00:22:44.526 "multi_ctrlr": true, 00:22:44.526 "ana_reporting": false 00:22:44.526 }, 00:22:44.526 "vs": { 00:22:44.526 "nvme_version": "1.3" 00:22:44.526 }, 00:22:44.526 "ns_data": { 00:22:44.526 "id": 1, 00:22:44.526 "can_share": true 00:22:44.526 } 00:22:44.526 } 00:22:44.526 ], 00:22:44.526 "mp_policy": "active_passive" 00:22:44.526 } 00:22:44.526 } 00:22:44.526 ] 00:22:44.526 11:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.526 11:47:04 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:44.526 11:47:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.526 11:47:04 -- common/autotest_common.sh@10 -- # set +x 00:22:44.526 11:47:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.526 11:47:04 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.heQi6JzzZy 00:22:44.526 11:47:04 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:22:44.526 11:47:04 -- host/async_init.sh@78 -- # nvmftestfini 00:22:44.526 11:47:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:44.526 11:47:04 -- nvmf/common.sh@116 -- # sync 00:22:44.526 11:47:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:44.526 11:47:04 -- nvmf/common.sh@119 -- # set +e 00:22:44.526 11:47:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:44.526 11:47:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:44.526 rmmod nvme_tcp 00:22:44.526 rmmod nvme_fabrics 00:22:44.526 rmmod nvme_keyring 00:22:44.526 11:47:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:44.526 11:47:04 -- nvmf/common.sh@123 -- # set -e 00:22:44.526 11:47:04 -- nvmf/common.sh@124 -- # return 0 00:22:44.526 11:47:04 -- nvmf/common.sh@477 -- # '[' -n 3881776 ']' 00:22:44.526 11:47:04 -- nvmf/common.sh@478 -- # killprocess 3881776 00:22:44.526 11:47:04 -- common/autotest_common.sh@936 -- # '[' -z 3881776 ']' 00:22:44.526 11:47:04 -- common/autotest_common.sh@940 -- # kill -0 3881776 00:22:44.526 11:47:04 -- common/autotest_common.sh@941 -- # uname 00:22:44.526 11:47:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:44.526 11:47:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3881776 00:22:44.526 11:47:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:44.526 11:47:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:44.526 11:47:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3881776' 00:22:44.526 killing process with pid 3881776 00:22:44.526 11:47:04 -- common/autotest_common.sh@955 -- # kill 3881776 00:22:44.526 11:47:04 -- common/autotest_common.sh@960 -- # wait 3881776 00:22:44.785 11:47:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:44.785 11:47:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:44.785 11:47:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:44.785 11:47:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:44.785 11:47:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:44.785 11:47:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:44.785 11:47:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:44.785 11:47:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:47.318 11:47:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:47.318 00:22:47.318 real 0m6.273s 00:22:47.318 user 0m3.185s 00:22:47.318 sys 0m1.794s 00:22:47.318 11:47:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:47.318 11:47:06 -- common/autotest_common.sh@10 -- # set +x 00:22:47.318 ************************************ 00:22:47.318 END TEST nvmf_async_init 00:22:47.318 ************************************ 00:22:47.318 11:47:06 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:22:47.318 11:47:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:47.318 11:47:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:47.318 11:47:06 -- common/autotest_common.sh@10 -- # set +x 00:22:47.318 ************************************ 00:22:47.318 START TEST dma 00:22:47.318 ************************************ 00:22:47.318 11:47:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:22:47.318 * Looking for test storage... 00:22:47.318 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:47.318 11:47:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:47.318 11:47:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:47.318 11:47:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:47.318 11:47:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:47.318 11:47:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:47.318 11:47:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:47.318 11:47:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:47.318 11:47:06 -- scripts/common.sh@335 -- # IFS=.-: 00:22:47.318 11:47:06 -- scripts/common.sh@335 -- # read -ra ver1 00:22:47.318 11:47:06 -- scripts/common.sh@336 -- # IFS=.-: 00:22:47.318 11:47:06 -- scripts/common.sh@336 -- # read -ra ver2 00:22:47.318 11:47:06 -- scripts/common.sh@337 -- # local 'op=<' 00:22:47.318 11:47:06 -- scripts/common.sh@339 -- # ver1_l=2 00:22:47.318 11:47:06 -- scripts/common.sh@340 -- # ver2_l=1 00:22:47.318 11:47:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:47.318 11:47:06 -- scripts/common.sh@343 -- # case "$op" in 00:22:47.318 11:47:06 -- scripts/common.sh@344 -- # : 1 00:22:47.318 11:47:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:47.318 11:47:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:47.318 11:47:06 -- scripts/common.sh@364 -- # decimal 1 00:22:47.318 11:47:06 -- scripts/common.sh@352 -- # local d=1 00:22:47.318 11:47:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:47.318 11:47:06 -- scripts/common.sh@354 -- # echo 1 00:22:47.318 11:47:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:47.318 11:47:06 -- scripts/common.sh@365 -- # decimal 2 00:22:47.318 11:47:06 -- scripts/common.sh@352 -- # local d=2 00:22:47.318 11:47:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:47.318 11:47:06 -- scripts/common.sh@354 -- # echo 2 00:22:47.318 11:47:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:47.318 11:47:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:47.318 11:47:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:47.318 11:47:06 -- scripts/common.sh@367 -- # return 0 00:22:47.318 11:47:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:47.318 11:47:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:47.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:47.318 --rc genhtml_branch_coverage=1 00:22:47.318 --rc genhtml_function_coverage=1 00:22:47.318 --rc genhtml_legend=1 00:22:47.318 --rc geninfo_all_blocks=1 00:22:47.318 --rc geninfo_unexecuted_blocks=1 00:22:47.318 00:22:47.318 ' 00:22:47.318 11:47:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:47.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:47.318 --rc genhtml_branch_coverage=1 00:22:47.318 --rc genhtml_function_coverage=1 00:22:47.318 --rc genhtml_legend=1 00:22:47.318 --rc geninfo_all_blocks=1 00:22:47.318 --rc geninfo_unexecuted_blocks=1 00:22:47.318 00:22:47.318 ' 00:22:47.318 11:47:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:47.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:47.318 --rc genhtml_branch_coverage=1 00:22:47.318 --rc genhtml_function_coverage=1 00:22:47.318 --rc genhtml_legend=1 00:22:47.318 --rc geninfo_all_blocks=1 00:22:47.318 --rc geninfo_unexecuted_blocks=1 00:22:47.318 00:22:47.318 ' 00:22:47.318 11:47:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:47.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:47.318 --rc genhtml_branch_coverage=1 00:22:47.318 --rc genhtml_function_coverage=1 00:22:47.318 --rc genhtml_legend=1 00:22:47.318 --rc geninfo_all_blocks=1 00:22:47.318 --rc geninfo_unexecuted_blocks=1 00:22:47.318 00:22:47.318 ' 00:22:47.318 11:47:06 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:47.318 11:47:06 -- nvmf/common.sh@7 -- # uname -s 00:22:47.318 11:47:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:47.318 11:47:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:47.318 11:47:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:47.318 11:47:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:47.318 11:47:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:47.318 11:47:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:47.319 11:47:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:47.319 11:47:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:47.319 11:47:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:47.319 11:47:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:47.319 11:47:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:47.319 11:47:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:47.319 11:47:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:47.319 11:47:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:47.319 11:47:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:47.319 11:47:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:47.319 11:47:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:47.319 11:47:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:47.319 11:47:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:47.319 11:47:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:47.319 11:47:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:47.319 11:47:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:47.319 11:47:06 -- paths/export.sh@5 -- # export PATH 00:22:47.319 11:47:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:47.319 11:47:06 -- nvmf/common.sh@46 -- # : 0 00:22:47.319 11:47:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:47.319 11:47:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:47.319 11:47:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:47.319 11:47:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:47.319 11:47:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:47.319 11:47:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:47.319 11:47:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:47.319 11:47:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:47.319 11:47:06 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:22:47.319 11:47:06 -- host/dma.sh@13 -- # exit 0 00:22:47.319 00:22:47.319 real 0m0.141s 00:22:47.319 user 0m0.101s 00:22:47.319 sys 0m0.048s 00:22:47.319 11:47:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:47.319 11:47:06 -- common/autotest_common.sh@10 -- # set +x 00:22:47.319 ************************************ 00:22:47.319 END TEST dma 00:22:47.319 ************************************ 00:22:47.319 11:47:06 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:22:47.319 11:47:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:47.319 11:47:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:47.319 11:47:06 -- common/autotest_common.sh@10 -- # set +x 00:22:47.319 ************************************ 00:22:47.319 START TEST nvmf_identify 00:22:47.319 ************************************ 00:22:47.319 11:47:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:22:47.319 * Looking for test storage... 00:22:47.319 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:47.319 11:47:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:47.319 11:47:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:47.319 11:47:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:47.319 11:47:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:47.319 11:47:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:47.319 11:47:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:47.319 11:47:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:47.319 11:47:07 -- scripts/common.sh@335 -- # IFS=.-: 00:22:47.319 11:47:07 -- scripts/common.sh@335 -- # read -ra ver1 00:22:47.319 11:47:07 -- scripts/common.sh@336 -- # IFS=.-: 00:22:47.319 11:47:07 -- scripts/common.sh@336 -- # read -ra ver2 00:22:47.319 11:47:07 -- scripts/common.sh@337 -- # local 'op=<' 00:22:47.319 11:47:07 -- scripts/common.sh@339 -- # ver1_l=2 00:22:47.319 11:47:07 -- scripts/common.sh@340 -- # ver2_l=1 00:22:47.319 11:47:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:47.319 11:47:07 -- scripts/common.sh@343 -- # case "$op" in 00:22:47.319 11:47:07 -- scripts/common.sh@344 -- # : 1 00:22:47.319 11:47:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:47.319 11:47:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:47.319 11:47:07 -- scripts/common.sh@364 -- # decimal 1 00:22:47.319 11:47:07 -- scripts/common.sh@352 -- # local d=1 00:22:47.319 11:47:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:47.319 11:47:07 -- scripts/common.sh@354 -- # echo 1 00:22:47.319 11:47:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:47.319 11:47:07 -- scripts/common.sh@365 -- # decimal 2 00:22:47.319 11:47:07 -- scripts/common.sh@352 -- # local d=2 00:22:47.319 11:47:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:47.319 11:47:07 -- scripts/common.sh@354 -- # echo 2 00:22:47.319 11:47:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:47.319 11:47:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:47.319 11:47:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:47.319 11:47:07 -- scripts/common.sh@367 -- # return 0 00:22:47.319 11:47:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:47.319 11:47:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:47.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:47.319 --rc genhtml_branch_coverage=1 00:22:47.319 --rc genhtml_function_coverage=1 00:22:47.319 --rc genhtml_legend=1 00:22:47.319 --rc geninfo_all_blocks=1 00:22:47.319 --rc geninfo_unexecuted_blocks=1 00:22:47.319 00:22:47.319 ' 00:22:47.319 11:47:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:47.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:47.319 --rc genhtml_branch_coverage=1 00:22:47.319 --rc genhtml_function_coverage=1 00:22:47.319 --rc genhtml_legend=1 00:22:47.319 --rc geninfo_all_blocks=1 00:22:47.319 --rc geninfo_unexecuted_blocks=1 00:22:47.319 00:22:47.319 ' 00:22:47.319 11:47:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:47.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:47.319 --rc genhtml_branch_coverage=1 00:22:47.319 --rc genhtml_function_coverage=1 00:22:47.319 --rc genhtml_legend=1 00:22:47.319 --rc geninfo_all_blocks=1 00:22:47.319 --rc geninfo_unexecuted_blocks=1 00:22:47.319 00:22:47.319 ' 00:22:47.319 11:47:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:47.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:47.320 --rc genhtml_branch_coverage=1 00:22:47.320 --rc genhtml_function_coverage=1 00:22:47.320 --rc genhtml_legend=1 00:22:47.320 --rc geninfo_all_blocks=1 00:22:47.320 --rc geninfo_unexecuted_blocks=1 00:22:47.320 00:22:47.320 ' 00:22:47.320 11:47:07 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:47.320 11:47:07 -- nvmf/common.sh@7 -- # uname -s 00:22:47.320 11:47:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:47.320 11:47:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:47.320 11:47:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:47.320 11:47:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:47.320 11:47:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:47.320 11:47:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:47.320 11:47:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:47.320 11:47:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:47.320 11:47:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:47.320 11:47:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:47.320 11:47:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:47.320 11:47:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:47.320 11:47:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:47.320 11:47:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:47.320 11:47:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:47.320 11:47:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:47.320 11:47:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:47.320 11:47:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:47.320 11:47:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:47.320 11:47:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:47.320 11:47:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:47.320 11:47:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:47.320 11:47:07 -- paths/export.sh@5 -- # export PATH 00:22:47.320 11:47:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:47.320 11:47:07 -- nvmf/common.sh@46 -- # : 0 00:22:47.320 11:47:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:47.320 11:47:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:47.320 11:47:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:47.320 11:47:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:47.320 11:47:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:47.320 11:47:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:47.320 11:47:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:47.320 11:47:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:47.320 11:47:07 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:47.320 11:47:07 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:47.320 11:47:07 -- host/identify.sh@14 -- # nvmftestinit 00:22:47.320 11:47:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:47.320 11:47:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:47.320 11:47:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:47.320 11:47:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:47.320 11:47:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:47.320 11:47:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:47.320 11:47:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:47.320 11:47:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:47.320 11:47:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:47.320 11:47:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:47.320 11:47:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:47.320 11:47:07 -- common/autotest_common.sh@10 -- # set +x 00:22:49.223 11:47:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:49.223 11:47:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:49.223 11:47:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:49.223 11:47:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:49.223 11:47:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:49.223 11:47:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:49.223 11:47:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:49.223 11:47:09 -- nvmf/common.sh@294 -- # net_devs=() 00:22:49.223 11:47:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:49.223 11:47:09 -- nvmf/common.sh@295 -- # e810=() 00:22:49.223 11:47:09 -- nvmf/common.sh@295 -- # local -ga e810 00:22:49.223 11:47:09 -- nvmf/common.sh@296 -- # x722=() 00:22:49.223 11:47:09 -- nvmf/common.sh@296 -- # local -ga x722 00:22:49.223 11:47:09 -- nvmf/common.sh@297 -- # mlx=() 00:22:49.223 11:47:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:49.223 11:47:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:49.223 11:47:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:49.223 11:47:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:49.223 11:47:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:49.223 11:47:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:49.223 11:47:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:49.223 11:47:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:49.223 11:47:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:49.223 11:47:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:49.223 11:47:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:49.223 11:47:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:49.223 11:47:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:49.223 11:47:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:49.223 11:47:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:49.223 11:47:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:49.223 11:47:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:49.223 11:47:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:49.223 11:47:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:49.223 11:47:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:49.223 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:49.223 11:47:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:49.223 11:47:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:49.223 11:47:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:49.223 11:47:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:49.223 11:47:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:49.223 11:47:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:49.223 11:47:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:49.223 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:49.223 11:47:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:49.223 11:47:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:49.223 11:47:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:49.223 11:47:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:49.223 11:47:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:49.223 11:47:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:49.224 11:47:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:49.224 11:47:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:49.224 11:47:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:49.224 11:47:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:49.224 11:47:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:49.224 11:47:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:49.224 11:47:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:49.224 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:49.224 11:47:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:49.224 11:47:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:49.224 11:47:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:49.224 11:47:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:49.224 11:47:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:49.224 11:47:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:49.224 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:49.224 11:47:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:49.224 11:47:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:49.224 11:47:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:49.224 11:47:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:49.224 11:47:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:49.224 11:47:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:49.224 11:47:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:49.224 11:47:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:49.224 11:47:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:49.224 11:47:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:49.224 11:47:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:49.224 11:47:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:49.224 11:47:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:49.224 11:47:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:49.224 11:47:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:49.224 11:47:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:49.224 11:47:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:49.224 11:47:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:49.224 11:47:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:49.224 11:47:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:49.224 11:47:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:49.224 11:47:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:49.224 11:47:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:49.224 11:47:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:49.224 11:47:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:49.224 11:47:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:49.224 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:49.224 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:22:49.224 00:22:49.224 --- 10.0.0.2 ping statistics --- 00:22:49.224 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:49.224 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:22:49.224 11:47:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:49.224 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:49.224 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:22:49.224 00:22:49.224 --- 10.0.0.1 ping statistics --- 00:22:49.224 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:49.224 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:22:49.224 11:47:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:49.224 11:47:09 -- nvmf/common.sh@410 -- # return 0 00:22:49.224 11:47:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:49.224 11:47:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:49.224 11:47:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:49.224 11:47:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:49.224 11:47:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:49.224 11:47:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:49.224 11:47:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:49.482 11:47:09 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:22:49.482 11:47:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:49.482 11:47:09 -- common/autotest_common.sh@10 -- # set +x 00:22:49.482 11:47:09 -- host/identify.sh@19 -- # nvmfpid=3884066 00:22:49.482 11:47:09 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:49.482 11:47:09 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:49.482 11:47:09 -- host/identify.sh@23 -- # waitforlisten 3884066 00:22:49.482 11:47:09 -- common/autotest_common.sh@829 -- # '[' -z 3884066 ']' 00:22:49.482 11:47:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:49.482 11:47:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:49.482 11:47:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:49.482 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:49.482 11:47:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:49.482 11:47:09 -- common/autotest_common.sh@10 -- # set +x 00:22:49.482 [2024-11-28 11:47:09.346749] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:49.482 [2024-11-28 11:47:09.346823] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:49.482 EAL: No free 2048 kB hugepages reported on node 1 00:22:49.482 [2024-11-28 11:47:09.415563] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:49.482 [2024-11-28 11:47:09.531606] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:49.482 [2024-11-28 11:47:09.531765] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:49.482 [2024-11-28 11:47:09.531784] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:49.482 [2024-11-28 11:47:09.531798] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:49.482 [2024-11-28 11:47:09.531885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:49.482 [2024-11-28 11:47:09.531939] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:49.482 [2024-11-28 11:47:09.532054] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:49.482 [2024-11-28 11:47:09.532057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:50.416 11:47:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:50.416 11:47:10 -- common/autotest_common.sh@862 -- # return 0 00:22:50.416 11:47:10 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:50.416 11:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.416 11:47:10 -- common/autotest_common.sh@10 -- # set +x 00:22:50.416 [2024-11-28 11:47:10.353182] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:50.416 11:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.416 11:47:10 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:22:50.416 11:47:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:50.416 11:47:10 -- common/autotest_common.sh@10 -- # set +x 00:22:50.416 11:47:10 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:50.416 11:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.416 11:47:10 -- common/autotest_common.sh@10 -- # set +x 00:22:50.416 Malloc0 00:22:50.416 11:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.416 11:47:10 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:50.416 11:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.416 11:47:10 -- common/autotest_common.sh@10 -- # set +x 00:22:50.416 11:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.416 11:47:10 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:22:50.416 11:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.416 11:47:10 -- common/autotest_common.sh@10 -- # set +x 00:22:50.416 11:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.416 11:47:10 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:50.416 11:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.416 11:47:10 -- common/autotest_common.sh@10 -- # set +x 00:22:50.416 [2024-11-28 11:47:10.435309] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:50.416 11:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.416 11:47:10 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:22:50.416 11:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.416 11:47:10 -- common/autotest_common.sh@10 -- # set +x 00:22:50.416 11:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.416 11:47:10 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:22:50.416 11:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.416 11:47:10 -- common/autotest_common.sh@10 -- # set +x 00:22:50.416 [2024-11-28 11:47:10.451059] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:50.416 [ 00:22:50.416 { 00:22:50.416 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:50.417 "subtype": "Discovery", 00:22:50.417 "listen_addresses": [ 00:22:50.417 { 00:22:50.417 "transport": "TCP", 00:22:50.417 "trtype": "TCP", 00:22:50.417 "adrfam": "IPv4", 00:22:50.417 "traddr": "10.0.0.2", 00:22:50.417 "trsvcid": "4420" 00:22:50.417 } 00:22:50.417 ], 00:22:50.417 "allow_any_host": true, 00:22:50.417 "hosts": [] 00:22:50.417 }, 00:22:50.417 { 00:22:50.417 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:50.417 "subtype": "NVMe", 00:22:50.417 "listen_addresses": [ 00:22:50.417 { 00:22:50.417 "transport": "TCP", 00:22:50.417 "trtype": "TCP", 00:22:50.417 "adrfam": "IPv4", 00:22:50.417 "traddr": "10.0.0.2", 00:22:50.417 "trsvcid": "4420" 00:22:50.417 } 00:22:50.417 ], 00:22:50.417 "allow_any_host": true, 00:22:50.417 "hosts": [], 00:22:50.417 "serial_number": "SPDK00000000000001", 00:22:50.417 "model_number": "SPDK bdev Controller", 00:22:50.417 "max_namespaces": 32, 00:22:50.417 "min_cntlid": 1, 00:22:50.417 "max_cntlid": 65519, 00:22:50.417 "namespaces": [ 00:22:50.417 { 00:22:50.417 "nsid": 1, 00:22:50.417 "bdev_name": "Malloc0", 00:22:50.417 "name": "Malloc0", 00:22:50.417 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:22:50.417 "eui64": "ABCDEF0123456789", 00:22:50.417 "uuid": "8fbb8f0e-a626-4814-b7be-782d2ef02299" 00:22:50.417 } 00:22:50.417 ] 00:22:50.417 } 00:22:50.417 ] 00:22:50.417 11:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.417 11:47:10 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:22:50.677 [2024-11-28 11:47:10.478469] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:50.677 [2024-11-28 11:47:10.478513] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3884226 ] 00:22:50.677 EAL: No free 2048 kB hugepages reported on node 1 00:22:50.677 [2024-11-28 11:47:10.511397] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:22:50.677 [2024-11-28 11:47:10.511471] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:22:50.677 [2024-11-28 11:47:10.511482] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:22:50.677 [2024-11-28 11:47:10.511502] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:22:50.677 [2024-11-28 11:47:10.511515] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:22:50.677 [2024-11-28 11:47:10.515579] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:22:50.677 [2024-11-28 11:47:10.515650] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1b84e10 0 00:22:50.677 [2024-11-28 11:47:10.522541] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:22:50.677 [2024-11-28 11:47:10.522564] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:22:50.677 [2024-11-28 11:47:10.522574] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:22:50.677 [2024-11-28 11:47:10.522585] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:22:50.677 [2024-11-28 11:47:10.522645] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.677 [2024-11-28 11:47:10.522659] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.677 [2024-11-28 11:47:10.522666] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b84e10) 00:22:50.677 [2024-11-28 11:47:10.522687] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:50.677 [2024-11-28 11:47:10.522716] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04b30, cid 0, qid 0 00:22:50.677 [2024-11-28 11:47:10.530544] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.677 [2024-11-28 11:47:10.530562] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.677 [2024-11-28 11:47:10.530570] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.677 [2024-11-28 11:47:10.530577] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c04b30) on tqpair=0x1b84e10 00:22:50.677 [2024-11-28 11:47:10.530599] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:50.677 [2024-11-28 11:47:10.530610] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:22:50.677 [2024-11-28 11:47:10.530620] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:22:50.678 [2024-11-28 11:47:10.530643] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.530652] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.530658] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b84e10) 00:22:50.678 [2024-11-28 11:47:10.530669] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.678 [2024-11-28 11:47:10.530692] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04b30, cid 0, qid 0 00:22:50.678 [2024-11-28 11:47:10.530839] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.678 [2024-11-28 11:47:10.530851] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.678 [2024-11-28 11:47:10.530858] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.530864] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c04b30) on tqpair=0x1b84e10 00:22:50.678 [2024-11-28 11:47:10.530875] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:22:50.678 [2024-11-28 11:47:10.530887] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:22:50.678 [2024-11-28 11:47:10.530900] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.530907] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.530913] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b84e10) 00:22:50.678 [2024-11-28 11:47:10.530923] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.678 [2024-11-28 11:47:10.530944] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04b30, cid 0, qid 0 00:22:50.678 [2024-11-28 11:47:10.531048] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.678 [2024-11-28 11:47:10.531063] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.678 [2024-11-28 11:47:10.531070] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.531076] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c04b30) on tqpair=0x1b84e10 00:22:50.678 [2024-11-28 11:47:10.531086] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:22:50.678 [2024-11-28 11:47:10.531105] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:22:50.678 [2024-11-28 11:47:10.531118] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.531125] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.531131] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b84e10) 00:22:50.678 [2024-11-28 11:47:10.531141] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.678 [2024-11-28 11:47:10.531162] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04b30, cid 0, qid 0 00:22:50.678 [2024-11-28 11:47:10.531258] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.678 [2024-11-28 11:47:10.531269] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.678 [2024-11-28 11:47:10.531276] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.531282] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c04b30) on tqpair=0x1b84e10 00:22:50.678 [2024-11-28 11:47:10.531292] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:50.678 [2024-11-28 11:47:10.531308] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.531316] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.531322] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b84e10) 00:22:50.678 [2024-11-28 11:47:10.531333] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.678 [2024-11-28 11:47:10.531353] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04b30, cid 0, qid 0 00:22:50.678 [2024-11-28 11:47:10.531496] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.678 [2024-11-28 11:47:10.531508] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.678 [2024-11-28 11:47:10.531515] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.531521] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c04b30) on tqpair=0x1b84e10 00:22:50.678 [2024-11-28 11:47:10.531541] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:22:50.678 [2024-11-28 11:47:10.531550] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:22:50.678 [2024-11-28 11:47:10.531562] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:50.678 [2024-11-28 11:47:10.531674] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:22:50.678 [2024-11-28 11:47:10.531682] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:50.678 [2024-11-28 11:47:10.531698] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.531705] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.531711] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b84e10) 00:22:50.678 [2024-11-28 11:47:10.531721] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.678 [2024-11-28 11:47:10.531743] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04b30, cid 0, qid 0 00:22:50.678 [2024-11-28 11:47:10.531890] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.678 [2024-11-28 11:47:10.531901] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.678 [2024-11-28 11:47:10.531908] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.531918] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c04b30) on tqpair=0x1b84e10 00:22:50.678 [2024-11-28 11:47:10.531929] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:50.678 [2024-11-28 11:47:10.531944] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.531953] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.531959] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b84e10) 00:22:50.678 [2024-11-28 11:47:10.531969] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.678 [2024-11-28 11:47:10.531990] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04b30, cid 0, qid 0 00:22:50.678 [2024-11-28 11:47:10.532094] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.678 [2024-11-28 11:47:10.532108] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.678 [2024-11-28 11:47:10.532115] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.532121] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c04b30) on tqpair=0x1b84e10 00:22:50.678 [2024-11-28 11:47:10.532130] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:50.678 [2024-11-28 11:47:10.532138] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:22:50.678 [2024-11-28 11:47:10.532150] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:22:50.678 [2024-11-28 11:47:10.532171] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:22:50.678 [2024-11-28 11:47:10.532188] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.532195] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.532201] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b84e10) 00:22:50.678 [2024-11-28 11:47:10.532212] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.678 [2024-11-28 11:47:10.532234] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04b30, cid 0, qid 0 00:22:50.678 [2024-11-28 11:47:10.532390] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.678 [2024-11-28 11:47:10.532405] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.678 [2024-11-28 11:47:10.532412] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.678 [2024-11-28 11:47:10.532418] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1b84e10): datao=0, datal=4096, cccid=0 00:22:50.678 [2024-11-28 11:47:10.532426] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1c04b30) on tqpair(0x1b84e10): expected_datao=0, payload_size=4096 00:22:50.679 [2024-11-28 11:47:10.532440] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.532450] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.532492] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.679 [2024-11-28 11:47:10.532506] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.679 [2024-11-28 11:47:10.532512] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.532519] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c04b30) on tqpair=0x1b84e10 00:22:50.679 [2024-11-28 11:47:10.532544] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:22:50.679 [2024-11-28 11:47:10.532555] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:22:50.679 [2024-11-28 11:47:10.532567] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:22:50.679 [2024-11-28 11:47:10.532577] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:22:50.679 [2024-11-28 11:47:10.532584] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:22:50.679 [2024-11-28 11:47:10.532592] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:22:50.679 [2024-11-28 11:47:10.532612] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:22:50.679 [2024-11-28 11:47:10.532626] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.532633] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.532640] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b84e10) 00:22:50.679 [2024-11-28 11:47:10.532651] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:50.679 [2024-11-28 11:47:10.532672] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04b30, cid 0, qid 0 00:22:50.679 [2024-11-28 11:47:10.532824] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.679 [2024-11-28 11:47:10.532838] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.679 [2024-11-28 11:47:10.532845] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.532851] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c04b30) on tqpair=0x1b84e10 00:22:50.679 [2024-11-28 11:47:10.532865] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.532872] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.532878] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b84e10) 00:22:50.679 [2024-11-28 11:47:10.532888] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.679 [2024-11-28 11:47:10.532898] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.532904] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.532910] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1b84e10) 00:22:50.679 [2024-11-28 11:47:10.532919] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.679 [2024-11-28 11:47:10.532928] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.532935] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.532941] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1b84e10) 00:22:50.679 [2024-11-28 11:47:10.532949] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.679 [2024-11-28 11:47:10.532959] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.532965] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.532971] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1b84e10) 00:22:50.679 [2024-11-28 11:47:10.532979] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.679 [2024-11-28 11:47:10.532988] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:22:50.679 [2024-11-28 11:47:10.533016] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:50.679 [2024-11-28 11:47:10.533032] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.533039] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.533045] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1b84e10) 00:22:50.679 [2024-11-28 11:47:10.533056] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.679 [2024-11-28 11:47:10.533089] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04b30, cid 0, qid 0 00:22:50.679 [2024-11-28 11:47:10.533100] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04c90, cid 1, qid 0 00:22:50.679 [2024-11-28 11:47:10.533108] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04df0, cid 2, qid 0 00:22:50.679 [2024-11-28 11:47:10.533115] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04f50, cid 3, qid 0 00:22:50.679 [2024-11-28 11:47:10.533122] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c050b0, cid 4, qid 0 00:22:50.679 [2024-11-28 11:47:10.533268] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.679 [2024-11-28 11:47:10.533283] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.679 [2024-11-28 11:47:10.533290] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.533296] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c050b0) on tqpair=0x1b84e10 00:22:50.679 [2024-11-28 11:47:10.533307] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:22:50.679 [2024-11-28 11:47:10.533316] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:22:50.679 [2024-11-28 11:47:10.533333] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.533342] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.533348] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1b84e10) 00:22:50.679 [2024-11-28 11:47:10.533358] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.679 [2024-11-28 11:47:10.533379] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c050b0, cid 4, qid 0 00:22:50.679 [2024-11-28 11:47:10.533493] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.679 [2024-11-28 11:47:10.533507] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.679 [2024-11-28 11:47:10.533514] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.533520] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1b84e10): datao=0, datal=4096, cccid=4 00:22:50.679 [2024-11-28 11:47:10.533536] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1c050b0) on tqpair(0x1b84e10): expected_datao=0, payload_size=4096 00:22:50.679 [2024-11-28 11:47:10.533555] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.533564] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.573678] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.679 [2024-11-28 11:47:10.573698] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.679 [2024-11-28 11:47:10.573705] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.573712] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c050b0) on tqpair=0x1b84e10 00:22:50.679 [2024-11-28 11:47:10.573735] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:22:50.679 [2024-11-28 11:47:10.573778] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.573789] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.573795] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1b84e10) 00:22:50.679 [2024-11-28 11:47:10.573810] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.679 [2024-11-28 11:47:10.573824] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.573831] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.679 [2024-11-28 11:47:10.573837] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1b84e10) 00:22:50.680 [2024-11-28 11:47:10.573846] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.680 [2024-11-28 11:47:10.573875] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c050b0, cid 4, qid 0 00:22:50.680 [2024-11-28 11:47:10.573887] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c05210, cid 5, qid 0 00:22:50.680 [2024-11-28 11:47:10.574148] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.680 [2024-11-28 11:47:10.574161] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.680 [2024-11-28 11:47:10.574168] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.574174] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1b84e10): datao=0, datal=1024, cccid=4 00:22:50.680 [2024-11-28 11:47:10.574181] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1c050b0) on tqpair(0x1b84e10): expected_datao=0, payload_size=1024 00:22:50.680 [2024-11-28 11:47:10.574192] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.574199] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.574207] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.680 [2024-11-28 11:47:10.574216] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.680 [2024-11-28 11:47:10.574222] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.574228] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c05210) on tqpair=0x1b84e10 00:22:50.680 [2024-11-28 11:47:10.614613] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.680 [2024-11-28 11:47:10.614631] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.680 [2024-11-28 11:47:10.614638] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.614644] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c050b0) on tqpair=0x1b84e10 00:22:50.680 [2024-11-28 11:47:10.614664] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.614673] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.614679] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1b84e10) 00:22:50.680 [2024-11-28 11:47:10.614690] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.680 [2024-11-28 11:47:10.614720] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c050b0, cid 4, qid 0 00:22:50.680 [2024-11-28 11:47:10.614865] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.680 [2024-11-28 11:47:10.614880] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.680 [2024-11-28 11:47:10.614887] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.614893] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1b84e10): datao=0, datal=3072, cccid=4 00:22:50.680 [2024-11-28 11:47:10.614900] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1c050b0) on tqpair(0x1b84e10): expected_datao=0, payload_size=3072 00:22:50.680 [2024-11-28 11:47:10.614911] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.614918] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.614930] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.680 [2024-11-28 11:47:10.614940] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.680 [2024-11-28 11:47:10.614951] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.614958] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c050b0) on tqpair=0x1b84e10 00:22:50.680 [2024-11-28 11:47:10.614976] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.614984] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.614990] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1b84e10) 00:22:50.680 [2024-11-28 11:47:10.615000] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.680 [2024-11-28 11:47:10.615029] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c050b0, cid 4, qid 0 00:22:50.680 [2024-11-28 11:47:10.615161] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.680 [2024-11-28 11:47:10.615173] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.680 [2024-11-28 11:47:10.615180] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.615186] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1b84e10): datao=0, datal=8, cccid=4 00:22:50.680 [2024-11-28 11:47:10.615193] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1c050b0) on tqpair(0x1b84e10): expected_datao=0, payload_size=8 00:22:50.680 [2024-11-28 11:47:10.615203] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.615210] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.655621] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.680 [2024-11-28 11:47:10.655640] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.680 [2024-11-28 11:47:10.655648] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.680 [2024-11-28 11:47:10.655654] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c050b0) on tqpair=0x1b84e10 00:22:50.680 ===================================================== 00:22:50.680 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:22:50.680 ===================================================== 00:22:50.680 Controller Capabilities/Features 00:22:50.680 ================================ 00:22:50.680 Vendor ID: 0000 00:22:50.680 Subsystem Vendor ID: 0000 00:22:50.680 Serial Number: .................... 00:22:50.680 Model Number: ........................................ 00:22:50.680 Firmware Version: 24.01.1 00:22:50.680 Recommended Arb Burst: 0 00:22:50.680 IEEE OUI Identifier: 00 00 00 00:22:50.680 Multi-path I/O 00:22:50.680 May have multiple subsystem ports: No 00:22:50.680 May have multiple controllers: No 00:22:50.680 Associated with SR-IOV VF: No 00:22:50.680 Max Data Transfer Size: 131072 00:22:50.680 Max Number of Namespaces: 0 00:22:50.680 Max Number of I/O Queues: 1024 00:22:50.680 NVMe Specification Version (VS): 1.3 00:22:50.680 NVMe Specification Version (Identify): 1.3 00:22:50.680 Maximum Queue Entries: 128 00:22:50.680 Contiguous Queues Required: Yes 00:22:50.680 Arbitration Mechanisms Supported 00:22:50.680 Weighted Round Robin: Not Supported 00:22:50.680 Vendor Specific: Not Supported 00:22:50.680 Reset Timeout: 15000 ms 00:22:50.680 Doorbell Stride: 4 bytes 00:22:50.680 NVM Subsystem Reset: Not Supported 00:22:50.680 Command Sets Supported 00:22:50.680 NVM Command Set: Supported 00:22:50.680 Boot Partition: Not Supported 00:22:50.680 Memory Page Size Minimum: 4096 bytes 00:22:50.680 Memory Page Size Maximum: 4096 bytes 00:22:50.680 Persistent Memory Region: Not Supported 00:22:50.680 Optional Asynchronous Events Supported 00:22:50.680 Namespace Attribute Notices: Not Supported 00:22:50.680 Firmware Activation Notices: Not Supported 00:22:50.680 ANA Change Notices: Not Supported 00:22:50.680 PLE Aggregate Log Change Notices: Not Supported 00:22:50.680 LBA Status Info Alert Notices: Not Supported 00:22:50.680 EGE Aggregate Log Change Notices: Not Supported 00:22:50.680 Normal NVM Subsystem Shutdown event: Not Supported 00:22:50.680 Zone Descriptor Change Notices: Not Supported 00:22:50.680 Discovery Log Change Notices: Supported 00:22:50.680 Controller Attributes 00:22:50.680 128-bit Host Identifier: Not Supported 00:22:50.680 Non-Operational Permissive Mode: Not Supported 00:22:50.680 NVM Sets: Not Supported 00:22:50.680 Read Recovery Levels: Not Supported 00:22:50.680 Endurance Groups: Not Supported 00:22:50.680 Predictable Latency Mode: Not Supported 00:22:50.680 Traffic Based Keep ALive: Not Supported 00:22:50.681 Namespace Granularity: Not Supported 00:22:50.681 SQ Associations: Not Supported 00:22:50.681 UUID List: Not Supported 00:22:50.681 Multi-Domain Subsystem: Not Supported 00:22:50.681 Fixed Capacity Management: Not Supported 00:22:50.681 Variable Capacity Management: Not Supported 00:22:50.681 Delete Endurance Group: Not Supported 00:22:50.681 Delete NVM Set: Not Supported 00:22:50.681 Extended LBA Formats Supported: Not Supported 00:22:50.681 Flexible Data Placement Supported: Not Supported 00:22:50.681 00:22:50.681 Controller Memory Buffer Support 00:22:50.681 ================================ 00:22:50.681 Supported: No 00:22:50.681 00:22:50.681 Persistent Memory Region Support 00:22:50.681 ================================ 00:22:50.681 Supported: No 00:22:50.681 00:22:50.681 Admin Command Set Attributes 00:22:50.681 ============================ 00:22:50.681 Security Send/Receive: Not Supported 00:22:50.681 Format NVM: Not Supported 00:22:50.681 Firmware Activate/Download: Not Supported 00:22:50.681 Namespace Management: Not Supported 00:22:50.681 Device Self-Test: Not Supported 00:22:50.681 Directives: Not Supported 00:22:50.681 NVMe-MI: Not Supported 00:22:50.681 Virtualization Management: Not Supported 00:22:50.681 Doorbell Buffer Config: Not Supported 00:22:50.681 Get LBA Status Capability: Not Supported 00:22:50.681 Command & Feature Lockdown Capability: Not Supported 00:22:50.681 Abort Command Limit: 1 00:22:50.681 Async Event Request Limit: 4 00:22:50.681 Number of Firmware Slots: N/A 00:22:50.681 Firmware Slot 1 Read-Only: N/A 00:22:50.681 Firmware Activation Without Reset: N/A 00:22:50.681 Multiple Update Detection Support: N/A 00:22:50.681 Firmware Update Granularity: No Information Provided 00:22:50.681 Per-Namespace SMART Log: No 00:22:50.681 Asymmetric Namespace Access Log Page: Not Supported 00:22:50.681 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:22:50.681 Command Effects Log Page: Not Supported 00:22:50.681 Get Log Page Extended Data: Supported 00:22:50.681 Telemetry Log Pages: Not Supported 00:22:50.681 Persistent Event Log Pages: Not Supported 00:22:50.681 Supported Log Pages Log Page: May Support 00:22:50.681 Commands Supported & Effects Log Page: Not Supported 00:22:50.681 Feature Identifiers & Effects Log Page:May Support 00:22:50.681 NVMe-MI Commands & Effects Log Page: May Support 00:22:50.681 Data Area 4 for Telemetry Log: Not Supported 00:22:50.681 Error Log Page Entries Supported: 128 00:22:50.681 Keep Alive: Not Supported 00:22:50.681 00:22:50.681 NVM Command Set Attributes 00:22:50.681 ========================== 00:22:50.681 Submission Queue Entry Size 00:22:50.681 Max: 1 00:22:50.681 Min: 1 00:22:50.681 Completion Queue Entry Size 00:22:50.681 Max: 1 00:22:50.681 Min: 1 00:22:50.681 Number of Namespaces: 0 00:22:50.681 Compare Command: Not Supported 00:22:50.681 Write Uncorrectable Command: Not Supported 00:22:50.681 Dataset Management Command: Not Supported 00:22:50.681 Write Zeroes Command: Not Supported 00:22:50.681 Set Features Save Field: Not Supported 00:22:50.681 Reservations: Not Supported 00:22:50.681 Timestamp: Not Supported 00:22:50.681 Copy: Not Supported 00:22:50.681 Volatile Write Cache: Not Present 00:22:50.681 Atomic Write Unit (Normal): 1 00:22:50.681 Atomic Write Unit (PFail): 1 00:22:50.681 Atomic Compare & Write Unit: 1 00:22:50.681 Fused Compare & Write: Supported 00:22:50.681 Scatter-Gather List 00:22:50.681 SGL Command Set: Supported 00:22:50.681 SGL Keyed: Supported 00:22:50.681 SGL Bit Bucket Descriptor: Not Supported 00:22:50.681 SGL Metadata Pointer: Not Supported 00:22:50.681 Oversized SGL: Not Supported 00:22:50.681 SGL Metadata Address: Not Supported 00:22:50.681 SGL Offset: Supported 00:22:50.681 Transport SGL Data Block: Not Supported 00:22:50.681 Replay Protected Memory Block: Not Supported 00:22:50.681 00:22:50.681 Firmware Slot Information 00:22:50.681 ========================= 00:22:50.681 Active slot: 0 00:22:50.681 00:22:50.681 00:22:50.681 Error Log 00:22:50.681 ========= 00:22:50.681 00:22:50.681 Active Namespaces 00:22:50.681 ================= 00:22:50.681 Discovery Log Page 00:22:50.681 ================== 00:22:50.681 Generation Counter: 2 00:22:50.681 Number of Records: 2 00:22:50.681 Record Format: 0 00:22:50.681 00:22:50.681 Discovery Log Entry 0 00:22:50.681 ---------------------- 00:22:50.681 Transport Type: 3 (TCP) 00:22:50.681 Address Family: 1 (IPv4) 00:22:50.681 Subsystem Type: 3 (Current Discovery Subsystem) 00:22:50.681 Entry Flags: 00:22:50.681 Duplicate Returned Information: 1 00:22:50.681 Explicit Persistent Connection Support for Discovery: 1 00:22:50.681 Transport Requirements: 00:22:50.681 Secure Channel: Not Required 00:22:50.681 Port ID: 0 (0x0000) 00:22:50.681 Controller ID: 65535 (0xffff) 00:22:50.681 Admin Max SQ Size: 128 00:22:50.681 Transport Service Identifier: 4420 00:22:50.681 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:22:50.681 Transport Address: 10.0.0.2 00:22:50.681 Discovery Log Entry 1 00:22:50.681 ---------------------- 00:22:50.681 Transport Type: 3 (TCP) 00:22:50.681 Address Family: 1 (IPv4) 00:22:50.681 Subsystem Type: 2 (NVM Subsystem) 00:22:50.681 Entry Flags: 00:22:50.681 Duplicate Returned Information: 0 00:22:50.681 Explicit Persistent Connection Support for Discovery: 0 00:22:50.681 Transport Requirements: 00:22:50.681 Secure Channel: Not Required 00:22:50.681 Port ID: 0 (0x0000) 00:22:50.681 Controller ID: 65535 (0xffff) 00:22:50.681 Admin Max SQ Size: 128 00:22:50.681 Transport Service Identifier: 4420 00:22:50.681 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:22:50.681 Transport Address: 10.0.0.2 [2024-11-28 11:47:10.655782] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:22:50.681 [2024-11-28 11:47:10.655811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.681 [2024-11-28 11:47:10.655823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.682 [2024-11-28 11:47:10.655833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.682 [2024-11-28 11:47:10.655842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.682 [2024-11-28 11:47:10.655856] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.682 [2024-11-28 11:47:10.655864] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.682 [2024-11-28 11:47:10.655870] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1b84e10) 00:22:50.682 [2024-11-28 11:47:10.655881] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.682 [2024-11-28 11:47:10.655908] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04f50, cid 3, qid 0 00:22:50.682 [2024-11-28 11:47:10.656026] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.682 [2024-11-28 11:47:10.656041] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.682 [2024-11-28 11:47:10.656047] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.682 [2024-11-28 11:47:10.656054] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c04f50) on tqpair=0x1b84e10 00:22:50.682 [2024-11-28 11:47:10.656069] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.682 [2024-11-28 11:47:10.656076] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.682 [2024-11-28 11:47:10.656082] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1b84e10) 00:22:50.682 [2024-11-28 11:47:10.656097] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.682 [2024-11-28 11:47:10.656124] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04f50, cid 3, qid 0 00:22:50.682 [2024-11-28 11:47:10.656270] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.682 [2024-11-28 11:47:10.656282] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.682 [2024-11-28 11:47:10.656288] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.682 [2024-11-28 11:47:10.656295] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c04f50) on tqpair=0x1b84e10 00:22:50.682 [2024-11-28 11:47:10.656306] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:22:50.682 [2024-11-28 11:47:10.656314] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:22:50.682 [2024-11-28 11:47:10.656329] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.682 [2024-11-28 11:47:10.656337] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.682 [2024-11-28 11:47:10.656343] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1b84e10) 00:22:50.682 [2024-11-28 11:47:10.656353] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.682 [2024-11-28 11:47:10.656374] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04f50, cid 3, qid 0 00:22:50.682 [2024-11-28 11:47:10.656487] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.682 [2024-11-28 11:47:10.656501] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.682 [2024-11-28 11:47:10.656508] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.682 [2024-11-28 11:47:10.656514] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c04f50) on tqpair=0x1b84e10 00:22:50.682 [2024-11-28 11:47:10.660543] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.682 [2024-11-28 11:47:10.660558] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.682 [2024-11-28 11:47:10.660565] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1b84e10) 00:22:50.682 [2024-11-28 11:47:10.660576] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.682 [2024-11-28 11:47:10.660598] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1c04f50, cid 3, qid 0 00:22:50.682 [2024-11-28 11:47:10.660711] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.682 [2024-11-28 11:47:10.660723] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.682 [2024-11-28 11:47:10.660730] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.682 [2024-11-28 11:47:10.660736] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1c04f50) on tqpair=0x1b84e10 00:22:50.682 [2024-11-28 11:47:10.660751] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 4 milliseconds 00:22:50.682 00:22:50.682 11:47:10 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:22:50.682 [2024-11-28 11:47:10.692688] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:50.682 [2024-11-28 11:47:10.692729] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3884228 ] 00:22:50.682 EAL: No free 2048 kB hugepages reported on node 1 00:22:50.682 [2024-11-28 11:47:10.726955] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:22:50.682 [2024-11-28 11:47:10.727010] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:22:50.682 [2024-11-28 11:47:10.727020] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:22:50.682 [2024-11-28 11:47:10.727039] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:22:50.682 [2024-11-28 11:47:10.727052] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:22:50.682 [2024-11-28 11:47:10.727264] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:22:50.682 [2024-11-28 11:47:10.727309] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1a2fe10 0 00:22:50.944 [2024-11-28 11:47:10.737543] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:22:50.944 [2024-11-28 11:47:10.737564] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:22:50.944 [2024-11-28 11:47:10.737573] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:22:50.944 [2024-11-28 11:47:10.737579] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:22:50.944 [2024-11-28 11:47:10.737621] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.944 [2024-11-28 11:47:10.737632] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.944 [2024-11-28 11:47:10.737639] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1a2fe10) 00:22:50.944 [2024-11-28 11:47:10.737655] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:50.944 [2024-11-28 11:47:10.737681] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aafb30, cid 0, qid 0 00:22:50.944 [2024-11-28 11:47:10.748542] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.944 [2024-11-28 11:47:10.748562] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.944 [2024-11-28 11:47:10.748570] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.944 [2024-11-28 11:47:10.748577] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aafb30) on tqpair=0x1a2fe10 00:22:50.944 [2024-11-28 11:47:10.748607] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:50.944 [2024-11-28 11:47:10.748620] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:22:50.944 [2024-11-28 11:47:10.748629] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:22:50.944 [2024-11-28 11:47:10.748647] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.944 [2024-11-28 11:47:10.748656] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.944 [2024-11-28 11:47:10.748662] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1a2fe10) 00:22:50.944 [2024-11-28 11:47:10.748673] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.944 [2024-11-28 11:47:10.748698] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aafb30, cid 0, qid 0 00:22:50.944 [2024-11-28 11:47:10.748811] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.944 [2024-11-28 11:47:10.748824] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.944 [2024-11-28 11:47:10.748831] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.944 [2024-11-28 11:47:10.748838] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aafb30) on tqpair=0x1a2fe10 00:22:50.944 [2024-11-28 11:47:10.748847] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:22:50.944 [2024-11-28 11:47:10.748860] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:22:50.944 [2024-11-28 11:47:10.748872] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.944 [2024-11-28 11:47:10.748880] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.944 [2024-11-28 11:47:10.748890] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1a2fe10) 00:22:50.944 [2024-11-28 11:47:10.748901] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.945 [2024-11-28 11:47:10.748923] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aafb30, cid 0, qid 0 00:22:50.945 [2024-11-28 11:47:10.749015] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.945 [2024-11-28 11:47:10.749028] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.945 [2024-11-28 11:47:10.749035] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.749041] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aafb30) on tqpair=0x1a2fe10 00:22:50.945 [2024-11-28 11:47:10.749051] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:22:50.945 [2024-11-28 11:47:10.749065] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:22:50.945 [2024-11-28 11:47:10.749077] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.749084] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.749090] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1a2fe10) 00:22:50.945 [2024-11-28 11:47:10.749100] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.945 [2024-11-28 11:47:10.749121] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aafb30, cid 0, qid 0 00:22:50.945 [2024-11-28 11:47:10.749230] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.945 [2024-11-28 11:47:10.749242] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.945 [2024-11-28 11:47:10.749249] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.749256] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aafb30) on tqpair=0x1a2fe10 00:22:50.945 [2024-11-28 11:47:10.749265] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:50.945 [2024-11-28 11:47:10.749281] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.749290] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.749296] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1a2fe10) 00:22:50.945 [2024-11-28 11:47:10.749307] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.945 [2024-11-28 11:47:10.749327] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aafb30, cid 0, qid 0 00:22:50.945 [2024-11-28 11:47:10.749436] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.945 [2024-11-28 11:47:10.749448] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.945 [2024-11-28 11:47:10.749455] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.749461] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aafb30) on tqpair=0x1a2fe10 00:22:50.945 [2024-11-28 11:47:10.749471] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:22:50.945 [2024-11-28 11:47:10.749480] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:22:50.945 [2024-11-28 11:47:10.749492] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:50.945 [2024-11-28 11:47:10.749603] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:22:50.945 [2024-11-28 11:47:10.749611] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:50.945 [2024-11-28 11:47:10.749630] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.749638] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.749644] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1a2fe10) 00:22:50.945 [2024-11-28 11:47:10.749654] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.945 [2024-11-28 11:47:10.749676] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aafb30, cid 0, qid 0 00:22:50.945 [2024-11-28 11:47:10.749788] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.945 [2024-11-28 11:47:10.749801] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.945 [2024-11-28 11:47:10.749808] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.749814] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aafb30) on tqpair=0x1a2fe10 00:22:50.945 [2024-11-28 11:47:10.749823] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:50.945 [2024-11-28 11:47:10.749839] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.749847] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.749854] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1a2fe10) 00:22:50.945 [2024-11-28 11:47:10.749864] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.945 [2024-11-28 11:47:10.749885] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aafb30, cid 0, qid 0 00:22:50.945 [2024-11-28 11:47:10.749988] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.945 [2024-11-28 11:47:10.750003] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.945 [2024-11-28 11:47:10.750010] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.750017] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aafb30) on tqpair=0x1a2fe10 00:22:50.945 [2024-11-28 11:47:10.750025] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:50.945 [2024-11-28 11:47:10.750034] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:22:50.945 [2024-11-28 11:47:10.750047] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:22:50.945 [2024-11-28 11:47:10.750061] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:22:50.945 [2024-11-28 11:47:10.750076] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.750083] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.750089] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1a2fe10) 00:22:50.945 [2024-11-28 11:47:10.750100] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.945 [2024-11-28 11:47:10.750122] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aafb30, cid 0, qid 0 00:22:50.945 [2024-11-28 11:47:10.750255] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.945 [2024-11-28 11:47:10.750270] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.945 [2024-11-28 11:47:10.750277] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.750284] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1a2fe10): datao=0, datal=4096, cccid=0 00:22:50.945 [2024-11-28 11:47:10.750291] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1aafb30) on tqpair(0x1a2fe10): expected_datao=0, payload_size=4096 00:22:50.945 [2024-11-28 11:47:10.750322] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.750332] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.750395] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.945 [2024-11-28 11:47:10.750410] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.945 [2024-11-28 11:47:10.750417] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.750424] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aafb30) on tqpair=0x1a2fe10 00:22:50.945 [2024-11-28 11:47:10.750437] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:22:50.945 [2024-11-28 11:47:10.750446] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:22:50.945 [2024-11-28 11:47:10.750454] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:22:50.945 [2024-11-28 11:47:10.750462] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:22:50.945 [2024-11-28 11:47:10.750469] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:22:50.945 [2024-11-28 11:47:10.750477] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:22:50.945 [2024-11-28 11:47:10.750497] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:22:50.945 [2024-11-28 11:47:10.750511] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.750518] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.945 [2024-11-28 11:47:10.750534] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1a2fe10) 00:22:50.946 [2024-11-28 11:47:10.750548] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:50.946 [2024-11-28 11:47:10.750570] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aafb30, cid 0, qid 0 00:22:50.946 [2024-11-28 11:47:10.750682] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.946 [2024-11-28 11:47:10.750694] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.946 [2024-11-28 11:47:10.750701] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.750707] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aafb30) on tqpair=0x1a2fe10 00:22:50.946 [2024-11-28 11:47:10.750722] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.750729] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.750736] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1a2fe10) 00:22:50.946 [2024-11-28 11:47:10.750745] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.946 [2024-11-28 11:47:10.750755] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.750762] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.750768] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1a2fe10) 00:22:50.946 [2024-11-28 11:47:10.750777] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.946 [2024-11-28 11:47:10.750787] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.750794] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.750800] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1a2fe10) 00:22:50.946 [2024-11-28 11:47:10.750808] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.946 [2024-11-28 11:47:10.750822] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.750830] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.750836] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.946 [2024-11-28 11:47:10.750845] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.946 [2024-11-28 11:47:10.750854] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:22:50.946 [2024-11-28 11:47:10.750872] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:50.946 [2024-11-28 11:47:10.750884] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.750891] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.750897] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1a2fe10) 00:22:50.946 [2024-11-28 11:47:10.750908] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.946 [2024-11-28 11:47:10.750945] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aafb30, cid 0, qid 0 00:22:50.946 [2024-11-28 11:47:10.750957] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aafc90, cid 1, qid 0 00:22:50.946 [2024-11-28 11:47:10.750964] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aafdf0, cid 2, qid 0 00:22:50.946 [2024-11-28 11:47:10.750971] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.946 [2024-11-28 11:47:10.750978] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab00b0, cid 4, qid 0 00:22:50.946 [2024-11-28 11:47:10.751121] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.946 [2024-11-28 11:47:10.751134] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.946 [2024-11-28 11:47:10.751141] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.751147] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab00b0) on tqpair=0x1a2fe10 00:22:50.946 [2024-11-28 11:47:10.751158] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:22:50.946 [2024-11-28 11:47:10.751166] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:22:50.946 [2024-11-28 11:47:10.751180] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:22:50.946 [2024-11-28 11:47:10.751196] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:22:50.946 [2024-11-28 11:47:10.751207] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.751215] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.751221] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1a2fe10) 00:22:50.946 [2024-11-28 11:47:10.751231] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:50.946 [2024-11-28 11:47:10.751253] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab00b0, cid 4, qid 0 00:22:50.946 [2024-11-28 11:47:10.751366] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.946 [2024-11-28 11:47:10.751381] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.946 [2024-11-28 11:47:10.751388] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.751395] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab00b0) on tqpair=0x1a2fe10 00:22:50.946 [2024-11-28 11:47:10.751463] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:22:50.946 [2024-11-28 11:47:10.751486] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:22:50.946 [2024-11-28 11:47:10.751502] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.751510] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.751516] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1a2fe10) 00:22:50.946 [2024-11-28 11:47:10.751534] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.946 [2024-11-28 11:47:10.751557] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab00b0, cid 4, qid 0 00:22:50.946 [2024-11-28 11:47:10.751675] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.946 [2024-11-28 11:47:10.751688] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.946 [2024-11-28 11:47:10.751695] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.751701] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1a2fe10): datao=0, datal=4096, cccid=4 00:22:50.946 [2024-11-28 11:47:10.751709] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ab00b0) on tqpair(0x1a2fe10): expected_datao=0, payload_size=4096 00:22:50.946 [2024-11-28 11:47:10.751725] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.751734] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.796539] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.946 [2024-11-28 11:47:10.796557] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.946 [2024-11-28 11:47:10.796565] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.796572] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab00b0) on tqpair=0x1a2fe10 00:22:50.946 [2024-11-28 11:47:10.796599] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:22:50.946 [2024-11-28 11:47:10.796621] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:22:50.946 [2024-11-28 11:47:10.796641] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:22:50.946 [2024-11-28 11:47:10.796654] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.796662] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.946 [2024-11-28 11:47:10.796668] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1a2fe10) 00:22:50.946 [2024-11-28 11:47:10.796679] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.946 [2024-11-28 11:47:10.796703] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab00b0, cid 4, qid 0 00:22:50.946 [2024-11-28 11:47:10.796837] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.946 [2024-11-28 11:47:10.796853] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.947 [2024-11-28 11:47:10.796860] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.796866] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1a2fe10): datao=0, datal=4096, cccid=4 00:22:50.947 [2024-11-28 11:47:10.796874] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ab00b0) on tqpair(0x1a2fe10): expected_datao=0, payload_size=4096 00:22:50.947 [2024-11-28 11:47:10.796891] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.796901] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.837612] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.947 [2024-11-28 11:47:10.837631] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.947 [2024-11-28 11:47:10.837643] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.837651] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab00b0) on tqpair=0x1a2fe10 00:22:50.947 [2024-11-28 11:47:10.837679] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:22:50.947 [2024-11-28 11:47:10.837700] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:22:50.947 [2024-11-28 11:47:10.837714] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.837722] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.837728] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1a2fe10) 00:22:50.947 [2024-11-28 11:47:10.837739] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.947 [2024-11-28 11:47:10.837762] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab00b0, cid 4, qid 0 00:22:50.947 [2024-11-28 11:47:10.837867] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.947 [2024-11-28 11:47:10.837883] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.947 [2024-11-28 11:47:10.837890] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.837897] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1a2fe10): datao=0, datal=4096, cccid=4 00:22:50.947 [2024-11-28 11:47:10.837904] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ab00b0) on tqpair(0x1a2fe10): expected_datao=0, payload_size=4096 00:22:50.947 [2024-11-28 11:47:10.837931] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.837941] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838003] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.947 [2024-11-28 11:47:10.838017] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.947 [2024-11-28 11:47:10.838025] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838031] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab00b0) on tqpair=0x1a2fe10 00:22:50.947 [2024-11-28 11:47:10.838047] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:22:50.947 [2024-11-28 11:47:10.838062] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:22:50.947 [2024-11-28 11:47:10.838079] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:22:50.947 [2024-11-28 11:47:10.838091] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:22:50.947 [2024-11-28 11:47:10.838100] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:22:50.947 [2024-11-28 11:47:10.838109] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:22:50.947 [2024-11-28 11:47:10.838117] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:22:50.947 [2024-11-28 11:47:10.838125] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:22:50.947 [2024-11-28 11:47:10.838146] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838154] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838161] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1a2fe10) 00:22:50.947 [2024-11-28 11:47:10.838171] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.947 [2024-11-28 11:47:10.838188] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838195] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838201] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1a2fe10) 00:22:50.947 [2024-11-28 11:47:10.838211] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.947 [2024-11-28 11:47:10.838238] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab00b0, cid 4, qid 0 00:22:50.947 [2024-11-28 11:47:10.838265] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab0210, cid 5, qid 0 00:22:50.947 [2024-11-28 11:47:10.838394] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.947 [2024-11-28 11:47:10.838410] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.947 [2024-11-28 11:47:10.838417] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838423] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab00b0) on tqpair=0x1a2fe10 00:22:50.947 [2024-11-28 11:47:10.838436] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.947 [2024-11-28 11:47:10.838445] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.947 [2024-11-28 11:47:10.838452] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838459] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab0210) on tqpair=0x1a2fe10 00:22:50.947 [2024-11-28 11:47:10.838475] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838484] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838490] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1a2fe10) 00:22:50.947 [2024-11-28 11:47:10.838500] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.947 [2024-11-28 11:47:10.838522] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab0210, cid 5, qid 0 00:22:50.947 [2024-11-28 11:47:10.838644] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.947 [2024-11-28 11:47:10.838659] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.947 [2024-11-28 11:47:10.838666] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838673] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab0210) on tqpair=0x1a2fe10 00:22:50.947 [2024-11-28 11:47:10.838689] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838698] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838704] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1a2fe10) 00:22:50.947 [2024-11-28 11:47:10.838715] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.947 [2024-11-28 11:47:10.838736] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab0210, cid 5, qid 0 00:22:50.947 [2024-11-28 11:47:10.838829] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.947 [2024-11-28 11:47:10.838841] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.947 [2024-11-28 11:47:10.838848] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838855] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab0210) on tqpair=0x1a2fe10 00:22:50.947 [2024-11-28 11:47:10.838870] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838879] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.947 [2024-11-28 11:47:10.838885] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1a2fe10) 00:22:50.947 [2024-11-28 11:47:10.838896] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.947 [2024-11-28 11:47:10.838921] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab0210, cid 5, qid 0 00:22:50.947 [2024-11-28 11:47:10.839011] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.947 [2024-11-28 11:47:10.839023] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.947 [2024-11-28 11:47:10.839030] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839037] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab0210) on tqpair=0x1a2fe10 00:22:50.948 [2024-11-28 11:47:10.839057] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839066] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839072] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1a2fe10) 00:22:50.948 [2024-11-28 11:47:10.839083] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.948 [2024-11-28 11:47:10.839095] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839102] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839108] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1a2fe10) 00:22:50.948 [2024-11-28 11:47:10.839118] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.948 [2024-11-28 11:47:10.839130] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839137] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839143] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x1a2fe10) 00:22:50.948 [2024-11-28 11:47:10.839152] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.948 [2024-11-28 11:47:10.839165] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839172] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839178] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1a2fe10) 00:22:50.948 [2024-11-28 11:47:10.839187] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.948 [2024-11-28 11:47:10.839209] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab0210, cid 5, qid 0 00:22:50.948 [2024-11-28 11:47:10.839220] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab00b0, cid 4, qid 0 00:22:50.948 [2024-11-28 11:47:10.839228] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab0370, cid 6, qid 0 00:22:50.948 [2024-11-28 11:47:10.839235] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab04d0, cid 7, qid 0 00:22:50.948 [2024-11-28 11:47:10.839443] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.948 [2024-11-28 11:47:10.839459] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.948 [2024-11-28 11:47:10.839466] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839473] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1a2fe10): datao=0, datal=8192, cccid=5 00:22:50.948 [2024-11-28 11:47:10.839480] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ab0210) on tqpair(0x1a2fe10): expected_datao=0, payload_size=8192 00:22:50.948 [2024-11-28 11:47:10.839502] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839512] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839521] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.948 [2024-11-28 11:47:10.839553] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.948 [2024-11-28 11:47:10.839561] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839572] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1a2fe10): datao=0, datal=512, cccid=4 00:22:50.948 [2024-11-28 11:47:10.839580] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ab00b0) on tqpair(0x1a2fe10): expected_datao=0, payload_size=512 00:22:50.948 [2024-11-28 11:47:10.839590] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839598] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839606] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.948 [2024-11-28 11:47:10.839615] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.948 [2024-11-28 11:47:10.839622] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839628] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1a2fe10): datao=0, datal=512, cccid=6 00:22:50.948 [2024-11-28 11:47:10.839635] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ab0370) on tqpair(0x1a2fe10): expected_datao=0, payload_size=512 00:22:50.948 [2024-11-28 11:47:10.839646] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839653] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839661] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.948 [2024-11-28 11:47:10.839670] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.948 [2024-11-28 11:47:10.839677] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839683] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1a2fe10): datao=0, datal=4096, cccid=7 00:22:50.948 [2024-11-28 11:47:10.839691] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ab04d0) on tqpair(0x1a2fe10): expected_datao=0, payload_size=4096 00:22:50.948 [2024-11-28 11:47:10.839701] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839709] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839721] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.948 [2024-11-28 11:47:10.839730] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.948 [2024-11-28 11:47:10.839737] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839744] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab0210) on tqpair=0x1a2fe10 00:22:50.948 [2024-11-28 11:47:10.839765] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.948 [2024-11-28 11:47:10.839776] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.948 [2024-11-28 11:47:10.839783] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839789] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab00b0) on tqpair=0x1a2fe10 00:22:50.948 [2024-11-28 11:47:10.839805] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.948 [2024-11-28 11:47:10.839816] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.948 [2024-11-28 11:47:10.839838] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839845] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab0370) on tqpair=0x1a2fe10 00:22:50.948 [2024-11-28 11:47:10.839856] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.948 [2024-11-28 11:47:10.839865] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.948 [2024-11-28 11:47:10.839872] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.948 [2024-11-28 11:47:10.839878] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab04d0) on tqpair=0x1a2fe10 00:22:50.948 ===================================================== 00:22:50.948 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:50.948 ===================================================== 00:22:50.948 Controller Capabilities/Features 00:22:50.948 ================================ 00:22:50.948 Vendor ID: 8086 00:22:50.948 Subsystem Vendor ID: 8086 00:22:50.948 Serial Number: SPDK00000000000001 00:22:50.948 Model Number: SPDK bdev Controller 00:22:50.948 Firmware Version: 24.01.1 00:22:50.948 Recommended Arb Burst: 6 00:22:50.948 IEEE OUI Identifier: e4 d2 5c 00:22:50.948 Multi-path I/O 00:22:50.948 May have multiple subsystem ports: Yes 00:22:50.948 May have multiple controllers: Yes 00:22:50.948 Associated with SR-IOV VF: No 00:22:50.948 Max Data Transfer Size: 131072 00:22:50.948 Max Number of Namespaces: 32 00:22:50.948 Max Number of I/O Queues: 127 00:22:50.948 NVMe Specification Version (VS): 1.3 00:22:50.948 NVMe Specification Version (Identify): 1.3 00:22:50.948 Maximum Queue Entries: 128 00:22:50.948 Contiguous Queues Required: Yes 00:22:50.948 Arbitration Mechanisms Supported 00:22:50.948 Weighted Round Robin: Not Supported 00:22:50.948 Vendor Specific: Not Supported 00:22:50.948 Reset Timeout: 15000 ms 00:22:50.948 Doorbell Stride: 4 bytes 00:22:50.948 NVM Subsystem Reset: Not Supported 00:22:50.948 Command Sets Supported 00:22:50.949 NVM Command Set: Supported 00:22:50.949 Boot Partition: Not Supported 00:22:50.949 Memory Page Size Minimum: 4096 bytes 00:22:50.949 Memory Page Size Maximum: 4096 bytes 00:22:50.949 Persistent Memory Region: Not Supported 00:22:50.949 Optional Asynchronous Events Supported 00:22:50.949 Namespace Attribute Notices: Supported 00:22:50.949 Firmware Activation Notices: Not Supported 00:22:50.949 ANA Change Notices: Not Supported 00:22:50.949 PLE Aggregate Log Change Notices: Not Supported 00:22:50.949 LBA Status Info Alert Notices: Not Supported 00:22:50.949 EGE Aggregate Log Change Notices: Not Supported 00:22:50.949 Normal NVM Subsystem Shutdown event: Not Supported 00:22:50.949 Zone Descriptor Change Notices: Not Supported 00:22:50.949 Discovery Log Change Notices: Not Supported 00:22:50.949 Controller Attributes 00:22:50.949 128-bit Host Identifier: Supported 00:22:50.949 Non-Operational Permissive Mode: Not Supported 00:22:50.949 NVM Sets: Not Supported 00:22:50.949 Read Recovery Levels: Not Supported 00:22:50.949 Endurance Groups: Not Supported 00:22:50.949 Predictable Latency Mode: Not Supported 00:22:50.949 Traffic Based Keep ALive: Not Supported 00:22:50.949 Namespace Granularity: Not Supported 00:22:50.949 SQ Associations: Not Supported 00:22:50.949 UUID List: Not Supported 00:22:50.949 Multi-Domain Subsystem: Not Supported 00:22:50.949 Fixed Capacity Management: Not Supported 00:22:50.949 Variable Capacity Management: Not Supported 00:22:50.949 Delete Endurance Group: Not Supported 00:22:50.949 Delete NVM Set: Not Supported 00:22:50.949 Extended LBA Formats Supported: Not Supported 00:22:50.949 Flexible Data Placement Supported: Not Supported 00:22:50.949 00:22:50.949 Controller Memory Buffer Support 00:22:50.949 ================================ 00:22:50.949 Supported: No 00:22:50.949 00:22:50.949 Persistent Memory Region Support 00:22:50.949 ================================ 00:22:50.949 Supported: No 00:22:50.949 00:22:50.949 Admin Command Set Attributes 00:22:50.949 ============================ 00:22:50.949 Security Send/Receive: Not Supported 00:22:50.949 Format NVM: Not Supported 00:22:50.949 Firmware Activate/Download: Not Supported 00:22:50.949 Namespace Management: Not Supported 00:22:50.949 Device Self-Test: Not Supported 00:22:50.949 Directives: Not Supported 00:22:50.949 NVMe-MI: Not Supported 00:22:50.949 Virtualization Management: Not Supported 00:22:50.949 Doorbell Buffer Config: Not Supported 00:22:50.949 Get LBA Status Capability: Not Supported 00:22:50.949 Command & Feature Lockdown Capability: Not Supported 00:22:50.949 Abort Command Limit: 4 00:22:50.949 Async Event Request Limit: 4 00:22:50.949 Number of Firmware Slots: N/A 00:22:50.949 Firmware Slot 1 Read-Only: N/A 00:22:50.949 Firmware Activation Without Reset: N/A 00:22:50.949 Multiple Update Detection Support: N/A 00:22:50.949 Firmware Update Granularity: No Information Provided 00:22:50.949 Per-Namespace SMART Log: No 00:22:50.949 Asymmetric Namespace Access Log Page: Not Supported 00:22:50.949 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:22:50.949 Command Effects Log Page: Supported 00:22:50.949 Get Log Page Extended Data: Supported 00:22:50.949 Telemetry Log Pages: Not Supported 00:22:50.949 Persistent Event Log Pages: Not Supported 00:22:50.949 Supported Log Pages Log Page: May Support 00:22:50.949 Commands Supported & Effects Log Page: Not Supported 00:22:50.949 Feature Identifiers & Effects Log Page:May Support 00:22:50.949 NVMe-MI Commands & Effects Log Page: May Support 00:22:50.949 Data Area 4 for Telemetry Log: Not Supported 00:22:50.949 Error Log Page Entries Supported: 128 00:22:50.949 Keep Alive: Supported 00:22:50.949 Keep Alive Granularity: 10000 ms 00:22:50.949 00:22:50.949 NVM Command Set Attributes 00:22:50.949 ========================== 00:22:50.949 Submission Queue Entry Size 00:22:50.949 Max: 64 00:22:50.949 Min: 64 00:22:50.949 Completion Queue Entry Size 00:22:50.949 Max: 16 00:22:50.949 Min: 16 00:22:50.949 Number of Namespaces: 32 00:22:50.949 Compare Command: Supported 00:22:50.949 Write Uncorrectable Command: Not Supported 00:22:50.949 Dataset Management Command: Supported 00:22:50.949 Write Zeroes Command: Supported 00:22:50.949 Set Features Save Field: Not Supported 00:22:50.949 Reservations: Supported 00:22:50.949 Timestamp: Not Supported 00:22:50.949 Copy: Supported 00:22:50.949 Volatile Write Cache: Present 00:22:50.949 Atomic Write Unit (Normal): 1 00:22:50.949 Atomic Write Unit (PFail): 1 00:22:50.949 Atomic Compare & Write Unit: 1 00:22:50.949 Fused Compare & Write: Supported 00:22:50.949 Scatter-Gather List 00:22:50.949 SGL Command Set: Supported 00:22:50.949 SGL Keyed: Supported 00:22:50.949 SGL Bit Bucket Descriptor: Not Supported 00:22:50.949 SGL Metadata Pointer: Not Supported 00:22:50.949 Oversized SGL: Not Supported 00:22:50.949 SGL Metadata Address: Not Supported 00:22:50.949 SGL Offset: Supported 00:22:50.949 Transport SGL Data Block: Not Supported 00:22:50.949 Replay Protected Memory Block: Not Supported 00:22:50.949 00:22:50.949 Firmware Slot Information 00:22:50.949 ========================= 00:22:50.949 Active slot: 1 00:22:50.949 Slot 1 Firmware Revision: 24.01.1 00:22:50.949 00:22:50.949 00:22:50.949 Commands Supported and Effects 00:22:50.949 ============================== 00:22:50.949 Admin Commands 00:22:50.949 -------------- 00:22:50.949 Get Log Page (02h): Supported 00:22:50.949 Identify (06h): Supported 00:22:50.949 Abort (08h): Supported 00:22:50.949 Set Features (09h): Supported 00:22:50.949 Get Features (0Ah): Supported 00:22:50.949 Asynchronous Event Request (0Ch): Supported 00:22:50.949 Keep Alive (18h): Supported 00:22:50.949 I/O Commands 00:22:50.949 ------------ 00:22:50.949 Flush (00h): Supported LBA-Change 00:22:50.949 Write (01h): Supported LBA-Change 00:22:50.949 Read (02h): Supported 00:22:50.949 Compare (05h): Supported 00:22:50.949 Write Zeroes (08h): Supported LBA-Change 00:22:50.949 Dataset Management (09h): Supported LBA-Change 00:22:50.949 Copy (19h): Supported LBA-Change 00:22:50.949 Unknown (79h): Supported LBA-Change 00:22:50.949 Unknown (7Ah): Supported 00:22:50.949 00:22:50.949 Error Log 00:22:50.949 ========= 00:22:50.949 00:22:50.949 Arbitration 00:22:50.949 =========== 00:22:50.949 Arbitration Burst: 1 00:22:50.949 00:22:50.949 Power Management 00:22:50.950 ================ 00:22:50.950 Number of Power States: 1 00:22:50.950 Current Power State: Power State #0 00:22:50.950 Power State #0: 00:22:50.950 Max Power: 0.00 W 00:22:50.950 Non-Operational State: Operational 00:22:50.950 Entry Latency: Not Reported 00:22:50.950 Exit Latency: Not Reported 00:22:50.950 Relative Read Throughput: 0 00:22:50.950 Relative Read Latency: 0 00:22:50.950 Relative Write Throughput: 0 00:22:50.950 Relative Write Latency: 0 00:22:50.950 Idle Power: Not Reported 00:22:50.950 Active Power: Not Reported 00:22:50.950 Non-Operational Permissive Mode: Not Supported 00:22:50.950 00:22:50.950 Health Information 00:22:50.950 ================== 00:22:50.950 Critical Warnings: 00:22:50.950 Available Spare Space: OK 00:22:50.950 Temperature: OK 00:22:50.950 Device Reliability: OK 00:22:50.950 Read Only: No 00:22:50.950 Volatile Memory Backup: OK 00:22:50.950 Current Temperature: 0 Kelvin (-273 Celsius) 00:22:50.950 Temperature Threshold: [2024-11-28 11:47:10.840008] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.950 [2024-11-28 11:47:10.840020] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.950 [2024-11-28 11:47:10.840026] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1a2fe10) 00:22:50.950 [2024-11-28 11:47:10.840037] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.950 [2024-11-28 11:47:10.840062] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ab04d0, cid 7, qid 0 00:22:50.950 [2024-11-28 11:47:10.840197] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.950 [2024-11-28 11:47:10.840213] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.950 [2024-11-28 11:47:10.840220] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.950 [2024-11-28 11:47:10.840227] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ab04d0) on tqpair=0x1a2fe10 00:22:50.950 [2024-11-28 11:47:10.840270] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:22:50.950 [2024-11-28 11:47:10.840292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.950 [2024-11-28 11:47:10.840304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.950 [2024-11-28 11:47:10.840313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.950 [2024-11-28 11:47:10.840322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.950 [2024-11-28 11:47:10.840334] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.950 [2024-11-28 11:47:10.840342] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.950 [2024-11-28 11:47:10.840348] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.950 [2024-11-28 11:47:10.840358] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.950 [2024-11-28 11:47:10.840381] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.950 [2024-11-28 11:47:10.840477] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.950 [2024-11-28 11:47:10.840489] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.950 [2024-11-28 11:47:10.840496] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.950 [2024-11-28 11:47:10.840503] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.950 [2024-11-28 11:47:10.840515] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.950 [2024-11-28 11:47:10.840522] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.950 [2024-11-28 11:47:10.844540] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.950 [2024-11-28 11:47:10.844553] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.950 [2024-11-28 11:47:10.844597] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.950 [2024-11-28 11:47:10.844719] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.950 [2024-11-28 11:47:10.844734] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.950 [2024-11-28 11:47:10.844741] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.950 [2024-11-28 11:47:10.844748] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.950 [2024-11-28 11:47:10.844757] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:22:50.950 [2024-11-28 11:47:10.844765] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:22:50.950 [2024-11-28 11:47:10.844781] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.950 [2024-11-28 11:47:10.844789] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.950 [2024-11-28 11:47:10.844796] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.950 [2024-11-28 11:47:10.844806] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.950 [2024-11-28 11:47:10.844831] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.950 [2024-11-28 11:47:10.844947] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.950 [2024-11-28 11:47:10.844962] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.950 [2024-11-28 11:47:10.844968] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.950 [2024-11-28 11:47:10.844975] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.950 [2024-11-28 11:47:10.844993] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.950 [2024-11-28 11:47:10.845002] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845008] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.951 [2024-11-28 11:47:10.845019] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.951 [2024-11-28 11:47:10.845039] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.951 [2024-11-28 11:47:10.845134] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.951 [2024-11-28 11:47:10.845146] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.951 [2024-11-28 11:47:10.845153] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845159] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.951 [2024-11-28 11:47:10.845176] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845184] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845190] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.951 [2024-11-28 11:47:10.845200] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.951 [2024-11-28 11:47:10.845220] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.951 [2024-11-28 11:47:10.845314] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.951 [2024-11-28 11:47:10.845326] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.951 [2024-11-28 11:47:10.845333] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845339] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.951 [2024-11-28 11:47:10.845356] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845364] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845371] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.951 [2024-11-28 11:47:10.845381] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.951 [2024-11-28 11:47:10.845401] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.951 [2024-11-28 11:47:10.845513] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.951 [2024-11-28 11:47:10.845535] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.951 [2024-11-28 11:47:10.845543] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845550] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.951 [2024-11-28 11:47:10.845567] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845576] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845582] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.951 [2024-11-28 11:47:10.845593] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.951 [2024-11-28 11:47:10.845619] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.951 [2024-11-28 11:47:10.845730] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.951 [2024-11-28 11:47:10.845742] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.951 [2024-11-28 11:47:10.845749] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845756] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.951 [2024-11-28 11:47:10.845772] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845781] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845787] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.951 [2024-11-28 11:47:10.845797] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.951 [2024-11-28 11:47:10.845817] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.951 [2024-11-28 11:47:10.845910] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.951 [2024-11-28 11:47:10.845922] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.951 [2024-11-28 11:47:10.845929] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845935] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.951 [2024-11-28 11:47:10.845952] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845960] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.845967] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.951 [2024-11-28 11:47:10.845977] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.951 [2024-11-28 11:47:10.845996] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.951 [2024-11-28 11:47:10.846091] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.951 [2024-11-28 11:47:10.846104] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.951 [2024-11-28 11:47:10.846111] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.846117] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.951 [2024-11-28 11:47:10.846134] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.846142] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.846148] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.951 [2024-11-28 11:47:10.846159] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.951 [2024-11-28 11:47:10.846179] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.951 [2024-11-28 11:47:10.846287] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.951 [2024-11-28 11:47:10.846299] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.951 [2024-11-28 11:47:10.846306] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.846313] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.951 [2024-11-28 11:47:10.846329] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.846338] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.846344] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.951 [2024-11-28 11:47:10.846354] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.951 [2024-11-28 11:47:10.846374] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.951 [2024-11-28 11:47:10.846487] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.951 [2024-11-28 11:47:10.846500] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.951 [2024-11-28 11:47:10.846507] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.846513] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.951 [2024-11-28 11:47:10.846539] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.846549] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.846556] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.951 [2024-11-28 11:47:10.846566] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.951 [2024-11-28 11:47:10.846587] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.951 [2024-11-28 11:47:10.846701] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.951 [2024-11-28 11:47:10.846716] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.951 [2024-11-28 11:47:10.846723] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.951 [2024-11-28 11:47:10.846730] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.951 [2024-11-28 11:47:10.846747] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.846756] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.846762] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.952 [2024-11-28 11:47:10.846773] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.952 [2024-11-28 11:47:10.846793] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.952 [2024-11-28 11:47:10.846891] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.952 [2024-11-28 11:47:10.846906] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.952 [2024-11-28 11:47:10.846913] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.846920] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.952 [2024-11-28 11:47:10.846937] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.846945] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.846952] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.952 [2024-11-28 11:47:10.846962] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.952 [2024-11-28 11:47:10.846982] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.952 [2024-11-28 11:47:10.847071] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.952 [2024-11-28 11:47:10.847083] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.952 [2024-11-28 11:47:10.847090] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847096] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.952 [2024-11-28 11:47:10.847113] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847122] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847128] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.952 [2024-11-28 11:47:10.847138] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.952 [2024-11-28 11:47:10.847158] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.952 [2024-11-28 11:47:10.847267] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.952 [2024-11-28 11:47:10.847283] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.952 [2024-11-28 11:47:10.847291] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847297] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.952 [2024-11-28 11:47:10.847314] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847322] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847329] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.952 [2024-11-28 11:47:10.847339] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.952 [2024-11-28 11:47:10.847359] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.952 [2024-11-28 11:47:10.847468] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.952 [2024-11-28 11:47:10.847480] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.952 [2024-11-28 11:47:10.847487] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847493] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.952 [2024-11-28 11:47:10.847509] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847518] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847531] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.952 [2024-11-28 11:47:10.847543] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.952 [2024-11-28 11:47:10.847564] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.952 [2024-11-28 11:47:10.847666] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.952 [2024-11-28 11:47:10.847681] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.952 [2024-11-28 11:47:10.847688] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847695] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.952 [2024-11-28 11:47:10.847712] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847721] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847727] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.952 [2024-11-28 11:47:10.847737] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.952 [2024-11-28 11:47:10.847758] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.952 [2024-11-28 11:47:10.847847] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.952 [2024-11-28 11:47:10.847859] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.952 [2024-11-28 11:47:10.847866] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847872] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.952 [2024-11-28 11:47:10.847889] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847897] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.847904] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.952 [2024-11-28 11:47:10.847914] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.952 [2024-11-28 11:47:10.847934] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.952 [2024-11-28 11:47:10.848026] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.952 [2024-11-28 11:47:10.848040] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.952 [2024-11-28 11:47:10.848052] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.848059] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.952 [2024-11-28 11:47:10.848076] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.848085] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.848091] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.952 [2024-11-28 11:47:10.848101] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.952 [2024-11-28 11:47:10.848122] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.952 [2024-11-28 11:47:10.848218] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.952 [2024-11-28 11:47:10.848232] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.952 [2024-11-28 11:47:10.848239] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.848246] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.952 [2024-11-28 11:47:10.848263] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.848272] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.848278] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.952 [2024-11-28 11:47:10.848289] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.952 [2024-11-28 11:47:10.848309] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.952 [2024-11-28 11:47:10.848403] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.952 [2024-11-28 11:47:10.848418] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.952 [2024-11-28 11:47:10.848424] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.848431] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.952 [2024-11-28 11:47:10.848448] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.848457] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.952 [2024-11-28 11:47:10.848463] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.952 [2024-11-28 11:47:10.848474] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.952 [2024-11-28 11:47:10.848494] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.952 [2024-11-28 11:47:10.852535] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.952 [2024-11-28 11:47:10.852553] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.952 [2024-11-28 11:47:10.852561] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.953 [2024-11-28 11:47:10.852568] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.953 [2024-11-28 11:47:10.852587] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.953 [2024-11-28 11:47:10.852597] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.953 [2024-11-28 11:47:10.852603] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1a2fe10) 00:22:50.953 [2024-11-28 11:47:10.852614] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.953 [2024-11-28 11:47:10.852636] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1aaff50, cid 3, qid 0 00:22:50.953 [2024-11-28 11:47:10.852747] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.953 [2024-11-28 11:47:10.852759] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.953 [2024-11-28 11:47:10.852770] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.953 [2024-11-28 11:47:10.852778] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1aaff50) on tqpair=0x1a2fe10 00:22:50.953 [2024-11-28 11:47:10.852792] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 7 milliseconds 00:22:50.953 0 Kelvin (-273 Celsius) 00:22:50.953 Available Spare: 0% 00:22:50.953 Available Spare Threshold: 0% 00:22:50.953 Life Percentage Used: 0% 00:22:50.953 Data Units Read: 0 00:22:50.953 Data Units Written: 0 00:22:50.953 Host Read Commands: 0 00:22:50.953 Host Write Commands: 0 00:22:50.953 Controller Busy Time: 0 minutes 00:22:50.953 Power Cycles: 0 00:22:50.953 Power On Hours: 0 hours 00:22:50.953 Unsafe Shutdowns: 0 00:22:50.953 Unrecoverable Media Errors: 0 00:22:50.953 Lifetime Error Log Entries: 0 00:22:50.953 Warning Temperature Time: 0 minutes 00:22:50.953 Critical Temperature Time: 0 minutes 00:22:50.953 00:22:50.953 Number of Queues 00:22:50.953 ================ 00:22:50.953 Number of I/O Submission Queues: 127 00:22:50.953 Number of I/O Completion Queues: 127 00:22:50.953 00:22:50.953 Active Namespaces 00:22:50.953 ================= 00:22:50.953 Namespace ID:1 00:22:50.953 Error Recovery Timeout: Unlimited 00:22:50.953 Command Set Identifier: NVM (00h) 00:22:50.953 Deallocate: Supported 00:22:50.953 Deallocated/Unwritten Error: Not Supported 00:22:50.953 Deallocated Read Value: Unknown 00:22:50.953 Deallocate in Write Zeroes: Not Supported 00:22:50.953 Deallocated Guard Field: 0xFFFF 00:22:50.953 Flush: Supported 00:22:50.953 Reservation: Supported 00:22:50.953 Namespace Sharing Capabilities: Multiple Controllers 00:22:50.953 Size (in LBAs): 131072 (0GiB) 00:22:50.953 Capacity (in LBAs): 131072 (0GiB) 00:22:50.953 Utilization (in LBAs): 131072 (0GiB) 00:22:50.953 NGUID: ABCDEF0123456789ABCDEF0123456789 00:22:50.953 EUI64: ABCDEF0123456789 00:22:50.953 UUID: 8fbb8f0e-a626-4814-b7be-782d2ef02299 00:22:50.953 Thin Provisioning: Not Supported 00:22:50.953 Per-NS Atomic Units: Yes 00:22:50.953 Atomic Boundary Size (Normal): 0 00:22:50.953 Atomic Boundary Size (PFail): 0 00:22:50.953 Atomic Boundary Offset: 0 00:22:50.953 Maximum Single Source Range Length: 65535 00:22:50.953 Maximum Copy Length: 65535 00:22:50.953 Maximum Source Range Count: 1 00:22:50.953 NGUID/EUI64 Never Reused: No 00:22:50.953 Namespace Write Protected: No 00:22:50.953 Number of LBA Formats: 1 00:22:50.953 Current LBA Format: LBA Format #00 00:22:50.953 LBA Format #00: Data Size: 512 Metadata Size: 0 00:22:50.953 00:22:50.953 11:47:10 -- host/identify.sh@51 -- # sync 00:22:50.953 11:47:10 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:50.953 11:47:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.953 11:47:10 -- common/autotest_common.sh@10 -- # set +x 00:22:50.953 11:47:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.953 11:47:10 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:22:50.953 11:47:10 -- host/identify.sh@56 -- # nvmftestfini 00:22:50.953 11:47:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:50.953 11:47:10 -- nvmf/common.sh@116 -- # sync 00:22:50.953 11:47:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:50.953 11:47:10 -- nvmf/common.sh@119 -- # set +e 00:22:50.953 11:47:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:50.953 11:47:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:50.953 rmmod nvme_tcp 00:22:50.953 rmmod nvme_fabrics 00:22:50.953 rmmod nvme_keyring 00:22:50.953 11:47:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:50.953 11:47:10 -- nvmf/common.sh@123 -- # set -e 00:22:50.953 11:47:10 -- nvmf/common.sh@124 -- # return 0 00:22:50.953 11:47:10 -- nvmf/common.sh@477 -- # '[' -n 3884066 ']' 00:22:50.953 11:47:10 -- nvmf/common.sh@478 -- # killprocess 3884066 00:22:50.953 11:47:10 -- common/autotest_common.sh@936 -- # '[' -z 3884066 ']' 00:22:50.953 11:47:10 -- common/autotest_common.sh@940 -- # kill -0 3884066 00:22:50.953 11:47:10 -- common/autotest_common.sh@941 -- # uname 00:22:50.953 11:47:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:50.953 11:47:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3884066 00:22:50.953 11:47:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:50.953 11:47:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:50.953 11:47:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3884066' 00:22:50.953 killing process with pid 3884066 00:22:50.953 11:47:10 -- common/autotest_common.sh@955 -- # kill 3884066 00:22:50.953 [2024-11-28 11:47:10.970431] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:50.953 11:47:10 -- common/autotest_common.sh@960 -- # wait 3884066 00:22:51.521 11:47:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:51.521 11:47:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:51.521 11:47:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:51.521 11:47:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:51.521 11:47:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:51.521 11:47:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:51.521 11:47:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:51.521 11:47:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:53.427 11:47:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:53.427 00:22:53.427 real 0m6.350s 00:22:53.427 user 0m7.809s 00:22:53.427 sys 0m1.952s 00:22:53.427 11:47:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:53.427 11:47:13 -- common/autotest_common.sh@10 -- # set +x 00:22:53.427 ************************************ 00:22:53.427 END TEST nvmf_identify 00:22:53.427 ************************************ 00:22:53.427 11:47:13 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:22:53.427 11:47:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:53.427 11:47:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:53.427 11:47:13 -- common/autotest_common.sh@10 -- # set +x 00:22:53.427 ************************************ 00:22:53.427 START TEST nvmf_perf 00:22:53.427 ************************************ 00:22:53.427 11:47:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:22:53.428 * Looking for test storage... 00:22:53.428 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:53.428 11:47:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:53.428 11:47:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:53.428 11:47:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:53.428 11:47:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:53.428 11:47:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:53.428 11:47:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:53.428 11:47:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:53.428 11:47:13 -- scripts/common.sh@335 -- # IFS=.-: 00:22:53.428 11:47:13 -- scripts/common.sh@335 -- # read -ra ver1 00:22:53.428 11:47:13 -- scripts/common.sh@336 -- # IFS=.-: 00:22:53.428 11:47:13 -- scripts/common.sh@336 -- # read -ra ver2 00:22:53.428 11:47:13 -- scripts/common.sh@337 -- # local 'op=<' 00:22:53.428 11:47:13 -- scripts/common.sh@339 -- # ver1_l=2 00:22:53.428 11:47:13 -- scripts/common.sh@340 -- # ver2_l=1 00:22:53.428 11:47:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:53.428 11:47:13 -- scripts/common.sh@343 -- # case "$op" in 00:22:53.428 11:47:13 -- scripts/common.sh@344 -- # : 1 00:22:53.428 11:47:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:53.428 11:47:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:53.428 11:47:13 -- scripts/common.sh@364 -- # decimal 1 00:22:53.428 11:47:13 -- scripts/common.sh@352 -- # local d=1 00:22:53.428 11:47:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:53.428 11:47:13 -- scripts/common.sh@354 -- # echo 1 00:22:53.428 11:47:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:53.428 11:47:13 -- scripts/common.sh@365 -- # decimal 2 00:22:53.428 11:47:13 -- scripts/common.sh@352 -- # local d=2 00:22:53.428 11:47:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:53.428 11:47:13 -- scripts/common.sh@354 -- # echo 2 00:22:53.428 11:47:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:53.428 11:47:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:53.428 11:47:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:53.428 11:47:13 -- scripts/common.sh@367 -- # return 0 00:22:53.428 11:47:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:53.428 11:47:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:53.428 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:53.428 --rc genhtml_branch_coverage=1 00:22:53.428 --rc genhtml_function_coverage=1 00:22:53.428 --rc genhtml_legend=1 00:22:53.428 --rc geninfo_all_blocks=1 00:22:53.428 --rc geninfo_unexecuted_blocks=1 00:22:53.428 00:22:53.428 ' 00:22:53.428 11:47:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:53.428 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:53.428 --rc genhtml_branch_coverage=1 00:22:53.428 --rc genhtml_function_coverage=1 00:22:53.428 --rc genhtml_legend=1 00:22:53.428 --rc geninfo_all_blocks=1 00:22:53.428 --rc geninfo_unexecuted_blocks=1 00:22:53.428 00:22:53.428 ' 00:22:53.428 11:47:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:53.428 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:53.428 --rc genhtml_branch_coverage=1 00:22:53.428 --rc genhtml_function_coverage=1 00:22:53.428 --rc genhtml_legend=1 00:22:53.428 --rc geninfo_all_blocks=1 00:22:53.428 --rc geninfo_unexecuted_blocks=1 00:22:53.428 00:22:53.428 ' 00:22:53.428 11:47:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:53.428 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:53.428 --rc genhtml_branch_coverage=1 00:22:53.428 --rc genhtml_function_coverage=1 00:22:53.428 --rc genhtml_legend=1 00:22:53.428 --rc geninfo_all_blocks=1 00:22:53.428 --rc geninfo_unexecuted_blocks=1 00:22:53.428 00:22:53.428 ' 00:22:53.428 11:47:13 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:53.428 11:47:13 -- nvmf/common.sh@7 -- # uname -s 00:22:53.428 11:47:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:53.428 11:47:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:53.428 11:47:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:53.428 11:47:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:53.428 11:47:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:53.428 11:47:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:53.428 11:47:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:53.428 11:47:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:53.428 11:47:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:53.428 11:47:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:53.686 11:47:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:53.686 11:47:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:53.686 11:47:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:53.686 11:47:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:53.686 11:47:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:53.686 11:47:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:53.686 11:47:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:53.686 11:47:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:53.686 11:47:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:53.686 11:47:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:53.686 11:47:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:53.686 11:47:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:53.686 11:47:13 -- paths/export.sh@5 -- # export PATH 00:22:53.686 11:47:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:53.686 11:47:13 -- nvmf/common.sh@46 -- # : 0 00:22:53.686 11:47:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:53.686 11:47:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:53.686 11:47:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:53.686 11:47:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:53.686 11:47:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:53.686 11:47:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:53.686 11:47:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:53.686 11:47:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:53.686 11:47:13 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:22:53.686 11:47:13 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:22:53.686 11:47:13 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:22:53.686 11:47:13 -- host/perf.sh@17 -- # nvmftestinit 00:22:53.686 11:47:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:53.686 11:47:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:53.686 11:47:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:53.686 11:47:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:53.686 11:47:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:53.686 11:47:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:53.686 11:47:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:53.686 11:47:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:53.686 11:47:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:53.686 11:47:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:53.686 11:47:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:53.686 11:47:13 -- common/autotest_common.sh@10 -- # set +x 00:22:55.589 11:47:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:55.589 11:47:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:55.589 11:47:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:55.589 11:47:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:55.589 11:47:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:55.589 11:47:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:55.589 11:47:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:55.589 11:47:15 -- nvmf/common.sh@294 -- # net_devs=() 00:22:55.589 11:47:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:55.589 11:47:15 -- nvmf/common.sh@295 -- # e810=() 00:22:55.589 11:47:15 -- nvmf/common.sh@295 -- # local -ga e810 00:22:55.589 11:47:15 -- nvmf/common.sh@296 -- # x722=() 00:22:55.589 11:47:15 -- nvmf/common.sh@296 -- # local -ga x722 00:22:55.589 11:47:15 -- nvmf/common.sh@297 -- # mlx=() 00:22:55.589 11:47:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:55.589 11:47:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:55.589 11:47:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:55.589 11:47:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:55.589 11:47:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:55.589 11:47:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:55.589 11:47:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:55.589 11:47:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:55.589 11:47:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:55.589 11:47:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:55.589 11:47:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:55.589 11:47:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:55.589 11:47:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:55.589 11:47:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:55.589 11:47:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:55.589 11:47:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:55.589 11:47:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:55.589 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:55.589 11:47:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:55.589 11:47:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:55.589 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:55.589 11:47:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:55.589 11:47:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:55.589 11:47:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:55.589 11:47:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:55.589 11:47:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:55.589 11:47:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:55.589 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:55.589 11:47:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:55.589 11:47:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:55.589 11:47:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:55.589 11:47:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:55.589 11:47:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:55.589 11:47:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:55.589 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:55.589 11:47:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:55.589 11:47:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:55.589 11:47:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:55.589 11:47:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:55.589 11:47:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:55.589 11:47:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:55.589 11:47:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:55.589 11:47:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:55.589 11:47:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:55.589 11:47:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:55.589 11:47:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:55.589 11:47:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:55.589 11:47:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:55.589 11:47:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:55.589 11:47:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:55.589 11:47:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:55.589 11:47:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:55.589 11:47:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:55.589 11:47:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:55.589 11:47:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:55.589 11:47:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:55.589 11:47:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:55.589 11:47:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:55.589 11:47:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:55.589 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:55.589 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.242 ms 00:22:55.589 00:22:55.589 --- 10.0.0.2 ping statistics --- 00:22:55.589 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:55.589 rtt min/avg/max/mdev = 0.242/0.242/0.242/0.000 ms 00:22:55.589 11:47:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:55.589 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:55.589 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:22:55.589 00:22:55.589 --- 10.0.0.1 ping statistics --- 00:22:55.589 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:55.589 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:22:55.589 11:47:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:55.589 11:47:15 -- nvmf/common.sh@410 -- # return 0 00:22:55.589 11:47:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:55.589 11:47:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:55.589 11:47:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:55.589 11:47:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:55.589 11:47:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:55.589 11:47:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:55.589 11:47:15 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:22:55.589 11:47:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:55.589 11:47:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:55.589 11:47:15 -- common/autotest_common.sh@10 -- # set +x 00:22:55.590 11:47:15 -- nvmf/common.sh@469 -- # nvmfpid=3886256 00:22:55.590 11:47:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:55.590 11:47:15 -- nvmf/common.sh@470 -- # waitforlisten 3886256 00:22:55.590 11:47:15 -- common/autotest_common.sh@829 -- # '[' -z 3886256 ']' 00:22:55.590 11:47:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:55.590 11:47:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:55.590 11:47:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:55.590 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:55.590 11:47:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:55.590 11:47:15 -- common/autotest_common.sh@10 -- # set +x 00:22:55.590 [2024-11-28 11:47:15.628946] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:55.590 [2024-11-28 11:47:15.629023] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:55.848 EAL: No free 2048 kB hugepages reported on node 1 00:22:55.848 [2024-11-28 11:47:15.694650] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:55.848 [2024-11-28 11:47:15.802426] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:55.848 [2024-11-28 11:47:15.802584] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:55.848 [2024-11-28 11:47:15.802602] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:55.848 [2024-11-28 11:47:15.802615] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:55.848 [2024-11-28 11:47:15.802665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:55.848 [2024-11-28 11:47:15.802724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:55.848 [2024-11-28 11:47:15.802791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:55.848 [2024-11-28 11:47:15.802794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:56.780 11:47:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:56.780 11:47:16 -- common/autotest_common.sh@862 -- # return 0 00:22:56.780 11:47:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:56.780 11:47:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:56.780 11:47:16 -- common/autotest_common.sh@10 -- # set +x 00:22:56.780 11:47:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:56.780 11:47:16 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:22:56.780 11:47:16 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:00.113 11:47:19 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:00.113 11:47:19 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:00.113 11:47:20 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:00.113 11:47:20 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:00.370 11:47:20 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:00.370 11:47:20 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:00.370 11:47:20 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:00.370 11:47:20 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:00.370 11:47:20 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:00.628 [2024-11-28 11:47:20.538761] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:00.628 11:47:20 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:00.885 11:47:20 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:00.886 11:47:20 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:01.143 11:47:21 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:01.143 11:47:21 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:01.401 11:47:21 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:01.659 [2024-11-28 11:47:21.542644] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:01.659 11:47:21 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:01.916 11:47:21 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:01.916 11:47:21 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:01.916 11:47:21 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:01.916 11:47:21 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:03.289 Initializing NVMe Controllers 00:23:03.289 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:03.289 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:03.289 Initialization complete. Launching workers. 00:23:03.289 ======================================================== 00:23:03.289 Latency(us) 00:23:03.289 Device Information : IOPS MiB/s Average min max 00:23:03.289 PCIE (0000:88:00.0) NSID 1 from core 0: 86644.59 338.46 368.86 31.52 5242.87 00:23:03.289 ======================================================== 00:23:03.289 Total : 86644.59 338.46 368.86 31.52 5242.87 00:23:03.289 00:23:03.289 11:47:23 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:03.289 EAL: No free 2048 kB hugepages reported on node 1 00:23:04.663 Initializing NVMe Controllers 00:23:04.663 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:04.663 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:04.663 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:04.663 Initialization complete. Launching workers. 00:23:04.663 ======================================================== 00:23:04.663 Latency(us) 00:23:04.663 Device Information : IOPS MiB/s Average min max 00:23:04.663 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 120.70 0.47 8376.83 156.28 49291.21 00:23:04.663 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 43.89 0.17 23509.48 5982.00 51845.35 00:23:04.663 ======================================================== 00:23:04.663 Total : 164.59 0.64 12412.20 156.28 51845.35 00:23:04.663 00:23:04.663 11:47:24 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:04.663 EAL: No free 2048 kB hugepages reported on node 1 00:23:06.048 Initializing NVMe Controllers 00:23:06.048 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:06.048 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:06.048 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:06.048 Initialization complete. Launching workers. 00:23:06.048 ======================================================== 00:23:06.048 Latency(us) 00:23:06.048 Device Information : IOPS MiB/s Average min max 00:23:06.048 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8422.39 32.90 3799.64 553.55 10895.49 00:23:06.048 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3881.81 15.16 8272.04 6973.29 15965.84 00:23:06.048 ======================================================== 00:23:06.048 Total : 12304.20 48.06 5210.62 553.55 15965.84 00:23:06.048 00:23:06.048 11:47:25 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:06.048 11:47:25 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:06.048 11:47:25 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:06.048 EAL: No free 2048 kB hugepages reported on node 1 00:23:08.576 Initializing NVMe Controllers 00:23:08.576 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:08.576 Controller IO queue size 128, less than required. 00:23:08.576 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:08.576 Controller IO queue size 128, less than required. 00:23:08.576 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:08.576 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:08.576 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:08.576 Initialization complete. Launching workers. 00:23:08.576 ======================================================== 00:23:08.576 Latency(us) 00:23:08.576 Device Information : IOPS MiB/s Average min max 00:23:08.576 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1203.31 300.83 108225.37 78000.55 181304.88 00:23:08.576 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 604.40 151.10 223236.43 76221.63 323446.32 00:23:08.576 ======================================================== 00:23:08.576 Total : 1807.71 451.93 146679.02 76221.63 323446.32 00:23:08.576 00:23:08.576 11:47:28 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:08.576 EAL: No free 2048 kB hugepages reported on node 1 00:23:08.576 No valid NVMe controllers or AIO or URING devices found 00:23:08.577 Initializing NVMe Controllers 00:23:08.577 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:08.577 Controller IO queue size 128, less than required. 00:23:08.577 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:08.577 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:08.577 Controller IO queue size 128, less than required. 00:23:08.577 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:08.577 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:08.577 WARNING: Some requested NVMe devices were skipped 00:23:08.577 11:47:28 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:08.577 EAL: No free 2048 kB hugepages reported on node 1 00:23:11.107 Initializing NVMe Controllers 00:23:11.107 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:11.107 Controller IO queue size 128, less than required. 00:23:11.107 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:11.107 Controller IO queue size 128, less than required. 00:23:11.107 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:11.107 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:11.107 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:11.107 Initialization complete. Launching workers. 00:23:11.107 00:23:11.107 ==================== 00:23:11.107 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:11.107 TCP transport: 00:23:11.107 polls: 9906 00:23:11.107 idle_polls: 6191 00:23:11.107 sock_completions: 3715 00:23:11.107 nvme_completions: 5114 00:23:11.107 submitted_requests: 7802 00:23:11.107 queued_requests: 1 00:23:11.107 00:23:11.107 ==================== 00:23:11.107 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:11.107 TCP transport: 00:23:11.107 polls: 13226 00:23:11.107 idle_polls: 8834 00:23:11.107 sock_completions: 4392 00:23:11.107 nvme_completions: 6075 00:23:11.107 submitted_requests: 9315 00:23:11.107 queued_requests: 1 00:23:11.107 ======================================================== 00:23:11.107 Latency(us) 00:23:11.107 Device Information : IOPS MiB/s Average min max 00:23:11.107 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1340.95 335.24 98559.37 64984.17 156616.61 00:23:11.107 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1581.26 395.32 81424.30 45998.92 111701.33 00:23:11.107 ======================================================== 00:23:11.107 Total : 2922.21 730.55 89287.28 45998.92 156616.61 00:23:11.107 00:23:11.107 11:47:30 -- host/perf.sh@66 -- # sync 00:23:11.107 11:47:30 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:11.366 11:47:31 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:11.366 11:47:31 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:11.366 11:47:31 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:14.646 11:47:34 -- host/perf.sh@72 -- # ls_guid=4235740b-47f4-44a6-afdb-9804508026c1 00:23:14.646 11:47:34 -- host/perf.sh@73 -- # get_lvs_free_mb 4235740b-47f4-44a6-afdb-9804508026c1 00:23:14.646 11:47:34 -- common/autotest_common.sh@1353 -- # local lvs_uuid=4235740b-47f4-44a6-afdb-9804508026c1 00:23:14.646 11:47:34 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:14.646 11:47:34 -- common/autotest_common.sh@1355 -- # local fc 00:23:14.646 11:47:34 -- common/autotest_common.sh@1356 -- # local cs 00:23:14.646 11:47:34 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:14.646 11:47:34 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:14.646 { 00:23:14.646 "uuid": "4235740b-47f4-44a6-afdb-9804508026c1", 00:23:14.646 "name": "lvs_0", 00:23:14.646 "base_bdev": "Nvme0n1", 00:23:14.646 "total_data_clusters": 238234, 00:23:14.646 "free_clusters": 238234, 00:23:14.646 "block_size": 512, 00:23:14.646 "cluster_size": 4194304 00:23:14.646 } 00:23:14.646 ]' 00:23:14.646 11:47:34 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="4235740b-47f4-44a6-afdb-9804508026c1") .free_clusters' 00:23:14.904 11:47:34 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:14.904 11:47:34 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="4235740b-47f4-44a6-afdb-9804508026c1") .cluster_size' 00:23:14.904 11:47:34 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:14.904 11:47:34 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:14.904 11:47:34 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:14.904 952936 00:23:14.904 11:47:34 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:14.904 11:47:34 -- host/perf.sh@78 -- # free_mb=20480 00:23:14.904 11:47:34 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 4235740b-47f4-44a6-afdb-9804508026c1 lbd_0 20480 00:23:15.162 11:47:35 -- host/perf.sh@80 -- # lb_guid=8c48b02f-b717-4a2d-8628-da42d9695376 00:23:15.162 11:47:35 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 8c48b02f-b717-4a2d-8628-da42d9695376 lvs_n_0 00:23:16.093 11:47:36 -- host/perf.sh@83 -- # ls_nested_guid=cec76b48-2ff7-4020-bb5b-8b4987847099 00:23:16.093 11:47:36 -- host/perf.sh@84 -- # get_lvs_free_mb cec76b48-2ff7-4020-bb5b-8b4987847099 00:23:16.093 11:47:36 -- common/autotest_common.sh@1353 -- # local lvs_uuid=cec76b48-2ff7-4020-bb5b-8b4987847099 00:23:16.093 11:47:36 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:16.093 11:47:36 -- common/autotest_common.sh@1355 -- # local fc 00:23:16.093 11:47:36 -- common/autotest_common.sh@1356 -- # local cs 00:23:16.093 11:47:36 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:16.350 11:47:36 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:16.350 { 00:23:16.350 "uuid": "4235740b-47f4-44a6-afdb-9804508026c1", 00:23:16.350 "name": "lvs_0", 00:23:16.350 "base_bdev": "Nvme0n1", 00:23:16.350 "total_data_clusters": 238234, 00:23:16.350 "free_clusters": 233114, 00:23:16.350 "block_size": 512, 00:23:16.350 "cluster_size": 4194304 00:23:16.350 }, 00:23:16.350 { 00:23:16.350 "uuid": "cec76b48-2ff7-4020-bb5b-8b4987847099", 00:23:16.350 "name": "lvs_n_0", 00:23:16.350 "base_bdev": "8c48b02f-b717-4a2d-8628-da42d9695376", 00:23:16.350 "total_data_clusters": 5114, 00:23:16.350 "free_clusters": 5114, 00:23:16.350 "block_size": 512, 00:23:16.350 "cluster_size": 4194304 00:23:16.350 } 00:23:16.350 ]' 00:23:16.350 11:47:36 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="cec76b48-2ff7-4020-bb5b-8b4987847099") .free_clusters' 00:23:16.350 11:47:36 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:16.350 11:47:36 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="cec76b48-2ff7-4020-bb5b-8b4987847099") .cluster_size' 00:23:16.606 11:47:36 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:16.606 11:47:36 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:16.606 11:47:36 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:16.606 20456 00:23:16.606 11:47:36 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:16.606 11:47:36 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u cec76b48-2ff7-4020-bb5b-8b4987847099 lbd_nest_0 20456 00:23:16.863 11:47:36 -- host/perf.sh@88 -- # lb_nested_guid=e465b865-4109-4d2b-88da-adf89a258104 00:23:16.863 11:47:36 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:17.120 11:47:36 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:17.120 11:47:36 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 e465b865-4109-4d2b-88da-adf89a258104 00:23:17.376 11:47:37 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:17.634 11:47:37 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:17.634 11:47:37 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:17.634 11:47:37 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:17.634 11:47:37 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:17.634 11:47:37 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:17.634 EAL: No free 2048 kB hugepages reported on node 1 00:23:29.823 Initializing NVMe Controllers 00:23:29.823 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:29.823 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:29.823 Initialization complete. Launching workers. 00:23:29.823 ======================================================== 00:23:29.823 Latency(us) 00:23:29.823 Device Information : IOPS MiB/s Average min max 00:23:29.823 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 50.49 0.02 19822.27 189.17 47750.29 00:23:29.823 ======================================================== 00:23:29.823 Total : 50.49 0.02 19822.27 189.17 47750.29 00:23:29.823 00:23:29.823 11:47:47 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:29.823 11:47:47 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:29.823 EAL: No free 2048 kB hugepages reported on node 1 00:23:39.785 Initializing NVMe Controllers 00:23:39.785 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:39.785 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:39.785 Initialization complete. Launching workers. 00:23:39.785 ======================================================== 00:23:39.785 Latency(us) 00:23:39.785 Device Information : IOPS MiB/s Average min max 00:23:39.785 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 81.90 10.24 12216.14 4205.25 50863.22 00:23:39.785 ======================================================== 00:23:39.786 Total : 81.90 10.24 12216.14 4205.25 50863.22 00:23:39.786 00:23:39.786 11:47:58 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:39.786 11:47:58 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:39.786 11:47:58 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:39.786 EAL: No free 2048 kB hugepages reported on node 1 00:23:49.750 Initializing NVMe Controllers 00:23:49.750 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:49.750 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:49.750 Initialization complete. Launching workers. 00:23:49.750 ======================================================== 00:23:49.750 Latency(us) 00:23:49.750 Device Information : IOPS MiB/s Average min max 00:23:49.750 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7316.07 3.57 4373.57 285.94 11125.29 00:23:49.750 ======================================================== 00:23:49.750 Total : 7316.07 3.57 4373.57 285.94 11125.29 00:23:49.750 00:23:49.750 11:48:08 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:49.750 11:48:08 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:49.750 EAL: No free 2048 kB hugepages reported on node 1 00:23:59.723 Initializing NVMe Controllers 00:23:59.723 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:59.723 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:59.723 Initialization complete. Launching workers. 00:23:59.723 ======================================================== 00:23:59.723 Latency(us) 00:23:59.723 Device Information : IOPS MiB/s Average min max 00:23:59.723 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3244.09 405.51 9869.84 916.52 24292.68 00:23:59.723 ======================================================== 00:23:59.723 Total : 3244.09 405.51 9869.84 916.52 24292.68 00:23:59.723 00:23:59.723 11:48:18 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:59.723 11:48:18 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:59.723 11:48:18 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:59.723 EAL: No free 2048 kB hugepages reported on node 1 00:24:09.744 Initializing NVMe Controllers 00:24:09.744 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:09.744 Controller IO queue size 128, less than required. 00:24:09.744 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:09.744 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:09.744 Initialization complete. Launching workers. 00:24:09.744 ======================================================== 00:24:09.744 Latency(us) 00:24:09.744 Device Information : IOPS MiB/s Average min max 00:24:09.745 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11989.80 5.85 10683.43 1710.73 26780.56 00:24:09.745 ======================================================== 00:24:09.745 Total : 11989.80 5.85 10683.43 1710.73 26780.56 00:24:09.745 00:24:09.745 11:48:29 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:09.745 11:48:29 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:09.745 EAL: No free 2048 kB hugepages reported on node 1 00:24:19.712 Initializing NVMe Controllers 00:24:19.712 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:19.712 Controller IO queue size 128, less than required. 00:24:19.712 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:19.712 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:19.712 Initialization complete. Launching workers. 00:24:19.712 ======================================================== 00:24:19.712 Latency(us) 00:24:19.712 Device Information : IOPS MiB/s Average min max 00:24:19.712 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1203.66 150.46 106850.33 15406.29 215825.71 00:24:19.712 ======================================================== 00:24:19.712 Total : 1203.66 150.46 106850.33 15406.29 215825.71 00:24:19.712 00:24:19.712 11:48:39 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:19.970 11:48:39 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete e465b865-4109-4d2b-88da-adf89a258104 00:24:20.902 11:48:40 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:21.160 11:48:40 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 8c48b02f-b717-4a2d-8628-da42d9695376 00:24:21.418 11:48:41 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:21.676 11:48:41 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:21.676 11:48:41 -- host/perf.sh@114 -- # nvmftestfini 00:24:21.676 11:48:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:21.676 11:48:41 -- nvmf/common.sh@116 -- # sync 00:24:21.676 11:48:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:21.676 11:48:41 -- nvmf/common.sh@119 -- # set +e 00:24:21.676 11:48:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:21.676 11:48:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:21.676 rmmod nvme_tcp 00:24:21.676 rmmod nvme_fabrics 00:24:21.676 rmmod nvme_keyring 00:24:21.676 11:48:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:21.676 11:48:41 -- nvmf/common.sh@123 -- # set -e 00:24:21.676 11:48:41 -- nvmf/common.sh@124 -- # return 0 00:24:21.676 11:48:41 -- nvmf/common.sh@477 -- # '[' -n 3886256 ']' 00:24:21.676 11:48:41 -- nvmf/common.sh@478 -- # killprocess 3886256 00:24:21.676 11:48:41 -- common/autotest_common.sh@936 -- # '[' -z 3886256 ']' 00:24:21.676 11:48:41 -- common/autotest_common.sh@940 -- # kill -0 3886256 00:24:21.676 11:48:41 -- common/autotest_common.sh@941 -- # uname 00:24:21.676 11:48:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:21.676 11:48:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3886256 00:24:21.676 11:48:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:21.676 11:48:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:21.676 11:48:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3886256' 00:24:21.676 killing process with pid 3886256 00:24:21.676 11:48:41 -- common/autotest_common.sh@955 -- # kill 3886256 00:24:21.676 11:48:41 -- common/autotest_common.sh@960 -- # wait 3886256 00:24:23.574 11:48:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:23.574 11:48:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:23.574 11:48:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:23.574 11:48:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:23.574 11:48:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:23.574 11:48:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:23.574 11:48:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:23.574 11:48:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:25.473 11:48:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:25.473 00:24:25.473 real 1m32.030s 00:24:25.473 user 5m32.432s 00:24:25.473 sys 0m17.662s 00:24:25.473 11:48:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:25.473 11:48:45 -- common/autotest_common.sh@10 -- # set +x 00:24:25.473 ************************************ 00:24:25.473 END TEST nvmf_perf 00:24:25.473 ************************************ 00:24:25.473 11:48:45 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:25.473 11:48:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:25.473 11:48:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:25.473 11:48:45 -- common/autotest_common.sh@10 -- # set +x 00:24:25.473 ************************************ 00:24:25.473 START TEST nvmf_fio_host 00:24:25.473 ************************************ 00:24:25.473 11:48:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:25.473 * Looking for test storage... 00:24:25.473 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:25.473 11:48:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:25.473 11:48:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:25.473 11:48:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:25.732 11:48:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:25.732 11:48:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:25.732 11:48:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:25.732 11:48:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:25.732 11:48:45 -- scripts/common.sh@335 -- # IFS=.-: 00:24:25.732 11:48:45 -- scripts/common.sh@335 -- # read -ra ver1 00:24:25.732 11:48:45 -- scripts/common.sh@336 -- # IFS=.-: 00:24:25.732 11:48:45 -- scripts/common.sh@336 -- # read -ra ver2 00:24:25.732 11:48:45 -- scripts/common.sh@337 -- # local 'op=<' 00:24:25.732 11:48:45 -- scripts/common.sh@339 -- # ver1_l=2 00:24:25.732 11:48:45 -- scripts/common.sh@340 -- # ver2_l=1 00:24:25.732 11:48:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:25.732 11:48:45 -- scripts/common.sh@343 -- # case "$op" in 00:24:25.732 11:48:45 -- scripts/common.sh@344 -- # : 1 00:24:25.732 11:48:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:25.732 11:48:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:25.732 11:48:45 -- scripts/common.sh@364 -- # decimal 1 00:24:25.732 11:48:45 -- scripts/common.sh@352 -- # local d=1 00:24:25.732 11:48:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:25.732 11:48:45 -- scripts/common.sh@354 -- # echo 1 00:24:25.732 11:48:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:25.732 11:48:45 -- scripts/common.sh@365 -- # decimal 2 00:24:25.732 11:48:45 -- scripts/common.sh@352 -- # local d=2 00:24:25.732 11:48:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:25.732 11:48:45 -- scripts/common.sh@354 -- # echo 2 00:24:25.732 11:48:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:25.732 11:48:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:25.732 11:48:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:25.732 11:48:45 -- scripts/common.sh@367 -- # return 0 00:24:25.732 11:48:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:25.732 11:48:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:25.732 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:25.732 --rc genhtml_branch_coverage=1 00:24:25.732 --rc genhtml_function_coverage=1 00:24:25.732 --rc genhtml_legend=1 00:24:25.732 --rc geninfo_all_blocks=1 00:24:25.732 --rc geninfo_unexecuted_blocks=1 00:24:25.732 00:24:25.732 ' 00:24:25.732 11:48:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:25.732 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:25.732 --rc genhtml_branch_coverage=1 00:24:25.732 --rc genhtml_function_coverage=1 00:24:25.732 --rc genhtml_legend=1 00:24:25.732 --rc geninfo_all_blocks=1 00:24:25.732 --rc geninfo_unexecuted_blocks=1 00:24:25.732 00:24:25.732 ' 00:24:25.732 11:48:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:25.732 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:25.732 --rc genhtml_branch_coverage=1 00:24:25.732 --rc genhtml_function_coverage=1 00:24:25.732 --rc genhtml_legend=1 00:24:25.732 --rc geninfo_all_blocks=1 00:24:25.732 --rc geninfo_unexecuted_blocks=1 00:24:25.732 00:24:25.732 ' 00:24:25.732 11:48:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:25.732 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:25.732 --rc genhtml_branch_coverage=1 00:24:25.732 --rc genhtml_function_coverage=1 00:24:25.732 --rc genhtml_legend=1 00:24:25.732 --rc geninfo_all_blocks=1 00:24:25.732 --rc geninfo_unexecuted_blocks=1 00:24:25.732 00:24:25.732 ' 00:24:25.732 11:48:45 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:25.732 11:48:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:25.732 11:48:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:25.732 11:48:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:25.732 11:48:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:25.732 11:48:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:25.732 11:48:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:25.732 11:48:45 -- paths/export.sh@5 -- # export PATH 00:24:25.732 11:48:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:25.732 11:48:45 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:25.732 11:48:45 -- nvmf/common.sh@7 -- # uname -s 00:24:25.732 11:48:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:25.732 11:48:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:25.732 11:48:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:25.732 11:48:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:25.732 11:48:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:25.732 11:48:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:25.732 11:48:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:25.732 11:48:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:25.732 11:48:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:25.732 11:48:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:25.732 11:48:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:25.732 11:48:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:25.732 11:48:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:25.732 11:48:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:25.732 11:48:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:25.732 11:48:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:25.732 11:48:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:25.732 11:48:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:25.732 11:48:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:25.732 11:48:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:25.732 11:48:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:25.732 11:48:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:25.732 11:48:45 -- paths/export.sh@5 -- # export PATH 00:24:25.732 11:48:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:25.733 11:48:45 -- nvmf/common.sh@46 -- # : 0 00:24:25.733 11:48:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:25.733 11:48:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:25.733 11:48:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:25.733 11:48:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:25.733 11:48:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:25.733 11:48:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:25.733 11:48:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:25.733 11:48:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:25.733 11:48:45 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:25.733 11:48:45 -- host/fio.sh@14 -- # nvmftestinit 00:24:25.733 11:48:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:25.733 11:48:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:25.733 11:48:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:25.733 11:48:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:25.733 11:48:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:25.733 11:48:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:25.733 11:48:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:25.733 11:48:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:25.733 11:48:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:25.733 11:48:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:25.733 11:48:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:25.733 11:48:45 -- common/autotest_common.sh@10 -- # set +x 00:24:27.636 11:48:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:27.636 11:48:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:27.636 11:48:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:27.636 11:48:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:27.636 11:48:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:27.636 11:48:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:27.637 11:48:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:27.637 11:48:47 -- nvmf/common.sh@294 -- # net_devs=() 00:24:27.637 11:48:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:27.637 11:48:47 -- nvmf/common.sh@295 -- # e810=() 00:24:27.637 11:48:47 -- nvmf/common.sh@295 -- # local -ga e810 00:24:27.637 11:48:47 -- nvmf/common.sh@296 -- # x722=() 00:24:27.637 11:48:47 -- nvmf/common.sh@296 -- # local -ga x722 00:24:27.637 11:48:47 -- nvmf/common.sh@297 -- # mlx=() 00:24:27.637 11:48:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:27.637 11:48:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:27.637 11:48:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:27.637 11:48:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:27.637 11:48:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:27.637 11:48:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:27.637 11:48:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:27.637 11:48:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:27.637 11:48:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:27.637 11:48:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:27.637 11:48:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:27.637 11:48:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:27.637 11:48:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:27.637 11:48:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:27.637 11:48:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:27.637 11:48:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:27.637 11:48:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:27.637 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:27.637 11:48:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:27.637 11:48:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:27.637 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:27.637 11:48:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:27.637 11:48:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:27.637 11:48:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:27.637 11:48:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:27.637 11:48:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:27.637 11:48:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:27.637 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:27.637 11:48:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:27.637 11:48:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:27.637 11:48:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:27.637 11:48:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:27.637 11:48:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:27.637 11:48:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:27.637 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:27.637 11:48:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:27.637 11:48:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:27.637 11:48:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:27.637 11:48:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:27.637 11:48:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:27.637 11:48:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:27.637 11:48:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:27.637 11:48:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:27.637 11:48:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:27.637 11:48:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:27.637 11:48:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:27.637 11:48:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:27.637 11:48:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:27.637 11:48:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:27.637 11:48:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:27.637 11:48:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:27.637 11:48:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:27.637 11:48:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:27.637 11:48:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:27.637 11:48:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:27.637 11:48:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:27.637 11:48:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:27.637 11:48:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:27.637 11:48:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:27.637 11:48:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:27.637 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:27.637 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:24:27.637 00:24:27.637 --- 10.0.0.2 ping statistics --- 00:24:27.637 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:27.637 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:24:27.637 11:48:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:27.637 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:27.637 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.151 ms 00:24:27.637 00:24:27.637 --- 10.0.0.1 ping statistics --- 00:24:27.637 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:27.637 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:24:27.896 11:48:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:27.896 11:48:47 -- nvmf/common.sh@410 -- # return 0 00:24:27.896 11:48:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:27.896 11:48:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:27.896 11:48:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:27.896 11:48:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:27.896 11:48:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:27.896 11:48:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:27.896 11:48:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:27.896 11:48:47 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:27.896 11:48:47 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:27.896 11:48:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:27.896 11:48:47 -- common/autotest_common.sh@10 -- # set +x 00:24:27.896 11:48:47 -- host/fio.sh@24 -- # nvmfpid=3899388 00:24:27.896 11:48:47 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:27.896 11:48:47 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:27.896 11:48:47 -- host/fio.sh@28 -- # waitforlisten 3899388 00:24:27.896 11:48:47 -- common/autotest_common.sh@829 -- # '[' -z 3899388 ']' 00:24:27.896 11:48:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:27.896 11:48:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:27.896 11:48:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:27.896 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:27.896 11:48:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:27.896 11:48:47 -- common/autotest_common.sh@10 -- # set +x 00:24:27.896 [2024-11-28 11:48:47.765482] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:27.896 [2024-11-28 11:48:47.765576] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:27.896 EAL: No free 2048 kB hugepages reported on node 1 00:24:27.896 [2024-11-28 11:48:47.828667] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:27.896 [2024-11-28 11:48:47.934265] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:27.896 [2024-11-28 11:48:47.934441] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:27.896 [2024-11-28 11:48:47.934457] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:27.896 [2024-11-28 11:48:47.934470] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:27.896 [2024-11-28 11:48:47.934529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:27.896 [2024-11-28 11:48:47.934584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:27.896 [2024-11-28 11:48:47.934652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:27.896 [2024-11-28 11:48:47.934654] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:28.829 11:48:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:28.829 11:48:48 -- common/autotest_common.sh@862 -- # return 0 00:24:28.829 11:48:48 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:29.087 [2024-11-28 11:48:48.967936] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:29.087 11:48:48 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:29.087 11:48:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:29.087 11:48:48 -- common/autotest_common.sh@10 -- # set +x 00:24:29.087 11:48:49 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:29.345 Malloc1 00:24:29.345 11:48:49 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:29.603 11:48:49 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:29.861 11:48:49 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:30.119 [2024-11-28 11:48:50.082998] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:30.119 11:48:50 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:30.377 11:48:50 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:30.377 11:48:50 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:30.377 11:48:50 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:30.377 11:48:50 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:30.377 11:48:50 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:30.377 11:48:50 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:30.377 11:48:50 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:30.377 11:48:50 -- common/autotest_common.sh@1330 -- # shift 00:24:30.377 11:48:50 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:30.377 11:48:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:30.377 11:48:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:30.378 11:48:50 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:30.378 11:48:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:30.378 11:48:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:30.378 11:48:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:30.378 11:48:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:30.378 11:48:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:30.378 11:48:50 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:30.378 11:48:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:30.378 11:48:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:30.378 11:48:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:30.378 11:48:50 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:30.378 11:48:50 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:30.635 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:30.636 fio-3.35 00:24:30.636 Starting 1 thread 00:24:30.636 EAL: No free 2048 kB hugepages reported on node 1 00:24:33.186 00:24:33.186 test: (groupid=0, jobs=1): err= 0: pid=3899883: Thu Nov 28 11:48:52 2024 00:24:33.186 read: IOPS=9476, BW=37.0MiB/s (38.8MB/s)(74.3MiB/2006msec) 00:24:33.186 slat (nsec): min=1913, max=176352, avg=2488.21, stdev=1956.49 00:24:33.186 clat (usec): min=2126, max=13179, avg=7470.39, stdev=559.15 00:24:33.186 lat (usec): min=2148, max=13181, avg=7472.88, stdev=559.05 00:24:33.186 clat percentiles (usec): 00:24:33.186 | 1.00th=[ 6194], 5.00th=[ 6587], 10.00th=[ 6783], 20.00th=[ 7046], 00:24:33.186 | 30.00th=[ 7177], 40.00th=[ 7308], 50.00th=[ 7439], 60.00th=[ 7570], 00:24:33.186 | 70.00th=[ 7767], 80.00th=[ 7898], 90.00th=[ 8160], 95.00th=[ 8291], 00:24:33.186 | 99.00th=[ 8717], 99.50th=[ 8717], 99.90th=[10683], 99.95th=[12256], 00:24:33.186 | 99.99th=[13173] 00:24:33.186 bw ( KiB/s): min=36912, max=38536, per=99.97%, avg=37896.00, stdev=692.48, samples=4 00:24:33.186 iops : min= 9228, max= 9634, avg=9474.00, stdev=173.12, samples=4 00:24:33.186 write: IOPS=9484, BW=37.0MiB/s (38.8MB/s)(74.3MiB/2006msec); 0 zone resets 00:24:33.186 slat (usec): min=2, max=137, avg= 2.59, stdev= 1.32 00:24:33.186 clat (usec): min=1698, max=12334, avg=5987.22, stdev=491.42 00:24:33.186 lat (usec): min=1705, max=12337, avg=5989.80, stdev=491.38 00:24:33.186 clat percentiles (usec): 00:24:33.186 | 1.00th=[ 4948], 5.00th=[ 5276], 10.00th=[ 5407], 20.00th=[ 5604], 00:24:33.186 | 30.00th=[ 5735], 40.00th=[ 5866], 50.00th=[ 5997], 60.00th=[ 6128], 00:24:33.186 | 70.00th=[ 6194], 80.00th=[ 6325], 90.00th=[ 6521], 95.00th=[ 6718], 00:24:33.186 | 99.00th=[ 7046], 99.50th=[ 7177], 99.90th=[ 9503], 99.95th=[10421], 00:24:33.186 | 99.99th=[12256] 00:24:33.186 bw ( KiB/s): min=37632, max=38208, per=99.96%, avg=37920.00, stdev=247.87, samples=4 00:24:33.186 iops : min= 9408, max= 9552, avg=9480.00, stdev=61.97, samples=4 00:24:33.186 lat (msec) : 2=0.02%, 4=0.10%, 10=99.78%, 20=0.10% 00:24:33.186 cpu : usr=58.10%, sys=38.20%, ctx=67, majf=0, minf=41 00:24:33.186 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:33.186 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:33.186 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:33.186 issued rwts: total=19010,19025,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:33.186 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:33.186 00:24:33.186 Run status group 0 (all jobs): 00:24:33.186 READ: bw=37.0MiB/s (38.8MB/s), 37.0MiB/s-37.0MiB/s (38.8MB/s-38.8MB/s), io=74.3MiB (77.9MB), run=2006-2006msec 00:24:33.186 WRITE: bw=37.0MiB/s (38.8MB/s), 37.0MiB/s-37.0MiB/s (38.8MB/s-38.8MB/s), io=74.3MiB (77.9MB), run=2006-2006msec 00:24:33.186 11:48:52 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:33.186 11:48:52 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:33.186 11:48:52 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:33.186 11:48:52 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:33.186 11:48:52 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:33.186 11:48:52 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:33.186 11:48:52 -- common/autotest_common.sh@1330 -- # shift 00:24:33.186 11:48:52 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:33.186 11:48:52 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:33.186 11:48:52 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:33.186 11:48:52 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:33.186 11:48:52 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:33.186 11:48:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:33.186 11:48:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:33.186 11:48:52 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:33.186 11:48:52 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:33.186 11:48:52 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:33.186 11:48:52 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:33.186 11:48:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:33.186 11:48:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:33.186 11:48:52 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:33.186 11:48:52 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:33.186 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:24:33.186 fio-3.35 00:24:33.186 Starting 1 thread 00:24:33.186 EAL: No free 2048 kB hugepages reported on node 1 00:24:35.715 00:24:35.715 test: (groupid=0, jobs=1): err= 0: pid=3900232: Thu Nov 28 11:48:55 2024 00:24:35.715 read: IOPS=8620, BW=135MiB/s (141MB/s)(270MiB/2008msec) 00:24:35.715 slat (nsec): min=2804, max=91281, avg=3520.24, stdev=1538.11 00:24:35.715 clat (usec): min=2586, max=16790, avg=8661.93, stdev=2021.40 00:24:35.715 lat (usec): min=2591, max=16793, avg=8665.45, stdev=2021.46 00:24:35.715 clat percentiles (usec): 00:24:35.715 | 1.00th=[ 4424], 5.00th=[ 5342], 10.00th=[ 6063], 20.00th=[ 6915], 00:24:35.715 | 30.00th=[ 7504], 40.00th=[ 8094], 50.00th=[ 8586], 60.00th=[ 9241], 00:24:35.715 | 70.00th=[ 9765], 80.00th=[10421], 90.00th=[11207], 95.00th=[11994], 00:24:35.715 | 99.00th=[13698], 99.50th=[14615], 99.90th=[16188], 99.95th=[16581], 00:24:35.715 | 99.99th=[16712] 00:24:35.715 bw ( KiB/s): min=60832, max=81024, per=50.65%, avg=69864.00, stdev=8334.57, samples=4 00:24:35.715 iops : min= 3802, max= 5064, avg=4366.50, stdev=520.91, samples=4 00:24:35.715 write: IOPS=5071, BW=79.2MiB/s (83.1MB/s)(143MiB/1806msec); 0 zone resets 00:24:35.715 slat (usec): min=30, max=129, avg=32.76, stdev= 4.38 00:24:35.715 clat (usec): min=6032, max=20946, avg=10836.70, stdev=2051.38 00:24:35.715 lat (usec): min=6063, max=20978, avg=10869.46, stdev=2051.74 00:24:35.715 clat percentiles (usec): 00:24:35.715 | 1.00th=[ 6980], 5.00th=[ 7832], 10.00th=[ 8356], 20.00th=[ 9110], 00:24:35.715 | 30.00th=[ 9634], 40.00th=[10159], 50.00th=[10552], 60.00th=[11076], 00:24:35.715 | 70.00th=[11731], 80.00th=[12649], 90.00th=[13698], 95.00th=[14615], 00:24:35.715 | 99.00th=[16057], 99.50th=[16581], 99.90th=[17957], 99.95th=[18744], 00:24:35.715 | 99.99th=[20841] 00:24:35.715 bw ( KiB/s): min=63360, max=83904, per=89.79%, avg=72856.00, stdev=8445.79, samples=4 00:24:35.715 iops : min= 3960, max= 5244, avg=4553.50, stdev=527.86, samples=4 00:24:35.715 lat (msec) : 4=0.17%, 10=61.52%, 20=38.30%, 50=0.01% 00:24:35.715 cpu : usr=74.04%, sys=23.47%, ctx=43, majf=0, minf=71 00:24:35.715 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:24:35.715 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:35.715 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:35.715 issued rwts: total=17310,9159,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:35.715 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:35.715 00:24:35.715 Run status group 0 (all jobs): 00:24:35.715 READ: bw=135MiB/s (141MB/s), 135MiB/s-135MiB/s (141MB/s-141MB/s), io=270MiB (284MB), run=2008-2008msec 00:24:35.715 WRITE: bw=79.2MiB/s (83.1MB/s), 79.2MiB/s-79.2MiB/s (83.1MB/s-83.1MB/s), io=143MiB (150MB), run=1806-1806msec 00:24:35.715 11:48:55 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:35.715 11:48:55 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:24:35.715 11:48:55 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:24:35.715 11:48:55 -- host/fio.sh@51 -- # get_nvme_bdfs 00:24:35.715 11:48:55 -- common/autotest_common.sh@1508 -- # bdfs=() 00:24:35.715 11:48:55 -- common/autotest_common.sh@1508 -- # local bdfs 00:24:35.715 11:48:55 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:24:35.715 11:48:55 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:24:35.715 11:48:55 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:24:35.715 11:48:55 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:24:35.715 11:48:55 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:24:35.715 11:48:55 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:24:38.997 Nvme0n1 00:24:38.997 11:48:58 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:24:42.276 11:49:01 -- host/fio.sh@53 -- # ls_guid=4aaab6e3-9bf0-47b6-8f13-599e66e7a177 00:24:42.276 11:49:01 -- host/fio.sh@54 -- # get_lvs_free_mb 4aaab6e3-9bf0-47b6-8f13-599e66e7a177 00:24:42.276 11:49:01 -- common/autotest_common.sh@1353 -- # local lvs_uuid=4aaab6e3-9bf0-47b6-8f13-599e66e7a177 00:24:42.276 11:49:01 -- common/autotest_common.sh@1354 -- # local lvs_info 00:24:42.276 11:49:01 -- common/autotest_common.sh@1355 -- # local fc 00:24:42.276 11:49:01 -- common/autotest_common.sh@1356 -- # local cs 00:24:42.276 11:49:01 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:42.276 11:49:01 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:24:42.276 { 00:24:42.276 "uuid": "4aaab6e3-9bf0-47b6-8f13-599e66e7a177", 00:24:42.276 "name": "lvs_0", 00:24:42.276 "base_bdev": "Nvme0n1", 00:24:42.276 "total_data_clusters": 930, 00:24:42.276 "free_clusters": 930, 00:24:42.276 "block_size": 512, 00:24:42.276 "cluster_size": 1073741824 00:24:42.276 } 00:24:42.276 ]' 00:24:42.276 11:49:01 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="4aaab6e3-9bf0-47b6-8f13-599e66e7a177") .free_clusters' 00:24:42.276 11:49:01 -- common/autotest_common.sh@1358 -- # fc=930 00:24:42.276 11:49:01 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="4aaab6e3-9bf0-47b6-8f13-599e66e7a177") .cluster_size' 00:24:42.276 11:49:01 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:24:42.276 11:49:01 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:24:42.276 11:49:01 -- common/autotest_common.sh@1363 -- # echo 952320 00:24:42.276 952320 00:24:42.276 11:49:01 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:24:42.533 acf6ca7b-c22b-47bc-900d-7d11a393ca8f 00:24:42.533 11:49:02 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:24:42.790 11:49:02 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:24:43.047 11:49:02 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:24:43.308 11:49:03 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:43.308 11:49:03 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:43.308 11:49:03 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:43.308 11:49:03 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:43.308 11:49:03 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:43.308 11:49:03 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:43.308 11:49:03 -- common/autotest_common.sh@1330 -- # shift 00:24:43.308 11:49:03 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:43.308 11:49:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:43.308 11:49:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:43.308 11:49:03 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:43.308 11:49:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:43.308 11:49:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:43.308 11:49:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:43.308 11:49:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:43.308 11:49:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:43.308 11:49:03 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:43.308 11:49:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:43.308 11:49:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:43.308 11:49:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:43.308 11:49:03 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:43.308 11:49:03 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:43.566 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:43.566 fio-3.35 00:24:43.566 Starting 1 thread 00:24:43.566 EAL: No free 2048 kB hugepages reported on node 1 00:24:46.092 00:24:46.092 test: (groupid=0, jobs=1): err= 0: pid=3901548: Thu Nov 28 11:49:05 2024 00:24:46.092 read: IOPS=6477, BW=25.3MiB/s (26.5MB/s)(50.8MiB/2008msec) 00:24:46.092 slat (nsec): min=1796, max=134967, avg=2403.85, stdev=1843.09 00:24:46.092 clat (usec): min=971, max=170811, avg=10867.62, stdev=11257.51 00:24:46.092 lat (usec): min=973, max=170858, avg=10870.02, stdev=11257.76 00:24:46.092 clat percentiles (msec): 00:24:46.092 | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 10], 00:24:46.092 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:24:46.092 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:24:46.092 | 99.00th=[ 12], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:24:46.092 | 99.99th=[ 171] 00:24:46.092 bw ( KiB/s): min=18176, max=28656, per=99.85%, avg=25870.00, stdev=5135.10, samples=4 00:24:46.092 iops : min= 4544, max= 7164, avg=6467.50, stdev=1283.77, samples=4 00:24:46.092 write: IOPS=6484, BW=25.3MiB/s (26.6MB/s)(50.9MiB/2008msec); 0 zone resets 00:24:46.092 slat (nsec): min=1903, max=118384, avg=2520.10, stdev=1446.02 00:24:46.092 clat (usec): min=266, max=169162, avg=8725.99, stdev=10555.47 00:24:46.092 lat (usec): min=269, max=169167, avg=8728.51, stdev=10555.71 00:24:46.092 clat percentiles (msec): 00:24:46.092 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:24:46.092 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 9], 00:24:46.092 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 9], 95.00th=[ 10], 00:24:46.092 | 99.00th=[ 10], 99.50th=[ 14], 99.90th=[ 169], 99.95th=[ 169], 00:24:46.092 | 99.99th=[ 169] 00:24:46.092 bw ( KiB/s): min=19112, max=28352, per=99.97%, avg=25930.00, stdev=4546.56, samples=4 00:24:46.092 iops : min= 4778, max= 7088, avg=6482.50, stdev=1136.64, samples=4 00:24:46.092 lat (usec) : 500=0.02%, 1000=0.01% 00:24:46.092 lat (msec) : 2=0.03%, 4=0.18%, 10=72.61%, 20=26.68%, 250=0.49% 00:24:46.092 cpu : usr=61.83%, sys=35.38%, ctx=117, majf=0, minf=41 00:24:46.092 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:46.092 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:46.092 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:46.092 issued rwts: total=13006,13021,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:46.092 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:46.092 00:24:46.092 Run status group 0 (all jobs): 00:24:46.092 READ: bw=25.3MiB/s (26.5MB/s), 25.3MiB/s-25.3MiB/s (26.5MB/s-26.5MB/s), io=50.8MiB (53.3MB), run=2008-2008msec 00:24:46.092 WRITE: bw=25.3MiB/s (26.6MB/s), 25.3MiB/s-25.3MiB/s (26.6MB/s-26.6MB/s), io=50.9MiB (53.3MB), run=2008-2008msec 00:24:46.092 11:49:05 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:24:46.092 11:49:05 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:24:47.025 11:49:07 -- host/fio.sh@64 -- # ls_nested_guid=7876cdad-feee-4236-b1bf-eeac1b771e16 00:24:47.025 11:49:07 -- host/fio.sh@65 -- # get_lvs_free_mb 7876cdad-feee-4236-b1bf-eeac1b771e16 00:24:47.025 11:49:07 -- common/autotest_common.sh@1353 -- # local lvs_uuid=7876cdad-feee-4236-b1bf-eeac1b771e16 00:24:47.025 11:49:07 -- common/autotest_common.sh@1354 -- # local lvs_info 00:24:47.025 11:49:07 -- common/autotest_common.sh@1355 -- # local fc 00:24:47.025 11:49:07 -- common/autotest_common.sh@1356 -- # local cs 00:24:47.025 11:49:07 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:47.282 11:49:07 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:24:47.282 { 00:24:47.282 "uuid": "4aaab6e3-9bf0-47b6-8f13-599e66e7a177", 00:24:47.282 "name": "lvs_0", 00:24:47.282 "base_bdev": "Nvme0n1", 00:24:47.282 "total_data_clusters": 930, 00:24:47.282 "free_clusters": 0, 00:24:47.282 "block_size": 512, 00:24:47.282 "cluster_size": 1073741824 00:24:47.282 }, 00:24:47.282 { 00:24:47.282 "uuid": "7876cdad-feee-4236-b1bf-eeac1b771e16", 00:24:47.282 "name": "lvs_n_0", 00:24:47.282 "base_bdev": "acf6ca7b-c22b-47bc-900d-7d11a393ca8f", 00:24:47.282 "total_data_clusters": 237847, 00:24:47.282 "free_clusters": 237847, 00:24:47.282 "block_size": 512, 00:24:47.282 "cluster_size": 4194304 00:24:47.282 } 00:24:47.282 ]' 00:24:47.282 11:49:07 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="7876cdad-feee-4236-b1bf-eeac1b771e16") .free_clusters' 00:24:47.282 11:49:07 -- common/autotest_common.sh@1358 -- # fc=237847 00:24:47.282 11:49:07 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="7876cdad-feee-4236-b1bf-eeac1b771e16") .cluster_size' 00:24:47.540 11:49:07 -- common/autotest_common.sh@1359 -- # cs=4194304 00:24:47.540 11:49:07 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:24:47.540 11:49:07 -- common/autotest_common.sh@1363 -- # echo 951388 00:24:47.540 951388 00:24:47.540 11:49:07 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:24:48.105 66af8a10-ea6f-4074-897a-5620be98c20f 00:24:48.105 11:49:08 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:24:48.362 11:49:08 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:24:48.620 11:49:08 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:24:48.878 11:49:08 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:48.878 11:49:08 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:48.878 11:49:08 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:48.878 11:49:08 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:48.878 11:49:08 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:48.878 11:49:08 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:48.878 11:49:08 -- common/autotest_common.sh@1330 -- # shift 00:24:48.878 11:49:08 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:48.878 11:49:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:48.878 11:49:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:48.878 11:49:08 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:48.878 11:49:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:48.878 11:49:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:48.878 11:49:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:48.878 11:49:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:48.878 11:49:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:48.878 11:49:08 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:48.878 11:49:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:48.878 11:49:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:48.878 11:49:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:48.878 11:49:08 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:48.878 11:49:08 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:49.136 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:49.136 fio-3.35 00:24:49.136 Starting 1 thread 00:24:49.136 EAL: No free 2048 kB hugepages reported on node 1 00:24:51.724 00:24:51.724 test: (groupid=0, jobs=1): err= 0: pid=3902300: Thu Nov 28 11:49:11 2024 00:24:51.724 read: IOPS=6095, BW=23.8MiB/s (25.0MB/s)(47.8MiB/2009msec) 00:24:51.724 slat (nsec): min=1811, max=196912, avg=2443.61, stdev=2676.36 00:24:51.724 clat (usec): min=4623, max=18833, avg=11611.70, stdev=949.09 00:24:51.724 lat (usec): min=4630, max=18836, avg=11614.14, stdev=948.97 00:24:51.724 clat percentiles (usec): 00:24:51.724 | 1.00th=[ 9372], 5.00th=[10159], 10.00th=[10421], 20.00th=[10814], 00:24:51.724 | 30.00th=[11076], 40.00th=[11338], 50.00th=[11600], 60.00th=[11863], 00:24:51.724 | 70.00th=[12125], 80.00th=[12387], 90.00th=[12780], 95.00th=[13173], 00:24:51.724 | 99.00th=[13698], 99.50th=[13960], 99.90th=[16319], 99.95th=[17695], 00:24:51.724 | 99.99th=[17957] 00:24:51.724 bw ( KiB/s): min=23056, max=24872, per=99.89%, avg=24354.00, stdev=869.42, samples=4 00:24:51.724 iops : min= 5764, max= 6218, avg=6088.50, stdev=217.36, samples=4 00:24:51.724 write: IOPS=6072, BW=23.7MiB/s (24.9MB/s)(47.7MiB/2009msec); 0 zone resets 00:24:51.724 slat (nsec): min=1921, max=164679, avg=2521.94, stdev=1910.44 00:24:51.724 clat (usec): min=2330, max=17717, avg=9240.49, stdev=860.20 00:24:51.724 lat (usec): min=2339, max=17719, avg=9243.01, stdev=860.15 00:24:51.724 clat percentiles (usec): 00:24:51.724 | 1.00th=[ 7242], 5.00th=[ 7963], 10.00th=[ 8225], 20.00th=[ 8586], 00:24:51.724 | 30.00th=[ 8848], 40.00th=[ 8979], 50.00th=[ 9241], 60.00th=[ 9372], 00:24:51.724 | 70.00th=[ 9634], 80.00th=[ 9896], 90.00th=[10290], 95.00th=[10552], 00:24:51.724 | 99.00th=[11076], 99.50th=[11469], 99.90th=[16188], 99.95th=[16450], 00:24:51.724 | 99.99th=[17695] 00:24:51.724 bw ( KiB/s): min=24024, max=24448, per=99.96%, avg=24282.00, stdev=186.75, samples=4 00:24:51.724 iops : min= 6006, max= 6112, avg=6070.50, stdev=46.69, samples=4 00:24:51.724 lat (msec) : 4=0.04%, 10=43.58%, 20=56.37% 00:24:51.724 cpu : usr=60.76%, sys=36.60%, ctx=104, majf=0, minf=41 00:24:51.724 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:24:51.724 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:51.724 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:51.724 issued rwts: total=12245,12200,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:51.724 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:51.724 00:24:51.724 Run status group 0 (all jobs): 00:24:51.724 READ: bw=23.8MiB/s (25.0MB/s), 23.8MiB/s-23.8MiB/s (25.0MB/s-25.0MB/s), io=47.8MiB (50.2MB), run=2009-2009msec 00:24:51.724 WRITE: bw=23.7MiB/s (24.9MB/s), 23.7MiB/s-23.7MiB/s (24.9MB/s-24.9MB/s), io=47.7MiB (50.0MB), run=2009-2009msec 00:24:51.724 11:49:11 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:24:51.724 11:49:11 -- host/fio.sh@74 -- # sync 00:24:51.724 11:49:11 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:24:55.971 11:49:15 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:55.971 11:49:15 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:24:59.251 11:49:18 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:59.251 11:49:18 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:01.150 11:49:20 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:01.150 11:49:20 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:01.150 11:49:20 -- host/fio.sh@86 -- # nvmftestfini 00:25:01.150 11:49:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:01.150 11:49:20 -- nvmf/common.sh@116 -- # sync 00:25:01.150 11:49:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:01.150 11:49:20 -- nvmf/common.sh@119 -- # set +e 00:25:01.150 11:49:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:01.150 11:49:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:01.150 rmmod nvme_tcp 00:25:01.150 rmmod nvme_fabrics 00:25:01.150 rmmod nvme_keyring 00:25:01.151 11:49:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:01.151 11:49:20 -- nvmf/common.sh@123 -- # set -e 00:25:01.151 11:49:20 -- nvmf/common.sh@124 -- # return 0 00:25:01.151 11:49:20 -- nvmf/common.sh@477 -- # '[' -n 3899388 ']' 00:25:01.151 11:49:20 -- nvmf/common.sh@478 -- # killprocess 3899388 00:25:01.151 11:49:20 -- common/autotest_common.sh@936 -- # '[' -z 3899388 ']' 00:25:01.151 11:49:20 -- common/autotest_common.sh@940 -- # kill -0 3899388 00:25:01.151 11:49:20 -- common/autotest_common.sh@941 -- # uname 00:25:01.151 11:49:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:01.151 11:49:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3899388 00:25:01.151 11:49:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:01.151 11:49:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:01.151 11:49:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3899388' 00:25:01.151 killing process with pid 3899388 00:25:01.151 11:49:20 -- common/autotest_common.sh@955 -- # kill 3899388 00:25:01.151 11:49:20 -- common/autotest_common.sh@960 -- # wait 3899388 00:25:01.411 11:49:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:01.411 11:49:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:01.411 11:49:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:01.411 11:49:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:01.411 11:49:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:01.411 11:49:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:01.411 11:49:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:01.411 11:49:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:03.315 11:49:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:03.315 00:25:03.315 real 0m37.894s 00:25:03.315 user 2m24.499s 00:25:03.315 sys 0m7.131s 00:25:03.315 11:49:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:03.315 11:49:23 -- common/autotest_common.sh@10 -- # set +x 00:25:03.315 ************************************ 00:25:03.315 END TEST nvmf_fio_host 00:25:03.315 ************************************ 00:25:03.315 11:49:23 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:03.315 11:49:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:03.315 11:49:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:03.315 11:49:23 -- common/autotest_common.sh@10 -- # set +x 00:25:03.315 ************************************ 00:25:03.315 START TEST nvmf_failover 00:25:03.315 ************************************ 00:25:03.315 11:49:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:03.574 * Looking for test storage... 00:25:03.574 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:03.574 11:49:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:03.574 11:49:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:03.574 11:49:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:03.574 11:49:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:03.574 11:49:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:03.574 11:49:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:03.574 11:49:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:03.574 11:49:23 -- scripts/common.sh@335 -- # IFS=.-: 00:25:03.574 11:49:23 -- scripts/common.sh@335 -- # read -ra ver1 00:25:03.574 11:49:23 -- scripts/common.sh@336 -- # IFS=.-: 00:25:03.574 11:49:23 -- scripts/common.sh@336 -- # read -ra ver2 00:25:03.574 11:49:23 -- scripts/common.sh@337 -- # local 'op=<' 00:25:03.574 11:49:23 -- scripts/common.sh@339 -- # ver1_l=2 00:25:03.574 11:49:23 -- scripts/common.sh@340 -- # ver2_l=1 00:25:03.574 11:49:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:03.574 11:49:23 -- scripts/common.sh@343 -- # case "$op" in 00:25:03.574 11:49:23 -- scripts/common.sh@344 -- # : 1 00:25:03.574 11:49:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:03.574 11:49:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:03.574 11:49:23 -- scripts/common.sh@364 -- # decimal 1 00:25:03.574 11:49:23 -- scripts/common.sh@352 -- # local d=1 00:25:03.574 11:49:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:03.574 11:49:23 -- scripts/common.sh@354 -- # echo 1 00:25:03.574 11:49:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:03.574 11:49:23 -- scripts/common.sh@365 -- # decimal 2 00:25:03.574 11:49:23 -- scripts/common.sh@352 -- # local d=2 00:25:03.574 11:49:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:03.574 11:49:23 -- scripts/common.sh@354 -- # echo 2 00:25:03.574 11:49:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:03.574 11:49:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:03.574 11:49:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:03.574 11:49:23 -- scripts/common.sh@367 -- # return 0 00:25:03.574 11:49:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:03.574 11:49:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:03.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:03.574 --rc genhtml_branch_coverage=1 00:25:03.574 --rc genhtml_function_coverage=1 00:25:03.574 --rc genhtml_legend=1 00:25:03.574 --rc geninfo_all_blocks=1 00:25:03.574 --rc geninfo_unexecuted_blocks=1 00:25:03.574 00:25:03.574 ' 00:25:03.574 11:49:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:03.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:03.574 --rc genhtml_branch_coverage=1 00:25:03.574 --rc genhtml_function_coverage=1 00:25:03.574 --rc genhtml_legend=1 00:25:03.574 --rc geninfo_all_blocks=1 00:25:03.574 --rc geninfo_unexecuted_blocks=1 00:25:03.574 00:25:03.574 ' 00:25:03.574 11:49:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:03.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:03.574 --rc genhtml_branch_coverage=1 00:25:03.574 --rc genhtml_function_coverage=1 00:25:03.574 --rc genhtml_legend=1 00:25:03.574 --rc geninfo_all_blocks=1 00:25:03.574 --rc geninfo_unexecuted_blocks=1 00:25:03.574 00:25:03.574 ' 00:25:03.574 11:49:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:03.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:03.574 --rc genhtml_branch_coverage=1 00:25:03.574 --rc genhtml_function_coverage=1 00:25:03.574 --rc genhtml_legend=1 00:25:03.574 --rc geninfo_all_blocks=1 00:25:03.574 --rc geninfo_unexecuted_blocks=1 00:25:03.574 00:25:03.574 ' 00:25:03.574 11:49:23 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:03.574 11:49:23 -- nvmf/common.sh@7 -- # uname -s 00:25:03.574 11:49:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:03.574 11:49:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:03.574 11:49:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:03.574 11:49:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:03.574 11:49:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:03.574 11:49:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:03.574 11:49:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:03.574 11:49:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:03.574 11:49:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:03.574 11:49:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:03.574 11:49:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:03.574 11:49:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:03.574 11:49:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:03.574 11:49:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:03.574 11:49:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:03.574 11:49:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:03.574 11:49:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:03.574 11:49:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:03.574 11:49:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:03.574 11:49:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:03.574 11:49:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:03.574 11:49:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:03.574 11:49:23 -- paths/export.sh@5 -- # export PATH 00:25:03.574 11:49:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:03.574 11:49:23 -- nvmf/common.sh@46 -- # : 0 00:25:03.574 11:49:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:03.574 11:49:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:03.574 11:49:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:03.574 11:49:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:03.574 11:49:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:03.574 11:49:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:03.574 11:49:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:03.574 11:49:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:03.574 11:49:23 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:03.574 11:49:23 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:03.574 11:49:23 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:03.574 11:49:23 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:03.574 11:49:23 -- host/failover.sh@18 -- # nvmftestinit 00:25:03.574 11:49:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:03.574 11:49:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:03.574 11:49:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:03.574 11:49:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:03.575 11:49:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:03.575 11:49:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:03.575 11:49:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:03.575 11:49:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:03.575 11:49:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:03.575 11:49:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:03.575 11:49:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:03.575 11:49:23 -- common/autotest_common.sh@10 -- # set +x 00:25:06.105 11:49:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:06.105 11:49:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:06.105 11:49:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:06.105 11:49:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:06.105 11:49:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:06.105 11:49:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:06.105 11:49:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:06.105 11:49:25 -- nvmf/common.sh@294 -- # net_devs=() 00:25:06.105 11:49:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:06.105 11:49:25 -- nvmf/common.sh@295 -- # e810=() 00:25:06.105 11:49:25 -- nvmf/common.sh@295 -- # local -ga e810 00:25:06.105 11:49:25 -- nvmf/common.sh@296 -- # x722=() 00:25:06.105 11:49:25 -- nvmf/common.sh@296 -- # local -ga x722 00:25:06.105 11:49:25 -- nvmf/common.sh@297 -- # mlx=() 00:25:06.105 11:49:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:06.105 11:49:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:06.105 11:49:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:06.105 11:49:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:06.105 11:49:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:06.105 11:49:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:06.105 11:49:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:06.105 11:49:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:06.105 11:49:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:06.105 11:49:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:06.105 11:49:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:06.105 11:49:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:06.105 11:49:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:06.105 11:49:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:06.105 11:49:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:06.105 11:49:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:06.105 11:49:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:06.105 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:06.105 11:49:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:06.105 11:49:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:06.105 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:06.105 11:49:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:06.105 11:49:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:06.105 11:49:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:06.105 11:49:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:06.105 11:49:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:06.105 11:49:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:06.105 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:06.105 11:49:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:06.105 11:49:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:06.105 11:49:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:06.105 11:49:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:06.105 11:49:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:06.105 11:49:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:06.105 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:06.105 11:49:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:06.105 11:49:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:06.105 11:49:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:06.105 11:49:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:06.105 11:49:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:06.105 11:49:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:06.105 11:49:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:06.105 11:49:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:06.105 11:49:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:06.105 11:49:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:06.105 11:49:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:06.105 11:49:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:06.105 11:49:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:06.105 11:49:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:06.105 11:49:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:06.105 11:49:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:06.105 11:49:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:06.105 11:49:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:06.105 11:49:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:06.105 11:49:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:06.105 11:49:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:06.105 11:49:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:06.105 11:49:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:06.105 11:49:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:06.105 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:06.105 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.161 ms 00:25:06.105 00:25:06.105 --- 10.0.0.2 ping statistics --- 00:25:06.105 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:06.105 rtt min/avg/max/mdev = 0.161/0.161/0.161/0.000 ms 00:25:06.105 11:49:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:06.105 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:06.105 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:25:06.105 00:25:06.105 --- 10.0.0.1 ping statistics --- 00:25:06.105 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:06.105 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:25:06.105 11:49:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:06.105 11:49:25 -- nvmf/common.sh@410 -- # return 0 00:25:06.105 11:49:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:06.105 11:49:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:06.105 11:49:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:06.105 11:49:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:06.106 11:49:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:06.106 11:49:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:06.106 11:49:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:06.106 11:49:25 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:06.106 11:49:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:06.106 11:49:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:06.106 11:49:25 -- common/autotest_common.sh@10 -- # set +x 00:25:06.106 11:49:25 -- nvmf/common.sh@469 -- # nvmfpid=3905736 00:25:06.106 11:49:25 -- nvmf/common.sh@470 -- # waitforlisten 3905736 00:25:06.106 11:49:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:06.106 11:49:25 -- common/autotest_common.sh@829 -- # '[' -z 3905736 ']' 00:25:06.106 11:49:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:06.106 11:49:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:06.106 11:49:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:06.106 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:06.106 11:49:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:06.106 11:49:25 -- common/autotest_common.sh@10 -- # set +x 00:25:06.106 [2024-11-28 11:49:25.778869] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:06.106 [2024-11-28 11:49:25.778954] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:06.106 EAL: No free 2048 kB hugepages reported on node 1 00:25:06.106 [2024-11-28 11:49:25.848285] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:06.106 [2024-11-28 11:49:25.961821] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:06.106 [2024-11-28 11:49:25.962007] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:06.106 [2024-11-28 11:49:25.962027] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:06.106 [2024-11-28 11:49:25.962041] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:06.106 [2024-11-28 11:49:25.962129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:06.106 [2024-11-28 11:49:25.962242] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:06.106 [2024-11-28 11:49:25.962245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:07.040 11:49:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:07.040 11:49:26 -- common/autotest_common.sh@862 -- # return 0 00:25:07.040 11:49:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:07.040 11:49:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:07.040 11:49:26 -- common/autotest_common.sh@10 -- # set +x 00:25:07.040 11:49:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:07.040 11:49:26 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:07.040 [2024-11-28 11:49:26.979825] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:07.040 11:49:26 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:07.298 Malloc0 00:25:07.298 11:49:27 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:07.556 11:49:27 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:07.814 11:49:27 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:08.072 [2024-11-28 11:49:28.012462] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:08.072 11:49:28 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:08.331 [2024-11-28 11:49:28.261190] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:08.331 11:49:28 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:08.589 [2024-11-28 11:49:28.518080] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:08.589 11:49:28 -- host/failover.sh@31 -- # bdevperf_pid=3906043 00:25:08.589 11:49:28 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:08.589 11:49:28 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:08.589 11:49:28 -- host/failover.sh@34 -- # waitforlisten 3906043 /var/tmp/bdevperf.sock 00:25:08.589 11:49:28 -- common/autotest_common.sh@829 -- # '[' -z 3906043 ']' 00:25:08.589 11:49:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:08.589 11:49:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:08.589 11:49:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:08.589 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:08.589 11:49:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:08.589 11:49:28 -- common/autotest_common.sh@10 -- # set +x 00:25:09.523 11:49:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:09.523 11:49:29 -- common/autotest_common.sh@862 -- # return 0 00:25:09.523 11:49:29 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:10.088 NVMe0n1 00:25:10.088 11:49:29 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:10.345 00:25:10.345 11:49:30 -- host/failover.sh@39 -- # run_test_pid=3906311 00:25:10.345 11:49:30 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:10.345 11:49:30 -- host/failover.sh@41 -- # sleep 1 00:25:11.719 11:49:31 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:11.719 [2024-11-28 11:49:31.610360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.610989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.611001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.611012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.611023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.611035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.611046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 [2024-11-28 11:49:31.611057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233dcb0 is same with the state(5) to be set 00:25:11.720 11:49:31 -- host/failover.sh@45 -- # sleep 3 00:25:15.001 11:49:34 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:15.258 00:25:15.258 11:49:35 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:15.515 [2024-11-28 11:49:35.364873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.364932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.364962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.364974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.364986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.364997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.515 [2024-11-28 11:49:35.365495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.516 [2024-11-28 11:49:35.365522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.516 [2024-11-28 11:49:35.365546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.516 [2024-11-28 11:49:35.365558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.516 [2024-11-28 11:49:35.365570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.516 [2024-11-28 11:49:35.365581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.516 [2024-11-28 11:49:35.365593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.516 [2024-11-28 11:49:35.365604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.516 [2024-11-28 11:49:35.365615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233f3a0 is same with the state(5) to be set 00:25:15.516 11:49:35 -- host/failover.sh@50 -- # sleep 3 00:25:18.798 11:49:38 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:18.798 [2024-11-28 11:49:38.650217] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:18.798 11:49:38 -- host/failover.sh@55 -- # sleep 1 00:25:19.734 11:49:39 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:19.993 [2024-11-28 11:49:39.915742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915835] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.915991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 [2024-11-28 11:49:39.916420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x233fa80 is same with the state(5) to be set 00:25:19.993 11:49:39 -- host/failover.sh@59 -- # wait 3906311 00:25:26.552 0 00:25:26.552 11:49:45 -- host/failover.sh@61 -- # killprocess 3906043 00:25:26.552 11:49:45 -- common/autotest_common.sh@936 -- # '[' -z 3906043 ']' 00:25:26.552 11:49:45 -- common/autotest_common.sh@940 -- # kill -0 3906043 00:25:26.552 11:49:45 -- common/autotest_common.sh@941 -- # uname 00:25:26.552 11:49:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:26.552 11:49:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3906043 00:25:26.552 11:49:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:26.552 11:49:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:26.552 11:49:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3906043' 00:25:26.552 killing process with pid 3906043 00:25:26.552 11:49:45 -- common/autotest_common.sh@955 -- # kill 3906043 00:25:26.552 11:49:45 -- common/autotest_common.sh@960 -- # wait 3906043 00:25:26.552 11:49:45 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:26.552 [2024-11-28 11:49:28.573769] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:26.552 [2024-11-28 11:49:28.573871] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3906043 ] 00:25:26.552 EAL: No free 2048 kB hugepages reported on node 1 00:25:26.552 [2024-11-28 11:49:28.631695] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:26.552 [2024-11-28 11:49:28.739338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:26.552 Running I/O for 15 seconds... 00:25:26.552 [2024-11-28 11:49:31.611350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:115432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.552 [2024-11-28 11:49:31.611391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.552 [2024-11-28 11:49:31.611419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:115440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.552 [2024-11-28 11:49:31.611436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.552 [2024-11-28 11:49:31.611452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:115448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.552 [2024-11-28 11:49:31.611466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.552 [2024-11-28 11:49:31.611481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:115464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.552 [2024-11-28 11:49:31.611495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.552 [2024-11-28 11:49:31.611510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:115472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.552 [2024-11-28 11:49:31.611530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.552 [2024-11-28 11:49:31.611547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:115024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.552 [2024-11-28 11:49:31.611561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.552 [2024-11-28 11:49:31.611576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:115048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.552 [2024-11-28 11:49:31.611590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.552 [2024-11-28 11:49:31.611604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:115096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.552 [2024-11-28 11:49:31.611618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.552 [2024-11-28 11:49:31.611633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:115104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.552 [2024-11-28 11:49:31.611646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.552 [2024-11-28 11:49:31.611661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:115120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.552 [2024-11-28 11:49:31.611674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.552 [2024-11-28 11:49:31.611689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:115136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.552 [2024-11-28 11:49:31.611702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.552 [2024-11-28 11:49:31.611725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:115176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.552 [2024-11-28 11:49:31.611739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.611754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:115184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.611767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.611782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:115480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.611795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.611809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:115496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.611822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.611851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:115528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.611864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.611878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:115544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.611891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.611906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:115560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.611918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.611933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:115568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.611945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.611959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:115576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.611972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.611986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:115584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.611999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:115592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:115600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:115608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:115616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:115664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:115672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:115680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:115704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.553 [2024-11-28 11:49:31.612218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:115712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:115720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:115728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.553 [2024-11-28 11:49:31.612299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:115736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:115744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.553 [2024-11-28 11:49:31.612353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:115752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:115760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:115768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:115776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:115784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.553 [2024-11-28 11:49:31.612493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:115792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:115800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.553 [2024-11-28 11:49:31.612575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:115808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.553 [2024-11-28 11:49:31.612603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:115816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:115824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.553 [2024-11-28 11:49:31.612658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.553 [2024-11-28 11:49:31.612673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:115832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.612686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.612701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:115840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.612713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.612728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:115848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.612741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.612755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:115856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.612768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.612783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:115864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.612801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.612816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:115872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.612830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.612844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:115880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.612857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.612872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:115888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.612885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.612900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:115896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.612913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.612927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:115904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.612940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.612954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:115912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.612967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.612981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:115920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.612994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:115928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.613021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:115936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.613049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:115944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.613078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:115952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.613104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:115960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.613132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:115968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.613168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:115208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.613195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:115224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.613222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:115232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.613250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:115264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.613278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:115280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.613306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:115288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.613334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:115304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.613362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:115312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.613389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:115976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.613417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:115984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.613444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:115992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.613471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:116000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.613503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:116008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.613540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:116016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.554 [2024-11-28 11:49:31.613569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.554 [2024-11-28 11:49:31.613583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:116024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.554 [2024-11-28 11:49:31.613596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.613611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:116032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.555 [2024-11-28 11:49:31.613624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.613638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:116040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.555 [2024-11-28 11:49:31.613651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.613666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:116048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.613678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.613693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:116056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.613706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.613722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:116064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.555 [2024-11-28 11:49:31.613735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.613750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:116072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.555 [2024-11-28 11:49:31.613762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.613777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:116080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.613790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.613809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:116088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.555 [2024-11-28 11:49:31.613822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.613837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:116096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.613850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.613864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:116104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.613881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.613896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:116112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.555 [2024-11-28 11:49:31.613909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.613924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:116120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.613937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.613951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:116128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.613964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.613978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:116136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.555 [2024-11-28 11:49:31.613991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:116144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:115320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:115336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:115344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:115352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:115368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:115376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:115392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:115408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:115416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:115424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:115456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:115488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:115504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:115512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:115520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:115536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:116152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.555 [2024-11-28 11:49:31.614505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.555 [2024-11-28 11:49:31.614519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:116160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.555 [2024-11-28 11:49:31.614540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:116168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:31.614568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:116176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.556 [2024-11-28 11:49:31.614599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:116184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:31.614629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:116192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.556 [2024-11-28 11:49:31.614656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:116200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.556 [2024-11-28 11:49:31.614683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:116208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:31.614710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:116216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.556 [2024-11-28 11:49:31.614737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:116224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:31.614765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:116232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:31.614792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:116240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.556 [2024-11-28 11:49:31.614818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:115552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:31.614846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:115624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:31.614873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:115632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:31.614900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:115640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:31.614927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:115648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:31.614963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.614979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:115656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:31.614992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.615007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:115688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:31.615019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.615033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a36a0 is same with the state(5) to be set 00:25:26.556 [2024-11-28 11:49:31.615049] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:26.556 [2024-11-28 11:49:31.615060] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:26.556 [2024-11-28 11:49:31.615072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:115696 len:8 PRP1 0x0 PRP2 0x0 00:25:26.556 [2024-11-28 11:49:31.615084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.615144] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x10a36a0 was disconnected and freed. reset controller. 00:25:26.556 [2024-11-28 11:49:31.615168] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:26.556 [2024-11-28 11:49:31.615203] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:26.556 [2024-11-28 11:49:31.615221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.615235] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:26.556 [2024-11-28 11:49:31.615248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.615262] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:26.556 [2024-11-28 11:49:31.615274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.615287] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:26.556 [2024-11-28 11:49:31.615299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:31.615312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:26.556 [2024-11-28 11:49:31.617591] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:26.556 [2024-11-28 11:49:31.617629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1084870 (9): Bad file descriptor 00:25:26.556 [2024-11-28 11:49:31.689930] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:26.556 [2024-11-28 11:49:35.365774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:110704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:35.365816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:35.365850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:110720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:35.365867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:35.365883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:110728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:35.365897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.556 [2024-11-28 11:49:35.365911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:110016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.556 [2024-11-28 11:49:35.365924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.365939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:110096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.365951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.365967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:110168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.365979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.365994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:110176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:110200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:110224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:110232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:110248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:110760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:110768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:110776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:110256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:110264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:110288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:110296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:110304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:110328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:110336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:110344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:110800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:110824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:110832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:110848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:110880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:110888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:110896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:110904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:110912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.557 [2024-11-28 11:49:35.366729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:110928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.557 [2024-11-28 11:49:35.366742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.366756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:110952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.366770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.366784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:110960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.366797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.366812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:110968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.558 [2024-11-28 11:49:35.366824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.366854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:110976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.558 [2024-11-28 11:49:35.366867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.366881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:110984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.558 [2024-11-28 11:49:35.366893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.366907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:110992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.366920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.366935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:111000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.366951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.366966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:111008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.366978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.366993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:111016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.558 [2024-11-28 11:49:35.367006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:110352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:110360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:110368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:110392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:110416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:110424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:110432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:110456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:111024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.558 [2024-11-28 11:49:35.367249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:111032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.558 [2024-11-28 11:49:35.367276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:111040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:111048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.558 [2024-11-28 11:49:35.367335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:110464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:110472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:110480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:110488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:110496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:110512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:110520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:110544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.558 [2024-11-28 11:49:35.367573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:111056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.558 [2024-11-28 11:49:35.367601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:111064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.558 [2024-11-28 11:49:35.367628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.558 [2024-11-28 11:49:35.367642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:111072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.559 [2024-11-28 11:49:35.367655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.367673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:111080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.559 [2024-11-28 11:49:35.367687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.367702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:111088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.367715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.367730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:111096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.367743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.367757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:111104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.559 [2024-11-28 11:49:35.367770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.367784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:111112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.367807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.367822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:111120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.559 [2024-11-28 11:49:35.367850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.367865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:111128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.367877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.367892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:111136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.367905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.367919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:111144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.367931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.367945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:111152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.367958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.367972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:111160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.559 [2024-11-28 11:49:35.367984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.367998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:110560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.368011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:110568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.368041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:110576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.368068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:110584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.368094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:110616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.368120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:110640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.368147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:110656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.368174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:110664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.368201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:111168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.559 [2024-11-28 11:49:35.368227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:111176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.559 [2024-11-28 11:49:35.368254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:111184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.368280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:111192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.559 [2024-11-28 11:49:35.368307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:111200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.559 [2024-11-28 11:49:35.368333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:111208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.368359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:111216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.559 [2024-11-28 11:49:35.368390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:111224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.368418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:111232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.559 [2024-11-28 11:49:35.368445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:111240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.559 [2024-11-28 11:49:35.368472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:111248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.559 [2024-11-28 11:49:35.368499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.559 [2024-11-28 11:49:35.368512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:111256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.368530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:110696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.368576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:110712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.368604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:110736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.368631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:110744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.368659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:110752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.368686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:110784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.368714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:110792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.368751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:110808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.368779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:111264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.368807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:111272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.368835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:111280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.560 [2024-11-28 11:49:35.368862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:111288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.560 [2024-11-28 11:49:35.368890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:111296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.560 [2024-11-28 11:49:35.368917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:111304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.560 [2024-11-28 11:49:35.368944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:111312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.368972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.368986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:111320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.368999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.369013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:111328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.560 [2024-11-28 11:49:35.369026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.369041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:111336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.560 [2024-11-28 11:49:35.369054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.369068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:111344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.560 [2024-11-28 11:49:35.369080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.369098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:111352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.560 [2024-11-28 11:49:35.369112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.369126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:111360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.369139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.369153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:111368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.560 [2024-11-28 11:49:35.369166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.369180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:111376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.560 [2024-11-28 11:49:35.369193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.369208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:111384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.369220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.369235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:111392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.369247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.369261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:110816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.560 [2024-11-28 11:49:35.369274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.560 [2024-11-28 11:49:35.369289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:110840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:35.369302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:35.369316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:110856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:35.369328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:35.369343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:110864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:35.369355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:35.369369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:110872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:35.369382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:35.369396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:110920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:35.369408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:35.369422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:110936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:35.369439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:35.369453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1090d10 is same with the state(5) to be set 00:25:26.561 [2024-11-28 11:49:35.369469] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:26.561 [2024-11-28 11:49:35.369480] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:26.561 [2024-11-28 11:49:35.369498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:110944 len:8 PRP1 0x0 PRP2 0x0 00:25:26.561 [2024-11-28 11:49:35.369511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:35.369578] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1090d10 was disconnected and freed. reset controller. 00:25:26.561 [2024-11-28 11:49:35.369596] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:26.561 [2024-11-28 11:49:35.369629] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:26.561 [2024-11-28 11:49:35.369646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:35.369661] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:26.561 [2024-11-28 11:49:35.369674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:35.369687] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:26.561 [2024-11-28 11:49:35.369700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:35.369713] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:26.561 [2024-11-28 11:49:35.369725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:35.369738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:26.561 [2024-11-28 11:49:35.369789] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1084870 (9): Bad file descriptor 00:25:26.561 [2024-11-28 11:49:35.371927] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:26.561 [2024-11-28 11:49:35.401480] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:26.561 [2024-11-28 11:49:39.915753] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:26.561 [2024-11-28 11:49:39.915816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.915834] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:26.561 [2024-11-28 11:49:39.915849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.915864] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:26.561 [2024-11-28 11:49:39.915876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.915891] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:26.561 [2024-11-28 11:49:39.915904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.915923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1084870 is same with the state(5) to be set 00:25:26.561 [2024-11-28 11:49:39.916579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:67072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:39.916602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.916627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:66528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:39.916642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.916658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:66544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:39.916671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.916685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:66552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:39.916699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.916713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:66592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:39.916726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.916740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:66600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:39.916753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.916768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:66616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:39.916781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.916805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:66632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:39.916818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.916848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:66640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:39.916864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.916878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:67080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:39.916891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.916905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:67112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:39.916918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.916932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:67136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:39.916945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.916964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:67152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:39.916978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.916992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:67184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.561 [2024-11-28 11:49:39.917004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.561 [2024-11-28 11:49:39.917018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:67192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:67200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:67208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:67216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:67224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:67232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:67240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:67256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:67264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:67272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:67288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:66648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:66656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:66664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:66672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:66680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:66688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:66696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:66712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:67312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:67320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:67328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:67336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:66728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:66736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:66776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:66792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:66848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:66864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:66896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:66904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:67352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:66912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.562 [2024-11-28 11:49:39.917953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.562 [2024-11-28 11:49:39.917967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:66936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.917980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.917994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:66952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:66960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:66992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:67008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:67016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:67056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:67368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.563 [2024-11-28 11:49:39.918181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:67376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.563 [2024-11-28 11:49:39.918208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:67384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.563 [2024-11-28 11:49:39.918235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:67392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:67400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:67408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.563 [2024-11-28 11:49:39.918315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:67416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:67424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:67432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:67440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:67448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:67456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:67464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.563 [2024-11-28 11:49:39.918508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:67472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:67480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.563 [2024-11-28 11:49:39.918587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:67488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.563 [2024-11-28 11:49:39.918615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:67496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:67504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.563 [2024-11-28 11:49:39.918684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:67512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.563 [2024-11-28 11:49:39.918697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.918712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:67520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.918724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.918739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:67528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.564 [2024-11-28 11:49:39.918752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.918770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:67536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.918784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.918798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:67544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.564 [2024-11-28 11:49:39.918811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.918826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:67552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.918839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.918869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:67560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.918881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.918895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:67568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.564 [2024-11-28 11:49:39.918907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.918922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:67576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.918935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.918949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:67584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.564 [2024-11-28 11:49:39.918962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.918976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:67592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.918988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:67600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.564 [2024-11-28 11:49:39.919015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:67608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:67064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:67088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:67096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:67104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:67120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:67128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:67144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:67160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:67616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.564 [2024-11-28 11:49:39.919285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:67624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:67632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:67640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:67648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:67656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.564 [2024-11-28 11:49:39.919426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:67664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.564 [2024-11-28 11:49:39.919452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:67672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:67680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.564 [2024-11-28 11:49:39.919510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:67688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.564 [2024-11-28 11:49:39.919560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.564 [2024-11-28 11:49:39.919575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:67696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.565 [2024-11-28 11:49:39.919589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:67704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.565 [2024-11-28 11:49:39.919615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:67712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.565 [2024-11-28 11:49:39.919643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:67720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.565 [2024-11-28 11:49:39.919670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:67728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.565 [2024-11-28 11:49:39.919697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:67736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.565 [2024-11-28 11:49:39.919725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:67744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.565 [2024-11-28 11:49:39.919753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:67752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.565 [2024-11-28 11:49:39.919780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:67760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.565 [2024-11-28 11:49:39.919807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:67768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.565 [2024-11-28 11:49:39.919840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:67776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.565 [2024-11-28 11:49:39.919873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:67784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.565 [2024-11-28 11:49:39.919900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:67792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.565 [2024-11-28 11:49:39.919927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:67800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.565 [2024-11-28 11:49:39.919955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:67808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.565 [2024-11-28 11:49:39.919982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.919996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:67816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:26.565 [2024-11-28 11:49:39.920009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.920024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:67824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.565 [2024-11-28 11:49:39.920037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.920051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:67168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.565 [2024-11-28 11:49:39.920064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.920078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:67176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.565 [2024-11-28 11:49:39.920091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.920105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:67248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.565 [2024-11-28 11:49:39.920118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.920132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:67280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.565 [2024-11-28 11:49:39.920145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.920160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:67296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.565 [2024-11-28 11:49:39.920172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.920186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:67304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.565 [2024-11-28 11:49:39.920203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.920218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:67344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:26.565 [2024-11-28 11:49:39.920231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.920244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7630 is same with the state(5) to be set 00:25:26.565 [2024-11-28 11:49:39.920260] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:26.565 [2024-11-28 11:49:39.920271] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:26.565 [2024-11-28 11:49:39.920288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:67360 len:8 PRP1 0x0 PRP2 0x0 00:25:26.565 [2024-11-28 11:49:39.920301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:26.565 [2024-11-28 11:49:39.920366] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x10a7630 was disconnected and freed. reset controller. 00:25:26.565 [2024-11-28 11:49:39.920383] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:26.565 [2024-11-28 11:49:39.920399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:26.565 [2024-11-28 11:49:39.922570] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:26.565 [2024-11-28 11:49:39.922611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1084870 (9): Bad file descriptor 00:25:26.565 [2024-11-28 11:49:39.949713] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:26.565 00:25:26.565 Latency(us) 00:25:26.565 [2024-11-28T10:49:46.621Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:26.565 [2024-11-28T10:49:46.621Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:26.565 Verification LBA range: start 0x0 length 0x4000 00:25:26.565 NVMe0n1 : 15.01 11838.75 46.25 489.71 0.00 10364.98 579.51 15922.82 00:25:26.565 [2024-11-28T10:49:46.622Z] =================================================================================================================== 00:25:26.566 [2024-11-28T10:49:46.622Z] Total : 11838.75 46.25 489.71 0.00 10364.98 579.51 15922.82 00:25:26.566 Received shutdown signal, test time was about 15.000000 seconds 00:25:26.566 00:25:26.566 Latency(us) 00:25:26.566 [2024-11-28T10:49:46.622Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:26.566 [2024-11-28T10:49:46.622Z] =================================================================================================================== 00:25:26.566 [2024-11-28T10:49:46.622Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:26.566 11:49:45 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:26.566 11:49:45 -- host/failover.sh@65 -- # count=3 00:25:26.566 11:49:45 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:26.566 11:49:45 -- host/failover.sh@73 -- # bdevperf_pid=3908089 00:25:26.566 11:49:45 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:26.566 11:49:45 -- host/failover.sh@75 -- # waitforlisten 3908089 /var/tmp/bdevperf.sock 00:25:26.566 11:49:45 -- common/autotest_common.sh@829 -- # '[' -z 3908089 ']' 00:25:26.566 11:49:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:26.566 11:49:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:26.566 11:49:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:26.566 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:26.566 11:49:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:26.566 11:49:45 -- common/autotest_common.sh@10 -- # set +x 00:25:26.823 11:49:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:26.823 11:49:46 -- common/autotest_common.sh@862 -- # return 0 00:25:26.823 11:49:46 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:27.080 [2024-11-28 11:49:47.095366] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:27.080 11:49:47 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:27.336 [2024-11-28 11:49:47.348044] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:27.336 11:49:47 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:27.899 NVMe0n1 00:25:27.899 11:49:47 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:28.156 00:25:28.156 11:49:48 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:28.414 00:25:28.414 11:49:48 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:28.414 11:49:48 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:28.671 11:49:48 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:28.929 11:49:48 -- host/failover.sh@87 -- # sleep 3 00:25:32.207 11:49:51 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:32.207 11:49:51 -- host/failover.sh@88 -- # grep -q NVMe0 00:25:32.207 11:49:52 -- host/failover.sh@90 -- # run_test_pid=3908908 00:25:32.207 11:49:52 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:32.207 11:49:52 -- host/failover.sh@92 -- # wait 3908908 00:25:33.583 0 00:25:33.583 11:49:53 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:33.583 [2024-11-28 11:49:45.877775] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:33.583 [2024-11-28 11:49:45.877872] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3908089 ] 00:25:33.583 EAL: No free 2048 kB hugepages reported on node 1 00:25:33.583 [2024-11-28 11:49:45.940003] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:33.583 [2024-11-28 11:49:46.046663] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:33.583 [2024-11-28 11:49:48.893769] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:33.583 [2024-11-28 11:49:48.893865] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:33.583 [2024-11-28 11:49:48.893904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:33.583 [2024-11-28 11:49:48.893930] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:33.583 [2024-11-28 11:49:48.893944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:33.583 [2024-11-28 11:49:48.893958] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:33.583 [2024-11-28 11:49:48.893972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:33.583 [2024-11-28 11:49:48.893985] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:33.583 [2024-11-28 11:49:48.893999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:33.583 [2024-11-28 11:49:48.894013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:33.583 [2024-11-28 11:49:48.894049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:33.583 [2024-11-28 11:49:48.894079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1465870 (9): Bad file descriptor 00:25:33.583 [2024-11-28 11:49:48.901982] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:33.583 Running I/O for 1 seconds... 00:25:33.583 00:25:33.583 Latency(us) 00:25:33.583 [2024-11-28T10:49:53.639Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:33.583 [2024-11-28T10:49:53.639Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:33.583 Verification LBA range: start 0x0 length 0x4000 00:25:33.583 NVMe0n1 : 1.00 11925.38 46.58 0.00 0.00 10689.28 1134.74 13981.01 00:25:33.583 [2024-11-28T10:49:53.639Z] =================================================================================================================== 00:25:33.583 [2024-11-28T10:49:53.639Z] Total : 11925.38 46.58 0.00 0.00 10689.28 1134.74 13981.01 00:25:33.583 11:49:53 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:33.583 11:49:53 -- host/failover.sh@95 -- # grep -q NVMe0 00:25:33.583 11:49:53 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:33.841 11:49:53 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:33.841 11:49:53 -- host/failover.sh@99 -- # grep -q NVMe0 00:25:34.099 11:49:54 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:34.357 11:49:54 -- host/failover.sh@101 -- # sleep 3 00:25:37.720 11:49:57 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:37.720 11:49:57 -- host/failover.sh@103 -- # grep -q NVMe0 00:25:37.720 11:49:57 -- host/failover.sh@108 -- # killprocess 3908089 00:25:37.720 11:49:57 -- common/autotest_common.sh@936 -- # '[' -z 3908089 ']' 00:25:37.720 11:49:57 -- common/autotest_common.sh@940 -- # kill -0 3908089 00:25:37.720 11:49:57 -- common/autotest_common.sh@941 -- # uname 00:25:37.720 11:49:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:37.720 11:49:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3908089 00:25:37.720 11:49:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:37.720 11:49:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:37.720 11:49:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3908089' 00:25:37.720 killing process with pid 3908089 00:25:37.720 11:49:57 -- common/autotest_common.sh@955 -- # kill 3908089 00:25:37.720 11:49:57 -- common/autotest_common.sh@960 -- # wait 3908089 00:25:37.978 11:49:57 -- host/failover.sh@110 -- # sync 00:25:37.978 11:49:57 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:38.237 11:49:58 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:25:38.237 11:49:58 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:38.237 11:49:58 -- host/failover.sh@116 -- # nvmftestfini 00:25:38.237 11:49:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:38.237 11:49:58 -- nvmf/common.sh@116 -- # sync 00:25:38.237 11:49:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:38.237 11:49:58 -- nvmf/common.sh@119 -- # set +e 00:25:38.237 11:49:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:38.237 11:49:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:38.237 rmmod nvme_tcp 00:25:38.237 rmmod nvme_fabrics 00:25:38.237 rmmod nvme_keyring 00:25:38.495 11:49:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:38.495 11:49:58 -- nvmf/common.sh@123 -- # set -e 00:25:38.495 11:49:58 -- nvmf/common.sh@124 -- # return 0 00:25:38.495 11:49:58 -- nvmf/common.sh@477 -- # '[' -n 3905736 ']' 00:25:38.495 11:49:58 -- nvmf/common.sh@478 -- # killprocess 3905736 00:25:38.495 11:49:58 -- common/autotest_common.sh@936 -- # '[' -z 3905736 ']' 00:25:38.495 11:49:58 -- common/autotest_common.sh@940 -- # kill -0 3905736 00:25:38.495 11:49:58 -- common/autotest_common.sh@941 -- # uname 00:25:38.495 11:49:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:38.495 11:49:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3905736 00:25:38.495 11:49:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:38.495 11:49:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:38.495 11:49:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3905736' 00:25:38.495 killing process with pid 3905736 00:25:38.495 11:49:58 -- common/autotest_common.sh@955 -- # kill 3905736 00:25:38.495 11:49:58 -- common/autotest_common.sh@960 -- # wait 3905736 00:25:38.754 11:49:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:38.754 11:49:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:38.754 11:49:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:38.754 11:49:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:38.754 11:49:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:38.754 11:49:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:38.754 11:49:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:38.754 11:49:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:40.660 11:50:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:40.660 00:25:40.660 real 0m37.353s 00:25:40.660 user 2m9.630s 00:25:40.660 sys 0m7.131s 00:25:40.660 11:50:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:40.660 11:50:00 -- common/autotest_common.sh@10 -- # set +x 00:25:40.660 ************************************ 00:25:40.660 END TEST nvmf_failover 00:25:40.660 ************************************ 00:25:40.660 11:50:00 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:25:40.660 11:50:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:40.660 11:50:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:40.660 11:50:00 -- common/autotest_common.sh@10 -- # set +x 00:25:40.660 ************************************ 00:25:40.660 START TEST nvmf_discovery 00:25:40.660 ************************************ 00:25:40.660 11:50:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:25:40.919 * Looking for test storage... 00:25:40.919 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:40.919 11:50:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:40.919 11:50:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:40.919 11:50:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:40.919 11:50:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:40.919 11:50:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:40.919 11:50:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:40.919 11:50:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:40.919 11:50:00 -- scripts/common.sh@335 -- # IFS=.-: 00:25:40.919 11:50:00 -- scripts/common.sh@335 -- # read -ra ver1 00:25:40.919 11:50:00 -- scripts/common.sh@336 -- # IFS=.-: 00:25:40.919 11:50:00 -- scripts/common.sh@336 -- # read -ra ver2 00:25:40.919 11:50:00 -- scripts/common.sh@337 -- # local 'op=<' 00:25:40.919 11:50:00 -- scripts/common.sh@339 -- # ver1_l=2 00:25:40.919 11:50:00 -- scripts/common.sh@340 -- # ver2_l=1 00:25:40.919 11:50:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:40.919 11:50:00 -- scripts/common.sh@343 -- # case "$op" in 00:25:40.920 11:50:00 -- scripts/common.sh@344 -- # : 1 00:25:40.920 11:50:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:40.920 11:50:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:40.920 11:50:00 -- scripts/common.sh@364 -- # decimal 1 00:25:40.920 11:50:00 -- scripts/common.sh@352 -- # local d=1 00:25:40.920 11:50:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:40.920 11:50:00 -- scripts/common.sh@354 -- # echo 1 00:25:40.920 11:50:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:40.920 11:50:00 -- scripts/common.sh@365 -- # decimal 2 00:25:40.920 11:50:00 -- scripts/common.sh@352 -- # local d=2 00:25:40.920 11:50:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:40.920 11:50:00 -- scripts/common.sh@354 -- # echo 2 00:25:40.920 11:50:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:40.920 11:50:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:40.920 11:50:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:40.920 11:50:00 -- scripts/common.sh@367 -- # return 0 00:25:40.920 11:50:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:40.920 11:50:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:40.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.920 --rc genhtml_branch_coverage=1 00:25:40.920 --rc genhtml_function_coverage=1 00:25:40.920 --rc genhtml_legend=1 00:25:40.920 --rc geninfo_all_blocks=1 00:25:40.920 --rc geninfo_unexecuted_blocks=1 00:25:40.920 00:25:40.920 ' 00:25:40.920 11:50:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:40.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.920 --rc genhtml_branch_coverage=1 00:25:40.920 --rc genhtml_function_coverage=1 00:25:40.920 --rc genhtml_legend=1 00:25:40.920 --rc geninfo_all_blocks=1 00:25:40.920 --rc geninfo_unexecuted_blocks=1 00:25:40.920 00:25:40.920 ' 00:25:40.920 11:50:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:40.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.920 --rc genhtml_branch_coverage=1 00:25:40.920 --rc genhtml_function_coverage=1 00:25:40.920 --rc genhtml_legend=1 00:25:40.920 --rc geninfo_all_blocks=1 00:25:40.920 --rc geninfo_unexecuted_blocks=1 00:25:40.920 00:25:40.920 ' 00:25:40.920 11:50:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:40.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.920 --rc genhtml_branch_coverage=1 00:25:40.920 --rc genhtml_function_coverage=1 00:25:40.920 --rc genhtml_legend=1 00:25:40.920 --rc geninfo_all_blocks=1 00:25:40.920 --rc geninfo_unexecuted_blocks=1 00:25:40.920 00:25:40.920 ' 00:25:40.920 11:50:00 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:40.920 11:50:00 -- nvmf/common.sh@7 -- # uname -s 00:25:40.920 11:50:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:40.920 11:50:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:40.920 11:50:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:40.920 11:50:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:40.920 11:50:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:40.920 11:50:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:40.920 11:50:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:40.920 11:50:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:40.920 11:50:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:40.920 11:50:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:40.920 11:50:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:40.920 11:50:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:40.920 11:50:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:40.920 11:50:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:40.920 11:50:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:40.920 11:50:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:40.920 11:50:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:40.920 11:50:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:40.920 11:50:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:40.920 11:50:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.920 11:50:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.920 11:50:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.920 11:50:00 -- paths/export.sh@5 -- # export PATH 00:25:40.920 11:50:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.920 11:50:00 -- nvmf/common.sh@46 -- # : 0 00:25:40.920 11:50:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:40.920 11:50:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:40.920 11:50:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:40.920 11:50:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:40.920 11:50:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:40.920 11:50:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:40.920 11:50:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:40.920 11:50:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:40.920 11:50:00 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:25:40.920 11:50:00 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:25:40.920 11:50:00 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:25:40.920 11:50:00 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:25:40.920 11:50:00 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:25:40.920 11:50:00 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:25:40.920 11:50:00 -- host/discovery.sh@25 -- # nvmftestinit 00:25:40.920 11:50:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:40.920 11:50:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:40.920 11:50:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:40.920 11:50:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:40.920 11:50:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:40.920 11:50:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:40.920 11:50:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:40.920 11:50:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:40.920 11:50:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:40.920 11:50:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:40.920 11:50:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:40.920 11:50:00 -- common/autotest_common.sh@10 -- # set +x 00:25:42.822 11:50:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:42.822 11:50:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:42.822 11:50:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:42.822 11:50:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:42.822 11:50:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:42.822 11:50:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:42.822 11:50:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:42.822 11:50:02 -- nvmf/common.sh@294 -- # net_devs=() 00:25:42.822 11:50:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:42.822 11:50:02 -- nvmf/common.sh@295 -- # e810=() 00:25:42.822 11:50:02 -- nvmf/common.sh@295 -- # local -ga e810 00:25:42.822 11:50:02 -- nvmf/common.sh@296 -- # x722=() 00:25:42.822 11:50:02 -- nvmf/common.sh@296 -- # local -ga x722 00:25:42.822 11:50:02 -- nvmf/common.sh@297 -- # mlx=() 00:25:42.822 11:50:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:42.822 11:50:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:42.822 11:50:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:42.822 11:50:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:42.822 11:50:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:42.822 11:50:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:42.822 11:50:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:42.822 11:50:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:42.822 11:50:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:42.822 11:50:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:42.822 11:50:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:42.822 11:50:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:42.822 11:50:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:42.822 11:50:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:42.822 11:50:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:42.822 11:50:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:42.822 11:50:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:42.822 11:50:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:42.822 11:50:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:42.822 11:50:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:42.822 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:42.822 11:50:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:42.822 11:50:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:42.822 11:50:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:42.822 11:50:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:42.822 11:50:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:42.822 11:50:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:42.822 11:50:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:42.822 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:42.822 11:50:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:42.822 11:50:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:42.823 11:50:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:42.823 11:50:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:42.823 11:50:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:42.823 11:50:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:42.823 11:50:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:42.823 11:50:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:42.823 11:50:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:42.823 11:50:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:42.823 11:50:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:42.823 11:50:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:42.823 11:50:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:42.823 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:42.823 11:50:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:42.823 11:50:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:42.823 11:50:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:42.823 11:50:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:42.823 11:50:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:42.823 11:50:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:42.823 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:42.823 11:50:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:42.823 11:50:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:42.823 11:50:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:42.823 11:50:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:42.823 11:50:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:42.823 11:50:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:42.823 11:50:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:42.823 11:50:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:42.823 11:50:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:42.823 11:50:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:42.823 11:50:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:42.823 11:50:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:42.823 11:50:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:42.823 11:50:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:42.823 11:50:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:42.823 11:50:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:42.823 11:50:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:42.823 11:50:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:42.823 11:50:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:43.081 11:50:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:43.081 11:50:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:43.081 11:50:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:43.081 11:50:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:43.081 11:50:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:43.081 11:50:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:43.081 11:50:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:43.081 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:43.081 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.350 ms 00:25:43.081 00:25:43.081 --- 10.0.0.2 ping statistics --- 00:25:43.081 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.081 rtt min/avg/max/mdev = 0.350/0.350/0.350/0.000 ms 00:25:43.081 11:50:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:43.081 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:43.081 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:25:43.081 00:25:43.081 --- 10.0.0.1 ping statistics --- 00:25:43.081 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.081 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:25:43.081 11:50:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:43.081 11:50:03 -- nvmf/common.sh@410 -- # return 0 00:25:43.081 11:50:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:43.081 11:50:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:43.081 11:50:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:43.081 11:50:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:43.081 11:50:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:43.081 11:50:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:43.081 11:50:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:43.081 11:50:03 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:25:43.081 11:50:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:43.081 11:50:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:43.081 11:50:03 -- common/autotest_common.sh@10 -- # set +x 00:25:43.081 11:50:03 -- nvmf/common.sh@469 -- # nvmfpid=3911675 00:25:43.082 11:50:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:25:43.082 11:50:03 -- nvmf/common.sh@470 -- # waitforlisten 3911675 00:25:43.082 11:50:03 -- common/autotest_common.sh@829 -- # '[' -z 3911675 ']' 00:25:43.082 11:50:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:43.082 11:50:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:43.082 11:50:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:43.082 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:43.082 11:50:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:43.082 11:50:03 -- common/autotest_common.sh@10 -- # set +x 00:25:43.082 [2024-11-28 11:50:03.085652] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:43.082 [2024-11-28 11:50:03.085725] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:43.082 EAL: No free 2048 kB hugepages reported on node 1 00:25:43.340 [2024-11-28 11:50:03.153628] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:43.340 [2024-11-28 11:50:03.267002] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:43.340 [2024-11-28 11:50:03.267177] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:43.340 [2024-11-28 11:50:03.267195] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:43.340 [2024-11-28 11:50:03.267209] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:43.340 [2024-11-28 11:50:03.267241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:44.273 11:50:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:44.273 11:50:04 -- common/autotest_common.sh@862 -- # return 0 00:25:44.273 11:50:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:44.273 11:50:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:44.273 11:50:04 -- common/autotest_common.sh@10 -- # set +x 00:25:44.273 11:50:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:44.273 11:50:04 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:44.273 11:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.273 11:50:04 -- common/autotest_common.sh@10 -- # set +x 00:25:44.273 [2024-11-28 11:50:04.054503] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:44.273 11:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.273 11:50:04 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:25:44.273 11:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.273 11:50:04 -- common/autotest_common.sh@10 -- # set +x 00:25:44.273 [2024-11-28 11:50:04.062692] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:25:44.273 11:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.273 11:50:04 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:25:44.274 11:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.274 11:50:04 -- common/autotest_common.sh@10 -- # set +x 00:25:44.274 null0 00:25:44.274 11:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.274 11:50:04 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:25:44.274 11:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.274 11:50:04 -- common/autotest_common.sh@10 -- # set +x 00:25:44.274 null1 00:25:44.274 11:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.274 11:50:04 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:25:44.274 11:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.274 11:50:04 -- common/autotest_common.sh@10 -- # set +x 00:25:44.274 11:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.274 11:50:04 -- host/discovery.sh@45 -- # hostpid=3911836 00:25:44.274 11:50:04 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:25:44.274 11:50:04 -- host/discovery.sh@46 -- # waitforlisten 3911836 /tmp/host.sock 00:25:44.274 11:50:04 -- common/autotest_common.sh@829 -- # '[' -z 3911836 ']' 00:25:44.274 11:50:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:25:44.274 11:50:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:44.274 11:50:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:25:44.274 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:25:44.274 11:50:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:44.274 11:50:04 -- common/autotest_common.sh@10 -- # set +x 00:25:44.274 [2024-11-28 11:50:04.132507] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:44.274 [2024-11-28 11:50:04.132618] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3911836 ] 00:25:44.274 EAL: No free 2048 kB hugepages reported on node 1 00:25:44.274 [2024-11-28 11:50:04.193214] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:44.274 [2024-11-28 11:50:04.306653] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:44.274 [2024-11-28 11:50:04.306818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:45.217 11:50:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:45.217 11:50:05 -- common/autotest_common.sh@862 -- # return 0 00:25:45.217 11:50:05 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:45.217 11:50:05 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:25:45.217 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.217 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.217 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.217 11:50:05 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:25:45.217 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.217 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.217 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.217 11:50:05 -- host/discovery.sh@72 -- # notify_id=0 00:25:45.217 11:50:05 -- host/discovery.sh@78 -- # get_subsystem_names 00:25:45.217 11:50:05 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:45.217 11:50:05 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:45.217 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.217 11:50:05 -- host/discovery.sh@59 -- # sort 00:25:45.217 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.217 11:50:05 -- host/discovery.sh@59 -- # xargs 00:25:45.217 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.217 11:50:05 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:25:45.217 11:50:05 -- host/discovery.sh@79 -- # get_bdev_list 00:25:45.217 11:50:05 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:45.217 11:50:05 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:45.217 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.217 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.217 11:50:05 -- host/discovery.sh@55 -- # sort 00:25:45.217 11:50:05 -- host/discovery.sh@55 -- # xargs 00:25:45.217 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.217 11:50:05 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:25:45.218 11:50:05 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:25:45.218 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.218 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.218 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.218 11:50:05 -- host/discovery.sh@82 -- # get_subsystem_names 00:25:45.218 11:50:05 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:45.218 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.218 11:50:05 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:45.218 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.218 11:50:05 -- host/discovery.sh@59 -- # sort 00:25:45.218 11:50:05 -- host/discovery.sh@59 -- # xargs 00:25:45.218 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.218 11:50:05 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:25:45.218 11:50:05 -- host/discovery.sh@83 -- # get_bdev_list 00:25:45.218 11:50:05 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:45.218 11:50:05 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:45.218 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.218 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.218 11:50:05 -- host/discovery.sh@55 -- # sort 00:25:45.218 11:50:05 -- host/discovery.sh@55 -- # xargs 00:25:45.218 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.478 11:50:05 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:25:45.478 11:50:05 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:25:45.478 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.478 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.478 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.478 11:50:05 -- host/discovery.sh@86 -- # get_subsystem_names 00:25:45.478 11:50:05 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:45.478 11:50:05 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:45.478 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.478 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.478 11:50:05 -- host/discovery.sh@59 -- # sort 00:25:45.478 11:50:05 -- host/discovery.sh@59 -- # xargs 00:25:45.478 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.478 11:50:05 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:25:45.478 11:50:05 -- host/discovery.sh@87 -- # get_bdev_list 00:25:45.478 11:50:05 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:45.478 11:50:05 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:45.478 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.478 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.478 11:50:05 -- host/discovery.sh@55 -- # sort 00:25:45.478 11:50:05 -- host/discovery.sh@55 -- # xargs 00:25:45.478 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.478 11:50:05 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:25:45.478 11:50:05 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:45.478 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.478 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.478 [2024-11-28 11:50:05.366279] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:45.478 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.478 11:50:05 -- host/discovery.sh@92 -- # get_subsystem_names 00:25:45.478 11:50:05 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:45.478 11:50:05 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:45.478 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.478 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.478 11:50:05 -- host/discovery.sh@59 -- # sort 00:25:45.478 11:50:05 -- host/discovery.sh@59 -- # xargs 00:25:45.478 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.478 11:50:05 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:25:45.478 11:50:05 -- host/discovery.sh@93 -- # get_bdev_list 00:25:45.478 11:50:05 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:45.478 11:50:05 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:45.478 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.478 11:50:05 -- host/discovery.sh@55 -- # sort 00:25:45.478 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.478 11:50:05 -- host/discovery.sh@55 -- # xargs 00:25:45.478 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.478 11:50:05 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:25:45.478 11:50:05 -- host/discovery.sh@94 -- # get_notification_count 00:25:45.478 11:50:05 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:25:45.478 11:50:05 -- host/discovery.sh@74 -- # jq '. | length' 00:25:45.478 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.478 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.478 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.478 11:50:05 -- host/discovery.sh@74 -- # notification_count=0 00:25:45.478 11:50:05 -- host/discovery.sh@75 -- # notify_id=0 00:25:45.478 11:50:05 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:25:45.478 11:50:05 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:25:45.478 11:50:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.478 11:50:05 -- common/autotest_common.sh@10 -- # set +x 00:25:45.478 11:50:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.478 11:50:05 -- host/discovery.sh@100 -- # sleep 1 00:25:46.407 [2024-11-28 11:50:06.144778] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:46.407 [2024-11-28 11:50:06.144837] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:46.407 [2024-11-28 11:50:06.144879] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:46.407 [2024-11-28 11:50:06.232130] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:25:46.407 [2024-11-28 11:50:06.455613] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:46.407 [2024-11-28 11:50:06.455637] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:46.664 11:50:06 -- host/discovery.sh@101 -- # get_subsystem_names 00:25:46.664 11:50:06 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:46.664 11:50:06 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:46.664 11:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.664 11:50:06 -- common/autotest_common.sh@10 -- # set +x 00:25:46.664 11:50:06 -- host/discovery.sh@59 -- # sort 00:25:46.664 11:50:06 -- host/discovery.sh@59 -- # xargs 00:25:46.664 11:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.664 11:50:06 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:46.664 11:50:06 -- host/discovery.sh@102 -- # get_bdev_list 00:25:46.664 11:50:06 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:46.664 11:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.664 11:50:06 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:46.664 11:50:06 -- common/autotest_common.sh@10 -- # set +x 00:25:46.664 11:50:06 -- host/discovery.sh@55 -- # sort 00:25:46.664 11:50:06 -- host/discovery.sh@55 -- # xargs 00:25:46.664 11:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.664 11:50:06 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:25:46.664 11:50:06 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:25:46.664 11:50:06 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:46.664 11:50:06 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:46.664 11:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.664 11:50:06 -- common/autotest_common.sh@10 -- # set +x 00:25:46.664 11:50:06 -- host/discovery.sh@63 -- # sort -n 00:25:46.664 11:50:06 -- host/discovery.sh@63 -- # xargs 00:25:46.664 11:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.664 11:50:06 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:25:46.664 11:50:06 -- host/discovery.sh@104 -- # get_notification_count 00:25:46.664 11:50:06 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:25:46.664 11:50:06 -- host/discovery.sh@74 -- # jq '. | length' 00:25:46.664 11:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.664 11:50:06 -- common/autotest_common.sh@10 -- # set +x 00:25:46.664 11:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.664 11:50:06 -- host/discovery.sh@74 -- # notification_count=1 00:25:46.664 11:50:06 -- host/discovery.sh@75 -- # notify_id=1 00:25:46.664 11:50:06 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:25:46.665 11:50:06 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:25:46.665 11:50:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.665 11:50:06 -- common/autotest_common.sh@10 -- # set +x 00:25:46.665 11:50:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.665 11:50:06 -- host/discovery.sh@109 -- # sleep 1 00:25:48.037 11:50:07 -- host/discovery.sh@110 -- # get_bdev_list 00:25:48.037 11:50:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:48.037 11:50:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.037 11:50:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:48.037 11:50:07 -- common/autotest_common.sh@10 -- # set +x 00:25:48.037 11:50:07 -- host/discovery.sh@55 -- # sort 00:25:48.037 11:50:07 -- host/discovery.sh@55 -- # xargs 00:25:48.037 11:50:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.037 11:50:07 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:48.037 11:50:07 -- host/discovery.sh@111 -- # get_notification_count 00:25:48.037 11:50:07 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:25:48.037 11:50:07 -- host/discovery.sh@74 -- # jq '. | length' 00:25:48.037 11:50:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.037 11:50:07 -- common/autotest_common.sh@10 -- # set +x 00:25:48.037 11:50:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.037 11:50:07 -- host/discovery.sh@74 -- # notification_count=1 00:25:48.037 11:50:07 -- host/discovery.sh@75 -- # notify_id=2 00:25:48.037 11:50:07 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:25:48.037 11:50:07 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:25:48.037 11:50:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.037 11:50:07 -- common/autotest_common.sh@10 -- # set +x 00:25:48.037 [2024-11-28 11:50:07.757581] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:48.037 [2024-11-28 11:50:07.757793] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:25:48.037 [2024-11-28 11:50:07.757836] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:48.037 11:50:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.038 11:50:07 -- host/discovery.sh@117 -- # sleep 1 00:25:48.038 [2024-11-28 11:50:07.844062] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:25:48.038 [2024-11-28 11:50:07.941798] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:48.038 [2024-11-28 11:50:07.941819] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:48.038 [2024-11-28 11:50:07.941844] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:48.971 11:50:08 -- host/discovery.sh@118 -- # get_subsystem_names 00:25:48.971 11:50:08 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:48.971 11:50:08 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:48.971 11:50:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.971 11:50:08 -- common/autotest_common.sh@10 -- # set +x 00:25:48.971 11:50:08 -- host/discovery.sh@59 -- # sort 00:25:48.971 11:50:08 -- host/discovery.sh@59 -- # xargs 00:25:48.971 11:50:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.971 11:50:08 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:48.971 11:50:08 -- host/discovery.sh@119 -- # get_bdev_list 00:25:48.971 11:50:08 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:48.971 11:50:08 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:48.971 11:50:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.971 11:50:08 -- common/autotest_common.sh@10 -- # set +x 00:25:48.971 11:50:08 -- host/discovery.sh@55 -- # sort 00:25:48.971 11:50:08 -- host/discovery.sh@55 -- # xargs 00:25:48.971 11:50:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.971 11:50:08 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:48.971 11:50:08 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:25:48.971 11:50:08 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:48.971 11:50:08 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:48.971 11:50:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.971 11:50:08 -- common/autotest_common.sh@10 -- # set +x 00:25:48.971 11:50:08 -- host/discovery.sh@63 -- # sort -n 00:25:48.971 11:50:08 -- host/discovery.sh@63 -- # xargs 00:25:48.971 11:50:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.971 11:50:08 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:25:48.971 11:50:08 -- host/discovery.sh@121 -- # get_notification_count 00:25:48.971 11:50:08 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:48.971 11:50:08 -- host/discovery.sh@74 -- # jq '. | length' 00:25:48.971 11:50:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.971 11:50:08 -- common/autotest_common.sh@10 -- # set +x 00:25:48.971 11:50:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.971 11:50:08 -- host/discovery.sh@74 -- # notification_count=0 00:25:48.972 11:50:08 -- host/discovery.sh@75 -- # notify_id=2 00:25:48.972 11:50:08 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:25:48.972 11:50:08 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:48.972 11:50:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.972 11:50:08 -- common/autotest_common.sh@10 -- # set +x 00:25:48.972 [2024-11-28 11:50:08.933322] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:25:48.972 [2024-11-28 11:50:08.933356] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:48.972 11:50:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.972 11:50:08 -- host/discovery.sh@127 -- # sleep 1 00:25:48.972 [2024-11-28 11:50:08.938966] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.972 [2024-11-28 11:50:08.939000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.972 [2024-11-28 11:50:08.939020] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.972 [2024-11-28 11:50:08.939036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.972 [2024-11-28 11:50:08.939051] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.972 [2024-11-28 11:50:08.939081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.972 [2024-11-28 11:50:08.939097] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.972 [2024-11-28 11:50:08.939110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.972 [2024-11-28 11:50:08.939123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb8b810 is same with the state(5) to be set 00:25:48.972 [2024-11-28 11:50:08.948971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb8b810 (9): Bad file descriptor 00:25:48.972 [2024-11-28 11:50:08.959016] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:48.972 [2024-11-28 11:50:08.959232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.972 [2024-11-28 11:50:08.959374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.972 [2024-11-28 11:50:08.959399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb8b810 with addr=10.0.0.2, port=4420 00:25:48.972 [2024-11-28 11:50:08.959415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb8b810 is same with the state(5) to be set 00:25:48.972 [2024-11-28 11:50:08.959438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb8b810 (9): Bad file descriptor 00:25:48.972 [2024-11-28 11:50:08.959494] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:48.972 [2024-11-28 11:50:08.959515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:48.972 [2024-11-28 11:50:08.959542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:48.972 [2024-11-28 11:50:08.959572] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.972 [2024-11-28 11:50:08.969097] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:48.972 [2024-11-28 11:50:08.969293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.972 [2024-11-28 11:50:08.969419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.972 [2024-11-28 11:50:08.969448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb8b810 with addr=10.0.0.2, port=4420 00:25:48.972 [2024-11-28 11:50:08.969465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb8b810 is same with the state(5) to be set 00:25:48.972 [2024-11-28 11:50:08.969488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb8b810 (9): Bad file descriptor 00:25:48.972 [2024-11-28 11:50:08.969533] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:48.972 [2024-11-28 11:50:08.969578] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:48.972 [2024-11-28 11:50:08.969592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:48.972 [2024-11-28 11:50:08.969611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.972 [2024-11-28 11:50:08.979173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:48.972 [2024-11-28 11:50:08.979377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.972 [2024-11-28 11:50:08.979500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.972 [2024-11-28 11:50:08.979539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb8b810 with addr=10.0.0.2, port=4420 00:25:48.972 [2024-11-28 11:50:08.979574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb8b810 is same with the state(5) to be set 00:25:48.972 [2024-11-28 11:50:08.979597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb8b810 (9): Bad file descriptor 00:25:48.972 [2024-11-28 11:50:08.979644] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:48.972 [2024-11-28 11:50:08.979663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:48.972 [2024-11-28 11:50:08.979676] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:48.972 [2024-11-28 11:50:08.979707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.972 [2024-11-28 11:50:08.989253] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:48.972 [2024-11-28 11:50:08.989440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.972 [2024-11-28 11:50:08.989602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.972 [2024-11-28 11:50:08.989628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb8b810 with addr=10.0.0.2, port=4420 00:25:48.972 [2024-11-28 11:50:08.989644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb8b810 is same with the state(5) to be set 00:25:48.972 [2024-11-28 11:50:08.989666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb8b810 (9): Bad file descriptor 00:25:48.972 [2024-11-28 11:50:08.989698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:48.972 [2024-11-28 11:50:08.989715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:48.972 [2024-11-28 11:50:08.989729] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:48.972 [2024-11-28 11:50:08.989747] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.972 [2024-11-28 11:50:08.999329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:48.972 [2024-11-28 11:50:08.999550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.972 [2024-11-28 11:50:08.999715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.972 [2024-11-28 11:50:08.999741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb8b810 with addr=10.0.0.2, port=4420 00:25:48.972 [2024-11-28 11:50:08.999756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb8b810 is same with the state(5) to be set 00:25:48.972 [2024-11-28 11:50:08.999777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb8b810 (9): Bad file descriptor 00:25:48.972 [2024-11-28 11:50:08.999837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:48.972 [2024-11-28 11:50:08.999858] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:48.972 [2024-11-28 11:50:08.999873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:48.972 [2024-11-28 11:50:08.999894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.972 [2024-11-28 11:50:09.009404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:48.972 [2024-11-28 11:50:09.009613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.972 [2024-11-28 11:50:09.009753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.972 [2024-11-28 11:50:09.009778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb8b810 with addr=10.0.0.2, port=4420 00:25:48.972 [2024-11-28 11:50:09.009793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb8b810 is same with the state(5) to be set 00:25:48.972 [2024-11-28 11:50:09.009815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb8b810 (9): Bad file descriptor 00:25:48.972 [2024-11-28 11:50:09.009834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:48.972 [2024-11-28 11:50:09.009847] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:48.972 [2024-11-28 11:50:09.009860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:48.972 [2024-11-28 11:50:09.009891] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:48.972 [2024-11-28 11:50:09.019481] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:48.972 [2024-11-28 11:50:09.019706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.972 [2024-11-28 11:50:09.019824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:48.972 [2024-11-28 11:50:09.019850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb8b810 with addr=10.0.0.2, port=4420 00:25:48.972 [2024-11-28 11:50:09.019866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb8b810 is same with the state(5) to be set 00:25:48.972 [2024-11-28 11:50:09.019887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb8b810 (9): Bad file descriptor 00:25:48.972 [2024-11-28 11:50:09.019942] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:25:48.972 [2024-11-28 11:50:09.019968] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:48.972 [2024-11-28 11:50:09.019999] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:48.972 [2024-11-28 11:50:09.020019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:48.972 [2024-11-28 11:50:09.020033] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:48.972 [2024-11-28 11:50:09.020073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:49.907 11:50:09 -- host/discovery.sh@128 -- # get_subsystem_names 00:25:49.907 11:50:09 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:49.907 11:50:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.907 11:50:09 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:49.907 11:50:09 -- host/discovery.sh@59 -- # sort 00:25:49.907 11:50:09 -- common/autotest_common.sh@10 -- # set +x 00:25:49.907 11:50:09 -- host/discovery.sh@59 -- # xargs 00:25:49.907 11:50:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.165 11:50:09 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:50.165 11:50:09 -- host/discovery.sh@129 -- # get_bdev_list 00:25:50.165 11:50:09 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:50.165 11:50:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.165 11:50:09 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:50.165 11:50:09 -- common/autotest_common.sh@10 -- # set +x 00:25:50.165 11:50:09 -- host/discovery.sh@55 -- # sort 00:25:50.165 11:50:09 -- host/discovery.sh@55 -- # xargs 00:25:50.165 11:50:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.165 11:50:10 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:50.165 11:50:10 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:25:50.165 11:50:10 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:50.165 11:50:10 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:50.165 11:50:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.165 11:50:10 -- common/autotest_common.sh@10 -- # set +x 00:25:50.165 11:50:10 -- host/discovery.sh@63 -- # sort -n 00:25:50.165 11:50:10 -- host/discovery.sh@63 -- # xargs 00:25:50.165 11:50:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.165 11:50:10 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:25:50.165 11:50:10 -- host/discovery.sh@131 -- # get_notification_count 00:25:50.165 11:50:10 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:50.165 11:50:10 -- host/discovery.sh@74 -- # jq '. | length' 00:25:50.165 11:50:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.165 11:50:10 -- common/autotest_common.sh@10 -- # set +x 00:25:50.165 11:50:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.165 11:50:10 -- host/discovery.sh@74 -- # notification_count=0 00:25:50.165 11:50:10 -- host/discovery.sh@75 -- # notify_id=2 00:25:50.165 11:50:10 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:25:50.165 11:50:10 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:25:50.165 11:50:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.165 11:50:10 -- common/autotest_common.sh@10 -- # set +x 00:25:50.165 11:50:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.165 11:50:10 -- host/discovery.sh@135 -- # sleep 1 00:25:51.097 11:50:11 -- host/discovery.sh@136 -- # get_subsystem_names 00:25:51.097 11:50:11 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:51.097 11:50:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.097 11:50:11 -- common/autotest_common.sh@10 -- # set +x 00:25:51.097 11:50:11 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:51.097 11:50:11 -- host/discovery.sh@59 -- # sort 00:25:51.097 11:50:11 -- host/discovery.sh@59 -- # xargs 00:25:51.097 11:50:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.355 11:50:11 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:25:51.355 11:50:11 -- host/discovery.sh@137 -- # get_bdev_list 00:25:51.355 11:50:11 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:51.355 11:50:11 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:51.355 11:50:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.355 11:50:11 -- common/autotest_common.sh@10 -- # set +x 00:25:51.355 11:50:11 -- host/discovery.sh@55 -- # sort 00:25:51.355 11:50:11 -- host/discovery.sh@55 -- # xargs 00:25:51.355 11:50:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.355 11:50:11 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:25:51.355 11:50:11 -- host/discovery.sh@138 -- # get_notification_count 00:25:51.355 11:50:11 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:51.355 11:50:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.355 11:50:11 -- host/discovery.sh@74 -- # jq '. | length' 00:25:51.355 11:50:11 -- common/autotest_common.sh@10 -- # set +x 00:25:51.355 11:50:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.355 11:50:11 -- host/discovery.sh@74 -- # notification_count=2 00:25:51.355 11:50:11 -- host/discovery.sh@75 -- # notify_id=4 00:25:51.355 11:50:11 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:25:51.355 11:50:11 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:51.355 11:50:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.355 11:50:11 -- common/autotest_common.sh@10 -- # set +x 00:25:52.289 [2024-11-28 11:50:12.301703] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:52.289 [2024-11-28 11:50:12.301728] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:52.289 [2024-11-28 11:50:12.301750] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:52.548 [2024-11-28 11:50:12.389076] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:25:52.548 [2024-11-28 11:50:12.454292] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:52.548 [2024-11-28 11:50:12.454331] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:52.548 11:50:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.548 11:50:12 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:52.548 11:50:12 -- common/autotest_common.sh@650 -- # local es=0 00:25:52.548 11:50:12 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:52.548 11:50:12 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:52.548 11:50:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:52.548 11:50:12 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:52.548 11:50:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:52.548 11:50:12 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:52.548 11:50:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.548 11:50:12 -- common/autotest_common.sh@10 -- # set +x 00:25:52.548 request: 00:25:52.548 { 00:25:52.548 "name": "nvme", 00:25:52.548 "trtype": "tcp", 00:25:52.548 "traddr": "10.0.0.2", 00:25:52.548 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:52.548 "adrfam": "ipv4", 00:25:52.548 "trsvcid": "8009", 00:25:52.548 "wait_for_attach": true, 00:25:52.548 "method": "bdev_nvme_start_discovery", 00:25:52.548 "req_id": 1 00:25:52.548 } 00:25:52.548 Got JSON-RPC error response 00:25:52.548 response: 00:25:52.548 { 00:25:52.548 "code": -17, 00:25:52.548 "message": "File exists" 00:25:52.548 } 00:25:52.548 11:50:12 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:52.548 11:50:12 -- common/autotest_common.sh@653 -- # es=1 00:25:52.548 11:50:12 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:52.548 11:50:12 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:52.548 11:50:12 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:52.548 11:50:12 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:25:52.548 11:50:12 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:52.548 11:50:12 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:52.548 11:50:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.548 11:50:12 -- host/discovery.sh@67 -- # sort 00:25:52.548 11:50:12 -- common/autotest_common.sh@10 -- # set +x 00:25:52.548 11:50:12 -- host/discovery.sh@67 -- # xargs 00:25:52.548 11:50:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.548 11:50:12 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:25:52.548 11:50:12 -- host/discovery.sh@147 -- # get_bdev_list 00:25:52.548 11:50:12 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:52.548 11:50:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.548 11:50:12 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:52.548 11:50:12 -- common/autotest_common.sh@10 -- # set +x 00:25:52.548 11:50:12 -- host/discovery.sh@55 -- # sort 00:25:52.548 11:50:12 -- host/discovery.sh@55 -- # xargs 00:25:52.548 11:50:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.548 11:50:12 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:52.548 11:50:12 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:52.548 11:50:12 -- common/autotest_common.sh@650 -- # local es=0 00:25:52.548 11:50:12 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:52.548 11:50:12 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:52.548 11:50:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:52.548 11:50:12 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:52.548 11:50:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:52.548 11:50:12 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:52.548 11:50:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.548 11:50:12 -- common/autotest_common.sh@10 -- # set +x 00:25:52.548 request: 00:25:52.548 { 00:25:52.548 "name": "nvme_second", 00:25:52.548 "trtype": "tcp", 00:25:52.548 "traddr": "10.0.0.2", 00:25:52.548 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:52.548 "adrfam": "ipv4", 00:25:52.548 "trsvcid": "8009", 00:25:52.548 "wait_for_attach": true, 00:25:52.548 "method": "bdev_nvme_start_discovery", 00:25:52.548 "req_id": 1 00:25:52.548 } 00:25:52.548 Got JSON-RPC error response 00:25:52.548 response: 00:25:52.548 { 00:25:52.548 "code": -17, 00:25:52.548 "message": "File exists" 00:25:52.548 } 00:25:52.548 11:50:12 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:52.548 11:50:12 -- common/autotest_common.sh@653 -- # es=1 00:25:52.548 11:50:12 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:52.548 11:50:12 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:52.548 11:50:12 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:52.548 11:50:12 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:25:52.548 11:50:12 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:52.549 11:50:12 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:52.549 11:50:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.549 11:50:12 -- host/discovery.sh@67 -- # sort 00:25:52.549 11:50:12 -- common/autotest_common.sh@10 -- # set +x 00:25:52.549 11:50:12 -- host/discovery.sh@67 -- # xargs 00:25:52.549 11:50:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.807 11:50:12 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:25:52.807 11:50:12 -- host/discovery.sh@153 -- # get_bdev_list 00:25:52.807 11:50:12 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:52.807 11:50:12 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:52.807 11:50:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.807 11:50:12 -- common/autotest_common.sh@10 -- # set +x 00:25:52.807 11:50:12 -- host/discovery.sh@55 -- # sort 00:25:52.807 11:50:12 -- host/discovery.sh@55 -- # xargs 00:25:52.807 11:50:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.807 11:50:12 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:52.807 11:50:12 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:52.807 11:50:12 -- common/autotest_common.sh@650 -- # local es=0 00:25:52.807 11:50:12 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:52.807 11:50:12 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:52.807 11:50:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:52.807 11:50:12 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:52.807 11:50:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:52.807 11:50:12 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:52.807 11:50:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.807 11:50:12 -- common/autotest_common.sh@10 -- # set +x 00:25:53.742 [2024-11-28 11:50:13.669855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.742 [2024-11-28 11:50:13.670054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:53.742 [2024-11-28 11:50:13.670084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbaf3d0 with addr=10.0.0.2, port=8010 00:25:53.742 [2024-11-28 11:50:13.670119] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:25:53.742 [2024-11-28 11:50:13.670136] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:53.742 [2024-11-28 11:50:13.670150] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:25:54.677 [2024-11-28 11:50:14.672243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.677 [2024-11-28 11:50:14.672381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.677 [2024-11-28 11:50:14.672424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb7bd30 with addr=10.0.0.2, port=8010 00:25:54.677 [2024-11-28 11:50:14.672445] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:25:54.677 [2024-11-28 11:50:14.672459] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:54.677 [2024-11-28 11:50:14.672471] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:25:56.049 [2024-11-28 11:50:15.674454] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:25:56.049 request: 00:25:56.049 { 00:25:56.049 "name": "nvme_second", 00:25:56.049 "trtype": "tcp", 00:25:56.049 "traddr": "10.0.0.2", 00:25:56.049 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:56.049 "adrfam": "ipv4", 00:25:56.049 "trsvcid": "8010", 00:25:56.049 "attach_timeout_ms": 3000, 00:25:56.049 "method": "bdev_nvme_start_discovery", 00:25:56.049 "req_id": 1 00:25:56.049 } 00:25:56.049 Got JSON-RPC error response 00:25:56.049 response: 00:25:56.049 { 00:25:56.049 "code": -110, 00:25:56.049 "message": "Connection timed out" 00:25:56.049 } 00:25:56.049 11:50:15 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:56.049 11:50:15 -- common/autotest_common.sh@653 -- # es=1 00:25:56.049 11:50:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:56.049 11:50:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:56.049 11:50:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:56.049 11:50:15 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:25:56.049 11:50:15 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:56.049 11:50:15 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:56.049 11:50:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.049 11:50:15 -- common/autotest_common.sh@10 -- # set +x 00:25:56.049 11:50:15 -- host/discovery.sh@67 -- # sort 00:25:56.049 11:50:15 -- host/discovery.sh@67 -- # xargs 00:25:56.049 11:50:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.049 11:50:15 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:25:56.049 11:50:15 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:25:56.049 11:50:15 -- host/discovery.sh@162 -- # kill 3911836 00:25:56.049 11:50:15 -- host/discovery.sh@163 -- # nvmftestfini 00:25:56.049 11:50:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:56.049 11:50:15 -- nvmf/common.sh@116 -- # sync 00:25:56.049 11:50:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:56.049 11:50:15 -- nvmf/common.sh@119 -- # set +e 00:25:56.049 11:50:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:56.049 11:50:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:56.049 rmmod nvme_tcp 00:25:56.049 rmmod nvme_fabrics 00:25:56.049 rmmod nvme_keyring 00:25:56.049 11:50:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:56.049 11:50:15 -- nvmf/common.sh@123 -- # set -e 00:25:56.049 11:50:15 -- nvmf/common.sh@124 -- # return 0 00:25:56.049 11:50:15 -- nvmf/common.sh@477 -- # '[' -n 3911675 ']' 00:25:56.049 11:50:15 -- nvmf/common.sh@478 -- # killprocess 3911675 00:25:56.049 11:50:15 -- common/autotest_common.sh@936 -- # '[' -z 3911675 ']' 00:25:56.049 11:50:15 -- common/autotest_common.sh@940 -- # kill -0 3911675 00:25:56.049 11:50:15 -- common/autotest_common.sh@941 -- # uname 00:25:56.049 11:50:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:56.049 11:50:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3911675 00:25:56.049 11:50:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:56.049 11:50:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:56.049 11:50:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3911675' 00:25:56.049 killing process with pid 3911675 00:25:56.049 11:50:15 -- common/autotest_common.sh@955 -- # kill 3911675 00:25:56.049 11:50:15 -- common/autotest_common.sh@960 -- # wait 3911675 00:25:56.311 11:50:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:56.311 11:50:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:56.311 11:50:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:56.311 11:50:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:56.311 11:50:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:56.311 11:50:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:56.311 11:50:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:56.311 11:50:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:58.216 11:50:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:58.216 00:25:58.216 real 0m17.466s 00:25:58.216 user 0m26.975s 00:25:58.216 sys 0m2.871s 00:25:58.216 11:50:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:58.216 11:50:18 -- common/autotest_common.sh@10 -- # set +x 00:25:58.216 ************************************ 00:25:58.216 END TEST nvmf_discovery 00:25:58.216 ************************************ 00:25:58.216 11:50:18 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:25:58.216 11:50:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:58.216 11:50:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:58.216 11:50:18 -- common/autotest_common.sh@10 -- # set +x 00:25:58.216 ************************************ 00:25:58.216 START TEST nvmf_discovery_remove_ifc 00:25:58.216 ************************************ 00:25:58.216 11:50:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:25:58.216 * Looking for test storage... 00:25:58.216 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:58.216 11:50:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:58.216 11:50:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:58.216 11:50:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:58.475 11:50:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:58.475 11:50:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:58.475 11:50:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:58.475 11:50:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:58.475 11:50:18 -- scripts/common.sh@335 -- # IFS=.-: 00:25:58.475 11:50:18 -- scripts/common.sh@335 -- # read -ra ver1 00:25:58.475 11:50:18 -- scripts/common.sh@336 -- # IFS=.-: 00:25:58.475 11:50:18 -- scripts/common.sh@336 -- # read -ra ver2 00:25:58.475 11:50:18 -- scripts/common.sh@337 -- # local 'op=<' 00:25:58.475 11:50:18 -- scripts/common.sh@339 -- # ver1_l=2 00:25:58.475 11:50:18 -- scripts/common.sh@340 -- # ver2_l=1 00:25:58.475 11:50:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:58.475 11:50:18 -- scripts/common.sh@343 -- # case "$op" in 00:25:58.475 11:50:18 -- scripts/common.sh@344 -- # : 1 00:25:58.475 11:50:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:58.475 11:50:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:58.475 11:50:18 -- scripts/common.sh@364 -- # decimal 1 00:25:58.475 11:50:18 -- scripts/common.sh@352 -- # local d=1 00:25:58.475 11:50:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:58.475 11:50:18 -- scripts/common.sh@354 -- # echo 1 00:25:58.475 11:50:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:58.475 11:50:18 -- scripts/common.sh@365 -- # decimal 2 00:25:58.475 11:50:18 -- scripts/common.sh@352 -- # local d=2 00:25:58.475 11:50:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:58.475 11:50:18 -- scripts/common.sh@354 -- # echo 2 00:25:58.475 11:50:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:58.475 11:50:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:58.475 11:50:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:58.475 11:50:18 -- scripts/common.sh@367 -- # return 0 00:25:58.475 11:50:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:58.475 11:50:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:58.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:58.475 --rc genhtml_branch_coverage=1 00:25:58.475 --rc genhtml_function_coverage=1 00:25:58.475 --rc genhtml_legend=1 00:25:58.475 --rc geninfo_all_blocks=1 00:25:58.475 --rc geninfo_unexecuted_blocks=1 00:25:58.475 00:25:58.475 ' 00:25:58.475 11:50:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:58.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:58.475 --rc genhtml_branch_coverage=1 00:25:58.475 --rc genhtml_function_coverage=1 00:25:58.475 --rc genhtml_legend=1 00:25:58.475 --rc geninfo_all_blocks=1 00:25:58.475 --rc geninfo_unexecuted_blocks=1 00:25:58.475 00:25:58.475 ' 00:25:58.475 11:50:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:58.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:58.475 --rc genhtml_branch_coverage=1 00:25:58.475 --rc genhtml_function_coverage=1 00:25:58.475 --rc genhtml_legend=1 00:25:58.475 --rc geninfo_all_blocks=1 00:25:58.475 --rc geninfo_unexecuted_blocks=1 00:25:58.475 00:25:58.475 ' 00:25:58.475 11:50:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:58.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:58.475 --rc genhtml_branch_coverage=1 00:25:58.475 --rc genhtml_function_coverage=1 00:25:58.475 --rc genhtml_legend=1 00:25:58.475 --rc geninfo_all_blocks=1 00:25:58.475 --rc geninfo_unexecuted_blocks=1 00:25:58.475 00:25:58.475 ' 00:25:58.475 11:50:18 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:58.475 11:50:18 -- nvmf/common.sh@7 -- # uname -s 00:25:58.475 11:50:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:58.475 11:50:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:58.475 11:50:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:58.475 11:50:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:58.475 11:50:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:58.475 11:50:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:58.475 11:50:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:58.475 11:50:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:58.475 11:50:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:58.475 11:50:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:58.475 11:50:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:58.475 11:50:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:58.475 11:50:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:58.475 11:50:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:58.475 11:50:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:58.475 11:50:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:58.475 11:50:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:58.475 11:50:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:58.475 11:50:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:58.476 11:50:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:58.476 11:50:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:58.476 11:50:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:58.476 11:50:18 -- paths/export.sh@5 -- # export PATH 00:25:58.476 11:50:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:58.476 11:50:18 -- nvmf/common.sh@46 -- # : 0 00:25:58.476 11:50:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:58.476 11:50:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:58.476 11:50:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:58.476 11:50:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:58.476 11:50:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:58.476 11:50:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:58.476 11:50:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:58.476 11:50:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:58.476 11:50:18 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:25:58.476 11:50:18 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:25:58.476 11:50:18 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:25:58.476 11:50:18 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:25:58.476 11:50:18 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:25:58.476 11:50:18 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:25:58.476 11:50:18 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:25:58.476 11:50:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:58.476 11:50:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:58.476 11:50:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:58.476 11:50:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:58.476 11:50:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:58.476 11:50:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:58.476 11:50:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:58.476 11:50:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:58.476 11:50:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:58.476 11:50:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:58.476 11:50:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:58.476 11:50:18 -- common/autotest_common.sh@10 -- # set +x 00:26:01.009 11:50:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:01.009 11:50:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:01.009 11:50:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:01.009 11:50:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:01.009 11:50:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:01.009 11:50:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:01.009 11:50:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:01.009 11:50:20 -- nvmf/common.sh@294 -- # net_devs=() 00:26:01.009 11:50:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:01.009 11:50:20 -- nvmf/common.sh@295 -- # e810=() 00:26:01.009 11:50:20 -- nvmf/common.sh@295 -- # local -ga e810 00:26:01.009 11:50:20 -- nvmf/common.sh@296 -- # x722=() 00:26:01.009 11:50:20 -- nvmf/common.sh@296 -- # local -ga x722 00:26:01.009 11:50:20 -- nvmf/common.sh@297 -- # mlx=() 00:26:01.009 11:50:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:01.009 11:50:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:01.009 11:50:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:01.009 11:50:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:01.009 11:50:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:01.009 11:50:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:01.009 11:50:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:01.009 11:50:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:01.009 11:50:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:01.009 11:50:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:01.009 11:50:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:01.009 11:50:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:01.009 11:50:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:01.009 11:50:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:01.009 11:50:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:01.009 11:50:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:01.009 11:50:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:01.009 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:01.009 11:50:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:01.009 11:50:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:01.009 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:01.009 11:50:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:01.009 11:50:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:01.009 11:50:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:01.009 11:50:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:01.009 11:50:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:01.009 11:50:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:01.009 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:01.009 11:50:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:01.009 11:50:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:01.009 11:50:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:01.009 11:50:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:01.009 11:50:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:01.009 11:50:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:01.009 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:01.009 11:50:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:01.009 11:50:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:01.009 11:50:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:01.009 11:50:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:01.009 11:50:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:01.009 11:50:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:01.009 11:50:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:01.009 11:50:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:01.009 11:50:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:01.009 11:50:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:01.009 11:50:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:01.009 11:50:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:01.009 11:50:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:01.009 11:50:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:01.009 11:50:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:01.009 11:50:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:01.009 11:50:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:01.009 11:50:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:01.009 11:50:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:01.009 11:50:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:01.009 11:50:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:01.009 11:50:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:01.009 11:50:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:01.009 11:50:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:01.009 11:50:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:01.009 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:01.009 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.302 ms 00:26:01.009 00:26:01.009 --- 10.0.0.2 ping statistics --- 00:26:01.009 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:01.009 rtt min/avg/max/mdev = 0.302/0.302/0.302/0.000 ms 00:26:01.009 11:50:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:01.010 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:01.010 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:26:01.010 00:26:01.010 --- 10.0.0.1 ping statistics --- 00:26:01.010 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:01.010 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:26:01.010 11:50:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:01.010 11:50:20 -- nvmf/common.sh@410 -- # return 0 00:26:01.010 11:50:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:01.010 11:50:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:01.010 11:50:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:01.010 11:50:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:01.010 11:50:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:01.010 11:50:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:01.010 11:50:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:01.010 11:50:20 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:01.010 11:50:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:01.010 11:50:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:01.010 11:50:20 -- common/autotest_common.sh@10 -- # set +x 00:26:01.010 11:50:20 -- nvmf/common.sh@469 -- # nvmfpid=3915314 00:26:01.010 11:50:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:01.010 11:50:20 -- nvmf/common.sh@470 -- # waitforlisten 3915314 00:26:01.010 11:50:20 -- common/autotest_common.sh@829 -- # '[' -z 3915314 ']' 00:26:01.010 11:50:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:01.010 11:50:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:01.010 11:50:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:01.010 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:01.010 11:50:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:01.010 11:50:20 -- common/autotest_common.sh@10 -- # set +x 00:26:01.010 [2024-11-28 11:50:20.677960] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:01.010 [2024-11-28 11:50:20.678027] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:01.010 EAL: No free 2048 kB hugepages reported on node 1 00:26:01.010 [2024-11-28 11:50:20.743136] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:01.010 [2024-11-28 11:50:20.848151] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:01.010 [2024-11-28 11:50:20.848303] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:01.010 [2024-11-28 11:50:20.848319] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:01.010 [2024-11-28 11:50:20.848341] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:01.010 [2024-11-28 11:50:20.848383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:01.943 11:50:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:01.943 11:50:21 -- common/autotest_common.sh@862 -- # return 0 00:26:01.943 11:50:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:01.943 11:50:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:01.943 11:50:21 -- common/autotest_common.sh@10 -- # set +x 00:26:01.943 11:50:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:01.943 11:50:21 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:01.943 11:50:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.943 11:50:21 -- common/autotest_common.sh@10 -- # set +x 00:26:01.943 [2024-11-28 11:50:21.683717] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:01.944 [2024-11-28 11:50:21.691919] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:01.944 null0 00:26:01.944 [2024-11-28 11:50:21.723856] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:01.944 11:50:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.944 11:50:21 -- host/discovery_remove_ifc.sh@59 -- # hostpid=3915468 00:26:01.944 11:50:21 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:01.944 11:50:21 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 3915468 /tmp/host.sock 00:26:01.944 11:50:21 -- common/autotest_common.sh@829 -- # '[' -z 3915468 ']' 00:26:01.944 11:50:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:01.944 11:50:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:01.944 11:50:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:01.944 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:01.944 11:50:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:01.944 11:50:21 -- common/autotest_common.sh@10 -- # set +x 00:26:01.944 [2024-11-28 11:50:21.784223] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:01.944 [2024-11-28 11:50:21.784298] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3915468 ] 00:26:01.944 EAL: No free 2048 kB hugepages reported on node 1 00:26:01.944 [2024-11-28 11:50:21.845745] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:01.944 [2024-11-28 11:50:21.960395] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:01.944 [2024-11-28 11:50:21.960595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:02.202 11:50:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:02.202 11:50:22 -- common/autotest_common.sh@862 -- # return 0 00:26:02.202 11:50:22 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:02.202 11:50:22 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:02.202 11:50:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.202 11:50:22 -- common/autotest_common.sh@10 -- # set +x 00:26:02.203 11:50:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.203 11:50:22 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:02.203 11:50:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.203 11:50:22 -- common/autotest_common.sh@10 -- # set +x 00:26:02.203 11:50:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.203 11:50:22 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:02.203 11:50:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.203 11:50:22 -- common/autotest_common.sh@10 -- # set +x 00:26:03.577 [2024-11-28 11:50:23.212266] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:03.577 [2024-11-28 11:50:23.212321] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:03.577 [2024-11-28 11:50:23.212349] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:03.577 [2024-11-28 11:50:23.340727] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:03.577 [2024-11-28 11:50:23.443539] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:03.577 [2024-11-28 11:50:23.443609] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:03.577 [2024-11-28 11:50:23.443648] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:03.577 [2024-11-28 11:50:23.443669] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:03.577 [2024-11-28 11:50:23.443704] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:03.577 11:50:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:03.577 11:50:23 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:03.577 11:50:23 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:03.577 11:50:23 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:03.577 11:50:23 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:03.577 11:50:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:03.577 11:50:23 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:03.577 11:50:23 -- common/autotest_common.sh@10 -- # set +x 00:26:03.577 11:50:23 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:03.577 11:50:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:03.578 11:50:23 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:03.578 11:50:23 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:03.578 [2024-11-28 11:50:23.490169] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x874d40 was disconnected and freed. delete nvme_qpair. 00:26:03.578 11:50:23 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:03.578 11:50:23 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:03.578 11:50:23 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:03.578 11:50:23 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:03.578 11:50:23 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:03.578 11:50:23 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:03.578 11:50:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:03.578 11:50:23 -- common/autotest_common.sh@10 -- # set +x 00:26:03.578 11:50:23 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:03.578 11:50:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:03.578 11:50:23 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:03.578 11:50:23 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:04.951 11:50:24 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:04.951 11:50:24 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:04.951 11:50:24 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:04.951 11:50:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.951 11:50:24 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:04.951 11:50:24 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:04.951 11:50:24 -- common/autotest_common.sh@10 -- # set +x 00:26:04.951 11:50:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.951 11:50:24 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:04.951 11:50:24 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:05.882 11:50:25 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:05.882 11:50:25 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:05.882 11:50:25 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:05.882 11:50:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.882 11:50:25 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:05.882 11:50:25 -- common/autotest_common.sh@10 -- # set +x 00:26:05.882 11:50:25 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:05.882 11:50:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.882 11:50:25 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:05.882 11:50:25 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:06.814 11:50:26 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:06.815 11:50:26 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:06.815 11:50:26 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:06.815 11:50:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.815 11:50:26 -- common/autotest_common.sh@10 -- # set +x 00:26:06.815 11:50:26 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:06.815 11:50:26 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:06.815 11:50:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.815 11:50:26 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:06.815 11:50:26 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:07.750 11:50:27 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:07.750 11:50:27 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.750 11:50:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.750 11:50:27 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:07.750 11:50:27 -- common/autotest_common.sh@10 -- # set +x 00:26:07.750 11:50:27 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:07.750 11:50:27 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:07.750 11:50:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.750 11:50:27 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:07.750 11:50:27 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:09.124 11:50:28 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:09.124 11:50:28 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:09.124 11:50:28 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:09.124 11:50:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.124 11:50:28 -- common/autotest_common.sh@10 -- # set +x 00:26:09.124 11:50:28 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:09.124 11:50:28 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:09.124 11:50:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.124 11:50:28 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:09.124 11:50:28 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:09.124 [2024-11-28 11:50:28.884378] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:09.124 [2024-11-28 11:50:28.884445] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.124 [2024-11-28 11:50:28.884470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.124 [2024-11-28 11:50:28.884490] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.124 [2024-11-28 11:50:28.884506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.124 [2024-11-28 11:50:28.884521] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.124 [2024-11-28 11:50:28.884546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.124 [2024-11-28 11:50:28.884584] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.124 [2024-11-28 11:50:28.884597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.124 [2024-11-28 11:50:28.884611] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.124 [2024-11-28 11:50:28.884623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.124 [2024-11-28 11:50:28.884636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x83b430 is same with the state(5) to be set 00:26:09.124 [2024-11-28 11:50:28.894399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x83b430 (9): Bad file descriptor 00:26:09.124 [2024-11-28 11:50:28.904448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:10.057 11:50:29 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:10.057 11:50:29 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:10.057 11:50:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.057 11:50:29 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:10.057 11:50:29 -- common/autotest_common.sh@10 -- # set +x 00:26:10.057 11:50:29 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:10.057 11:50:29 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:10.057 [2024-11-28 11:50:29.908560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:11.095 [2024-11-28 11:50:30.932572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:11.095 [2024-11-28 11:50:30.932646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x83b430 with addr=10.0.0.2, port=4420 00:26:11.095 [2024-11-28 11:50:30.932678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x83b430 is same with the state(5) to be set 00:26:11.095 [2024-11-28 11:50:30.932719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:11.095 [2024-11-28 11:50:30.932738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:11.095 [2024-11-28 11:50:30.932754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:11.095 [2024-11-28 11:50:30.932771] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:11.095 [2024-11-28 11:50:30.933237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x83b430 (9): Bad file descriptor 00:26:11.095 [2024-11-28 11:50:30.933283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:11.095 [2024-11-28 11:50:30.933324] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:11.095 [2024-11-28 11:50:30.933367] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.095 [2024-11-28 11:50:30.933394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.095 [2024-11-28 11:50:30.933416] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.095 [2024-11-28 11:50:30.933431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.095 [2024-11-28 11:50:30.933445] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.095 [2024-11-28 11:50:30.933460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.096 [2024-11-28 11:50:30.933475] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.096 [2024-11-28 11:50:30.933489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.096 [2024-11-28 11:50:30.933505] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.096 [2024-11-28 11:50:30.933520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.096 [2024-11-28 11:50:30.933553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:11.096 [2024-11-28 11:50:30.933717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x83b840 (9): Bad file descriptor 00:26:11.096 [2024-11-28 11:50:30.934740] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:11.096 [2024-11-28 11:50:30.934761] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:11.096 11:50:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.096 11:50:30 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:11.096 11:50:30 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:12.030 11:50:31 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:12.030 11:50:31 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:12.030 11:50:31 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:12.030 11:50:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.030 11:50:31 -- common/autotest_common.sh@10 -- # set +x 00:26:12.030 11:50:31 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:12.030 11:50:31 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:12.030 11:50:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.030 11:50:31 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:12.030 11:50:31 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:12.030 11:50:31 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:12.030 11:50:32 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:12.030 11:50:32 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:12.030 11:50:32 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:12.030 11:50:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.030 11:50:32 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:12.030 11:50:32 -- common/autotest_common.sh@10 -- # set +x 00:26:12.030 11:50:32 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:12.030 11:50:32 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:12.030 11:50:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.030 11:50:32 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:12.030 11:50:32 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:12.963 [2024-11-28 11:50:32.947600] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:12.964 [2024-11-28 11:50:32.947624] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:12.964 [2024-11-28 11:50:32.947647] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:13.222 11:50:33 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:13.222 11:50:33 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:13.222 11:50:33 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:13.222 11:50:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.222 11:50:33 -- common/autotest_common.sh@10 -- # set +x 00:26:13.222 11:50:33 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:13.222 11:50:33 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:13.222 [2024-11-28 11:50:33.074100] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:13.222 11:50:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.222 11:50:33 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:13.222 11:50:33 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:13.222 [2024-11-28 11:50:33.258339] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:13.222 [2024-11-28 11:50:33.258390] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:13.222 [2024-11-28 11:50:33.258428] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:13.222 [2024-11-28 11:50:33.258453] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:13.222 [2024-11-28 11:50:33.258466] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:13.222 [2024-11-28 11:50:33.266332] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x84a480 was disconnected and freed. delete nvme_qpair. 00:26:14.156 11:50:34 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:14.156 11:50:34 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:14.156 11:50:34 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:14.156 11:50:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.156 11:50:34 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:14.156 11:50:34 -- common/autotest_common.sh@10 -- # set +x 00:26:14.156 11:50:34 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:14.156 11:50:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.156 11:50:34 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:14.156 11:50:34 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:14.156 11:50:34 -- host/discovery_remove_ifc.sh@90 -- # killprocess 3915468 00:26:14.156 11:50:34 -- common/autotest_common.sh@936 -- # '[' -z 3915468 ']' 00:26:14.156 11:50:34 -- common/autotest_common.sh@940 -- # kill -0 3915468 00:26:14.156 11:50:34 -- common/autotest_common.sh@941 -- # uname 00:26:14.156 11:50:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:14.156 11:50:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3915468 00:26:14.156 11:50:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:14.156 11:50:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:14.156 11:50:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3915468' 00:26:14.156 killing process with pid 3915468 00:26:14.156 11:50:34 -- common/autotest_common.sh@955 -- # kill 3915468 00:26:14.156 11:50:34 -- common/autotest_common.sh@960 -- # wait 3915468 00:26:14.414 11:50:34 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:14.414 11:50:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:14.414 11:50:34 -- nvmf/common.sh@116 -- # sync 00:26:14.414 11:50:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:14.414 11:50:34 -- nvmf/common.sh@119 -- # set +e 00:26:14.414 11:50:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:14.414 11:50:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:14.414 rmmod nvme_tcp 00:26:14.672 rmmod nvme_fabrics 00:26:14.672 rmmod nvme_keyring 00:26:14.672 11:50:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:14.672 11:50:34 -- nvmf/common.sh@123 -- # set -e 00:26:14.672 11:50:34 -- nvmf/common.sh@124 -- # return 0 00:26:14.672 11:50:34 -- nvmf/common.sh@477 -- # '[' -n 3915314 ']' 00:26:14.672 11:50:34 -- nvmf/common.sh@478 -- # killprocess 3915314 00:26:14.672 11:50:34 -- common/autotest_common.sh@936 -- # '[' -z 3915314 ']' 00:26:14.672 11:50:34 -- common/autotest_common.sh@940 -- # kill -0 3915314 00:26:14.672 11:50:34 -- common/autotest_common.sh@941 -- # uname 00:26:14.672 11:50:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:14.672 11:50:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3915314 00:26:14.672 11:50:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:14.672 11:50:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:14.672 11:50:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3915314' 00:26:14.672 killing process with pid 3915314 00:26:14.672 11:50:34 -- common/autotest_common.sh@955 -- # kill 3915314 00:26:14.672 11:50:34 -- common/autotest_common.sh@960 -- # wait 3915314 00:26:14.931 11:50:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:14.931 11:50:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:14.931 11:50:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:14.931 11:50:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:14.931 11:50:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:14.931 11:50:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:14.931 11:50:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:14.931 11:50:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:16.836 11:50:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:16.836 00:26:16.836 real 0m18.675s 00:26:16.836 user 0m25.932s 00:26:16.836 sys 0m2.982s 00:26:16.836 11:50:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:16.836 11:50:36 -- common/autotest_common.sh@10 -- # set +x 00:26:16.836 ************************************ 00:26:16.836 END TEST nvmf_discovery_remove_ifc 00:26:16.836 ************************************ 00:26:17.095 11:50:36 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:17.095 11:50:36 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:17.095 11:50:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:17.095 11:50:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:17.095 11:50:36 -- common/autotest_common.sh@10 -- # set +x 00:26:17.095 ************************************ 00:26:17.095 START TEST nvmf_digest 00:26:17.095 ************************************ 00:26:17.095 11:50:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:17.095 * Looking for test storage... 00:26:17.095 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:17.095 11:50:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:17.095 11:50:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:17.095 11:50:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:17.095 11:50:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:17.095 11:50:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:17.095 11:50:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:17.095 11:50:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:17.095 11:50:37 -- scripts/common.sh@335 -- # IFS=.-: 00:26:17.095 11:50:37 -- scripts/common.sh@335 -- # read -ra ver1 00:26:17.095 11:50:37 -- scripts/common.sh@336 -- # IFS=.-: 00:26:17.095 11:50:37 -- scripts/common.sh@336 -- # read -ra ver2 00:26:17.095 11:50:37 -- scripts/common.sh@337 -- # local 'op=<' 00:26:17.095 11:50:37 -- scripts/common.sh@339 -- # ver1_l=2 00:26:17.095 11:50:37 -- scripts/common.sh@340 -- # ver2_l=1 00:26:17.095 11:50:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:17.095 11:50:37 -- scripts/common.sh@343 -- # case "$op" in 00:26:17.095 11:50:37 -- scripts/common.sh@344 -- # : 1 00:26:17.095 11:50:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:17.095 11:50:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:17.095 11:50:37 -- scripts/common.sh@364 -- # decimal 1 00:26:17.095 11:50:37 -- scripts/common.sh@352 -- # local d=1 00:26:17.095 11:50:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:17.095 11:50:37 -- scripts/common.sh@354 -- # echo 1 00:26:17.095 11:50:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:17.095 11:50:37 -- scripts/common.sh@365 -- # decimal 2 00:26:17.095 11:50:37 -- scripts/common.sh@352 -- # local d=2 00:26:17.095 11:50:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:17.095 11:50:37 -- scripts/common.sh@354 -- # echo 2 00:26:17.095 11:50:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:17.095 11:50:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:17.095 11:50:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:17.095 11:50:37 -- scripts/common.sh@367 -- # return 0 00:26:17.095 11:50:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:17.095 11:50:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:17.095 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:17.095 --rc genhtml_branch_coverage=1 00:26:17.095 --rc genhtml_function_coverage=1 00:26:17.095 --rc genhtml_legend=1 00:26:17.095 --rc geninfo_all_blocks=1 00:26:17.095 --rc geninfo_unexecuted_blocks=1 00:26:17.095 00:26:17.095 ' 00:26:17.095 11:50:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:17.095 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:17.095 --rc genhtml_branch_coverage=1 00:26:17.095 --rc genhtml_function_coverage=1 00:26:17.095 --rc genhtml_legend=1 00:26:17.095 --rc geninfo_all_blocks=1 00:26:17.095 --rc geninfo_unexecuted_blocks=1 00:26:17.095 00:26:17.095 ' 00:26:17.095 11:50:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:17.095 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:17.095 --rc genhtml_branch_coverage=1 00:26:17.095 --rc genhtml_function_coverage=1 00:26:17.095 --rc genhtml_legend=1 00:26:17.095 --rc geninfo_all_blocks=1 00:26:17.095 --rc geninfo_unexecuted_blocks=1 00:26:17.095 00:26:17.095 ' 00:26:17.095 11:50:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:17.095 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:17.095 --rc genhtml_branch_coverage=1 00:26:17.095 --rc genhtml_function_coverage=1 00:26:17.095 --rc genhtml_legend=1 00:26:17.095 --rc geninfo_all_blocks=1 00:26:17.095 --rc geninfo_unexecuted_blocks=1 00:26:17.095 00:26:17.095 ' 00:26:17.095 11:50:37 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:17.095 11:50:37 -- nvmf/common.sh@7 -- # uname -s 00:26:17.095 11:50:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:17.095 11:50:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:17.095 11:50:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:17.095 11:50:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:17.095 11:50:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:17.095 11:50:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:17.095 11:50:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:17.095 11:50:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:17.095 11:50:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:17.095 11:50:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:17.095 11:50:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:17.095 11:50:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:17.095 11:50:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:17.095 11:50:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:17.095 11:50:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:17.095 11:50:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:17.095 11:50:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:17.095 11:50:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:17.095 11:50:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:17.095 11:50:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:17.096 11:50:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:17.096 11:50:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:17.096 11:50:37 -- paths/export.sh@5 -- # export PATH 00:26:17.096 11:50:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:17.096 11:50:37 -- nvmf/common.sh@46 -- # : 0 00:26:17.096 11:50:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:17.096 11:50:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:17.096 11:50:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:17.096 11:50:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:17.096 11:50:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:17.096 11:50:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:17.096 11:50:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:17.096 11:50:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:17.096 11:50:37 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:17.096 11:50:37 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:17.096 11:50:37 -- host/digest.sh@16 -- # runtime=2 00:26:17.096 11:50:37 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:17.096 11:50:37 -- host/digest.sh@132 -- # nvmftestinit 00:26:17.096 11:50:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:17.096 11:50:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:17.096 11:50:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:17.096 11:50:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:17.096 11:50:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:17.096 11:50:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:17.096 11:50:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:17.096 11:50:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:17.096 11:50:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:17.096 11:50:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:17.096 11:50:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:17.096 11:50:37 -- common/autotest_common.sh@10 -- # set +x 00:26:19.628 11:50:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:19.628 11:50:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:19.628 11:50:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:19.628 11:50:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:19.628 11:50:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:19.628 11:50:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:19.628 11:50:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:19.628 11:50:39 -- nvmf/common.sh@294 -- # net_devs=() 00:26:19.628 11:50:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:19.628 11:50:39 -- nvmf/common.sh@295 -- # e810=() 00:26:19.628 11:50:39 -- nvmf/common.sh@295 -- # local -ga e810 00:26:19.628 11:50:39 -- nvmf/common.sh@296 -- # x722=() 00:26:19.628 11:50:39 -- nvmf/common.sh@296 -- # local -ga x722 00:26:19.628 11:50:39 -- nvmf/common.sh@297 -- # mlx=() 00:26:19.628 11:50:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:19.628 11:50:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:19.628 11:50:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:19.628 11:50:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:19.628 11:50:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:19.628 11:50:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:19.628 11:50:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:19.628 11:50:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:19.628 11:50:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:19.628 11:50:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:19.628 11:50:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:19.628 11:50:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:19.628 11:50:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:19.628 11:50:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:19.628 11:50:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:19.628 11:50:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:19.628 11:50:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:19.628 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:19.628 11:50:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:19.628 11:50:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:19.628 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:19.628 11:50:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:19.628 11:50:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:19.628 11:50:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:19.628 11:50:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:19.628 11:50:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:19.628 11:50:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:19.628 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:19.628 11:50:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:19.628 11:50:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:19.628 11:50:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:19.628 11:50:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:19.628 11:50:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:19.628 11:50:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:19.628 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:19.628 11:50:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:19.628 11:50:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:19.628 11:50:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:19.628 11:50:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:19.628 11:50:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:19.628 11:50:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:19.628 11:50:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:19.628 11:50:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:19.628 11:50:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:19.628 11:50:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:19.628 11:50:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:19.628 11:50:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:19.628 11:50:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:19.628 11:50:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:19.628 11:50:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:19.628 11:50:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:19.628 11:50:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:19.628 11:50:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:19.628 11:50:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:19.628 11:50:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:19.628 11:50:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:19.628 11:50:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:19.628 11:50:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:19.628 11:50:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:19.628 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:19.628 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:26:19.628 00:26:19.628 --- 10.0.0.2 ping statistics --- 00:26:19.628 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:19.628 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:26:19.628 11:50:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:19.628 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:19.628 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:26:19.628 00:26:19.628 --- 10.0.0.1 ping statistics --- 00:26:19.628 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:19.628 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:26:19.628 11:50:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:19.628 11:50:39 -- nvmf/common.sh@410 -- # return 0 00:26:19.628 11:50:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:19.628 11:50:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:19.628 11:50:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:19.628 11:50:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:19.628 11:50:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:19.628 11:50:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:19.628 11:50:39 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:19.628 11:50:39 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:19.628 11:50:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:19.628 11:50:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:19.628 11:50:39 -- common/autotest_common.sh@10 -- # set +x 00:26:19.628 ************************************ 00:26:19.628 START TEST nvmf_digest_clean 00:26:19.628 ************************************ 00:26:19.628 11:50:39 -- common/autotest_common.sh@1114 -- # run_digest 00:26:19.628 11:50:39 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:19.628 11:50:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:19.628 11:50:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:19.628 11:50:39 -- common/autotest_common.sh@10 -- # set +x 00:26:19.628 11:50:39 -- nvmf/common.sh@469 -- # nvmfpid=3918999 00:26:19.628 11:50:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:19.628 11:50:39 -- nvmf/common.sh@470 -- # waitforlisten 3918999 00:26:19.628 11:50:39 -- common/autotest_common.sh@829 -- # '[' -z 3918999 ']' 00:26:19.628 11:50:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:19.628 11:50:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:19.628 11:50:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:19.628 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:19.628 11:50:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:19.628 11:50:39 -- common/autotest_common.sh@10 -- # set +x 00:26:19.628 [2024-11-28 11:50:39.255851] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:19.628 [2024-11-28 11:50:39.255929] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:19.628 EAL: No free 2048 kB hugepages reported on node 1 00:26:19.628 [2024-11-28 11:50:39.328480] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:19.628 [2024-11-28 11:50:39.447322] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:19.628 [2024-11-28 11:50:39.447497] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:19.628 [2024-11-28 11:50:39.447518] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:19.628 [2024-11-28 11:50:39.447541] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:19.628 [2024-11-28 11:50:39.447582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:19.628 11:50:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:19.628 11:50:39 -- common/autotest_common.sh@862 -- # return 0 00:26:19.628 11:50:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:19.628 11:50:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:19.629 11:50:39 -- common/autotest_common.sh@10 -- # set +x 00:26:19.629 11:50:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:19.629 11:50:39 -- host/digest.sh@120 -- # common_target_config 00:26:19.629 11:50:39 -- host/digest.sh@43 -- # rpc_cmd 00:26:19.629 11:50:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.629 11:50:39 -- common/autotest_common.sh@10 -- # set +x 00:26:19.629 null0 00:26:19.629 [2024-11-28 11:50:39.623148] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:19.629 [2024-11-28 11:50:39.647380] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:19.629 11:50:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.629 11:50:39 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:19.629 11:50:39 -- host/digest.sh@77 -- # local rw bs qd 00:26:19.629 11:50:39 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:19.629 11:50:39 -- host/digest.sh@80 -- # rw=randread 00:26:19.629 11:50:39 -- host/digest.sh@80 -- # bs=4096 00:26:19.629 11:50:39 -- host/digest.sh@80 -- # qd=128 00:26:19.629 11:50:39 -- host/digest.sh@82 -- # bperfpid=3919145 00:26:19.629 11:50:39 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:19.629 11:50:39 -- host/digest.sh@83 -- # waitforlisten 3919145 /var/tmp/bperf.sock 00:26:19.629 11:50:39 -- common/autotest_common.sh@829 -- # '[' -z 3919145 ']' 00:26:19.629 11:50:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:19.629 11:50:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:19.629 11:50:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:19.629 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:19.629 11:50:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:19.629 11:50:39 -- common/autotest_common.sh@10 -- # set +x 00:26:19.887 [2024-11-28 11:50:39.687866] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:19.887 [2024-11-28 11:50:39.687939] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3919145 ] 00:26:19.887 EAL: No free 2048 kB hugepages reported on node 1 00:26:19.887 [2024-11-28 11:50:39.748674] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:19.887 [2024-11-28 11:50:39.863099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:19.887 11:50:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:19.887 11:50:39 -- common/autotest_common.sh@862 -- # return 0 00:26:19.887 11:50:39 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:19.887 11:50:39 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:19.887 11:50:39 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:20.453 11:50:40 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:20.453 11:50:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:20.711 nvme0n1 00:26:20.711 11:50:40 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:20.711 11:50:40 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:20.969 Running I/O for 2 seconds... 00:26:22.869 00:26:22.869 Latency(us) 00:26:22.869 [2024-11-28T10:50:42.925Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:22.869 [2024-11-28T10:50:42.925Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:22.869 nvme0n1 : 2.01 16877.66 65.93 0.00 0.00 7576.05 3228.25 14175.19 00:26:22.869 [2024-11-28T10:50:42.925Z] =================================================================================================================== 00:26:22.869 [2024-11-28T10:50:42.925Z] Total : 16877.66 65.93 0.00 0.00 7576.05 3228.25 14175.19 00:26:22.869 0 00:26:22.869 11:50:42 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:22.869 11:50:42 -- host/digest.sh@92 -- # get_accel_stats 00:26:22.869 11:50:42 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:22.869 11:50:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:22.869 11:50:42 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:22.869 | select(.opcode=="crc32c") 00:26:22.869 | "\(.module_name) \(.executed)"' 00:26:23.128 11:50:43 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:23.128 11:50:43 -- host/digest.sh@93 -- # exp_module=software 00:26:23.128 11:50:43 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:23.128 11:50:43 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:23.128 11:50:43 -- host/digest.sh@97 -- # killprocess 3919145 00:26:23.128 11:50:43 -- common/autotest_common.sh@936 -- # '[' -z 3919145 ']' 00:26:23.128 11:50:43 -- common/autotest_common.sh@940 -- # kill -0 3919145 00:26:23.128 11:50:43 -- common/autotest_common.sh@941 -- # uname 00:26:23.128 11:50:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:23.128 11:50:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3919145 00:26:23.387 11:50:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:23.387 11:50:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:23.387 11:50:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3919145' 00:26:23.387 killing process with pid 3919145 00:26:23.387 11:50:43 -- common/autotest_common.sh@955 -- # kill 3919145 00:26:23.387 Received shutdown signal, test time was about 2.000000 seconds 00:26:23.387 00:26:23.387 Latency(us) 00:26:23.387 [2024-11-28T10:50:43.443Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:23.387 [2024-11-28T10:50:43.443Z] =================================================================================================================== 00:26:23.387 [2024-11-28T10:50:43.443Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:23.387 11:50:43 -- common/autotest_common.sh@960 -- # wait 3919145 00:26:23.646 11:50:43 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:23.646 11:50:43 -- host/digest.sh@77 -- # local rw bs qd 00:26:23.646 11:50:43 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:23.646 11:50:43 -- host/digest.sh@80 -- # rw=randread 00:26:23.646 11:50:43 -- host/digest.sh@80 -- # bs=131072 00:26:23.646 11:50:43 -- host/digest.sh@80 -- # qd=16 00:26:23.646 11:50:43 -- host/digest.sh@82 -- # bperfpid=3919563 00:26:23.646 11:50:43 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:23.646 11:50:43 -- host/digest.sh@83 -- # waitforlisten 3919563 /var/tmp/bperf.sock 00:26:23.646 11:50:43 -- common/autotest_common.sh@829 -- # '[' -z 3919563 ']' 00:26:23.646 11:50:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:23.646 11:50:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:23.646 11:50:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:23.646 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:23.646 11:50:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:23.646 11:50:43 -- common/autotest_common.sh@10 -- # set +x 00:26:23.646 [2024-11-28 11:50:43.499173] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:23.646 [2024-11-28 11:50:43.499250] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3919563 ] 00:26:23.646 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:23.646 Zero copy mechanism will not be used. 00:26:23.646 EAL: No free 2048 kB hugepages reported on node 1 00:26:23.646 [2024-11-28 11:50:43.562004] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:23.646 [2024-11-28 11:50:43.675168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:23.905 11:50:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:23.905 11:50:43 -- common/autotest_common.sh@862 -- # return 0 00:26:23.905 11:50:43 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:23.905 11:50:43 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:23.905 11:50:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:24.163 11:50:44 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:24.163 11:50:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:24.421 nvme0n1 00:26:24.422 11:50:44 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:24.422 11:50:44 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:24.680 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:24.680 Zero copy mechanism will not be used. 00:26:24.680 Running I/O for 2 seconds... 00:26:26.577 00:26:26.577 Latency(us) 00:26:26.577 [2024-11-28T10:50:46.633Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:26.577 [2024-11-28T10:50:46.633Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:26.577 nvme0n1 : 2.00 4578.89 572.36 0.00 0.00 3490.52 928.43 7475.96 00:26:26.577 [2024-11-28T10:50:46.633Z] =================================================================================================================== 00:26:26.577 [2024-11-28T10:50:46.633Z] Total : 4578.89 572.36 0.00 0.00 3490.52 928.43 7475.96 00:26:26.577 0 00:26:26.577 11:50:46 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:26.577 11:50:46 -- host/digest.sh@92 -- # get_accel_stats 00:26:26.577 11:50:46 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:26.577 11:50:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:26.577 11:50:46 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:26.577 | select(.opcode=="crc32c") 00:26:26.577 | "\(.module_name) \(.executed)"' 00:26:26.835 11:50:46 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:26.835 11:50:46 -- host/digest.sh@93 -- # exp_module=software 00:26:26.835 11:50:46 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:26.835 11:50:46 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:26.835 11:50:46 -- host/digest.sh@97 -- # killprocess 3919563 00:26:26.835 11:50:46 -- common/autotest_common.sh@936 -- # '[' -z 3919563 ']' 00:26:26.835 11:50:46 -- common/autotest_common.sh@940 -- # kill -0 3919563 00:26:26.835 11:50:46 -- common/autotest_common.sh@941 -- # uname 00:26:26.835 11:50:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:26.835 11:50:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3919563 00:26:26.835 11:50:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:26.835 11:50:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:26.835 11:50:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3919563' 00:26:26.835 killing process with pid 3919563 00:26:26.835 11:50:46 -- common/autotest_common.sh@955 -- # kill 3919563 00:26:26.835 Received shutdown signal, test time was about 2.000000 seconds 00:26:26.835 00:26:26.835 Latency(us) 00:26:26.835 [2024-11-28T10:50:46.891Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:26.835 [2024-11-28T10:50:46.891Z] =================================================================================================================== 00:26:26.835 [2024-11-28T10:50:46.891Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:26.835 11:50:46 -- common/autotest_common.sh@960 -- # wait 3919563 00:26:27.094 11:50:47 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:27.094 11:50:47 -- host/digest.sh@77 -- # local rw bs qd 00:26:27.094 11:50:47 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:27.094 11:50:47 -- host/digest.sh@80 -- # rw=randwrite 00:26:27.094 11:50:47 -- host/digest.sh@80 -- # bs=4096 00:26:27.094 11:50:47 -- host/digest.sh@80 -- # qd=128 00:26:27.094 11:50:47 -- host/digest.sh@82 -- # bperfpid=3919985 00:26:27.094 11:50:47 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:27.094 11:50:47 -- host/digest.sh@83 -- # waitforlisten 3919985 /var/tmp/bperf.sock 00:26:27.094 11:50:47 -- common/autotest_common.sh@829 -- # '[' -z 3919985 ']' 00:26:27.094 11:50:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:27.094 11:50:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:27.094 11:50:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:27.094 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:27.094 11:50:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:27.094 11:50:47 -- common/autotest_common.sh@10 -- # set +x 00:26:27.094 [2024-11-28 11:50:47.141056] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:27.094 [2024-11-28 11:50:47.141138] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3919985 ] 00:26:27.353 EAL: No free 2048 kB hugepages reported on node 1 00:26:27.353 [2024-11-28 11:50:47.203458] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:27.353 [2024-11-28 11:50:47.325119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:27.353 11:50:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:27.353 11:50:47 -- common/autotest_common.sh@862 -- # return 0 00:26:27.353 11:50:47 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:27.353 11:50:47 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:27.353 11:50:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:27.919 11:50:47 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:27.919 11:50:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:28.177 nvme0n1 00:26:28.177 11:50:48 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:28.177 11:50:48 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:28.177 Running I/O for 2 seconds... 00:26:30.703 00:26:30.703 Latency(us) 00:26:30.703 [2024-11-28T10:50:50.759Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:30.703 [2024-11-28T10:50:50.759Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:30.703 nvme0n1 : 2.01 20667.25 80.73 0.00 0.00 6185.49 3131.16 13107.20 00:26:30.703 [2024-11-28T10:50:50.759Z] =================================================================================================================== 00:26:30.703 [2024-11-28T10:50:50.759Z] Total : 20667.25 80.73 0.00 0.00 6185.49 3131.16 13107.20 00:26:30.703 0 00:26:30.703 11:50:50 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:30.703 11:50:50 -- host/digest.sh@92 -- # get_accel_stats 00:26:30.703 11:50:50 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:30.703 11:50:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:30.703 11:50:50 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:30.703 | select(.opcode=="crc32c") 00:26:30.703 | "\(.module_name) \(.executed)"' 00:26:30.703 11:50:50 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:30.703 11:50:50 -- host/digest.sh@93 -- # exp_module=software 00:26:30.704 11:50:50 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:30.704 11:50:50 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:30.704 11:50:50 -- host/digest.sh@97 -- # killprocess 3919985 00:26:30.704 11:50:50 -- common/autotest_common.sh@936 -- # '[' -z 3919985 ']' 00:26:30.704 11:50:50 -- common/autotest_common.sh@940 -- # kill -0 3919985 00:26:30.704 11:50:50 -- common/autotest_common.sh@941 -- # uname 00:26:30.704 11:50:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:30.704 11:50:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3919985 00:26:30.704 11:50:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:30.704 11:50:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:30.704 11:50:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3919985' 00:26:30.704 killing process with pid 3919985 00:26:30.704 11:50:50 -- common/autotest_common.sh@955 -- # kill 3919985 00:26:30.704 Received shutdown signal, test time was about 2.000000 seconds 00:26:30.704 00:26:30.704 Latency(us) 00:26:30.704 [2024-11-28T10:50:50.760Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:30.704 [2024-11-28T10:50:50.760Z] =================================================================================================================== 00:26:30.704 [2024-11-28T10:50:50.760Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:30.704 11:50:50 -- common/autotest_common.sh@960 -- # wait 3919985 00:26:30.704 11:50:50 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:26:30.704 11:50:50 -- host/digest.sh@77 -- # local rw bs qd 00:26:30.704 11:50:50 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:30.704 11:50:50 -- host/digest.sh@80 -- # rw=randwrite 00:26:30.704 11:50:50 -- host/digest.sh@80 -- # bs=131072 00:26:30.704 11:50:50 -- host/digest.sh@80 -- # qd=16 00:26:30.704 11:50:50 -- host/digest.sh@82 -- # bperfpid=3920474 00:26:30.704 11:50:50 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:30.704 11:50:50 -- host/digest.sh@83 -- # waitforlisten 3920474 /var/tmp/bperf.sock 00:26:30.704 11:50:50 -- common/autotest_common.sh@829 -- # '[' -z 3920474 ']' 00:26:30.704 11:50:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:30.704 11:50:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:30.704 11:50:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:30.704 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:30.704 11:50:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:30.704 11:50:50 -- common/autotest_common.sh@10 -- # set +x 00:26:30.704 [2024-11-28 11:50:50.724566] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:30.704 [2024-11-28 11:50:50.724642] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3920474 ] 00:26:30.704 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:30.704 Zero copy mechanism will not be used. 00:26:30.704 EAL: No free 2048 kB hugepages reported on node 1 00:26:30.962 [2024-11-28 11:50:50.788151] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:30.962 [2024-11-28 11:50:50.901974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:30.962 11:50:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:30.962 11:50:50 -- common/autotest_common.sh@862 -- # return 0 00:26:30.962 11:50:50 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:30.962 11:50:50 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:30.962 11:50:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:31.529 11:50:51 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:31.529 11:50:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:31.529 nvme0n1 00:26:31.787 11:50:51 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:31.787 11:50:51 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:31.787 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:31.787 Zero copy mechanism will not be used. 00:26:31.787 Running I/O for 2 seconds... 00:26:33.686 00:26:33.686 Latency(us) 00:26:33.686 [2024-11-28T10:50:53.742Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:33.686 [2024-11-28T10:50:53.743Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:33.687 nvme0n1 : 2.00 4188.95 523.62 0.00 0.00 3810.49 1978.22 5170.06 00:26:33.687 [2024-11-28T10:50:53.743Z] =================================================================================================================== 00:26:33.687 [2024-11-28T10:50:53.743Z] Total : 4188.95 523.62 0.00 0.00 3810.49 1978.22 5170.06 00:26:33.687 0 00:26:33.687 11:50:53 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:33.687 11:50:53 -- host/digest.sh@92 -- # get_accel_stats 00:26:33.687 11:50:53 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:33.687 11:50:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:33.687 11:50:53 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:33.687 | select(.opcode=="crc32c") 00:26:33.687 | "\(.module_name) \(.executed)"' 00:26:33.944 11:50:53 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:33.944 11:50:53 -- host/digest.sh@93 -- # exp_module=software 00:26:33.944 11:50:53 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:33.944 11:50:53 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:33.944 11:50:53 -- host/digest.sh@97 -- # killprocess 3920474 00:26:33.944 11:50:53 -- common/autotest_common.sh@936 -- # '[' -z 3920474 ']' 00:26:33.944 11:50:53 -- common/autotest_common.sh@940 -- # kill -0 3920474 00:26:33.944 11:50:53 -- common/autotest_common.sh@941 -- # uname 00:26:33.944 11:50:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:33.944 11:50:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3920474 00:26:34.203 11:50:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:34.203 11:50:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:34.203 11:50:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3920474' 00:26:34.203 killing process with pid 3920474 00:26:34.203 11:50:54 -- common/autotest_common.sh@955 -- # kill 3920474 00:26:34.203 Received shutdown signal, test time was about 2.000000 seconds 00:26:34.203 00:26:34.203 Latency(us) 00:26:34.203 [2024-11-28T10:50:54.259Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:34.203 [2024-11-28T10:50:54.259Z] =================================================================================================================== 00:26:34.203 [2024-11-28T10:50:54.259Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:34.203 11:50:54 -- common/autotest_common.sh@960 -- # wait 3920474 00:26:34.461 11:50:54 -- host/digest.sh@126 -- # killprocess 3918999 00:26:34.461 11:50:54 -- common/autotest_common.sh@936 -- # '[' -z 3918999 ']' 00:26:34.461 11:50:54 -- common/autotest_common.sh@940 -- # kill -0 3918999 00:26:34.461 11:50:54 -- common/autotest_common.sh@941 -- # uname 00:26:34.461 11:50:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:34.461 11:50:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3918999 00:26:34.461 11:50:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:34.461 11:50:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:34.461 11:50:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3918999' 00:26:34.461 killing process with pid 3918999 00:26:34.461 11:50:54 -- common/autotest_common.sh@955 -- # kill 3918999 00:26:34.461 11:50:54 -- common/autotest_common.sh@960 -- # wait 3918999 00:26:34.720 00:26:34.720 real 0m15.349s 00:26:34.720 user 0m29.158s 00:26:34.720 sys 0m4.737s 00:26:34.720 11:50:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:34.720 11:50:54 -- common/autotest_common.sh@10 -- # set +x 00:26:34.720 ************************************ 00:26:34.720 END TEST nvmf_digest_clean 00:26:34.720 ************************************ 00:26:34.720 11:50:54 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:26:34.720 11:50:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:34.720 11:50:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:34.720 11:50:54 -- common/autotest_common.sh@10 -- # set +x 00:26:34.720 ************************************ 00:26:34.720 START TEST nvmf_digest_error 00:26:34.720 ************************************ 00:26:34.720 11:50:54 -- common/autotest_common.sh@1114 -- # run_digest_error 00:26:34.720 11:50:54 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:26:34.720 11:50:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:34.720 11:50:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:34.720 11:50:54 -- common/autotest_common.sh@10 -- # set +x 00:26:34.720 11:50:54 -- nvmf/common.sh@469 -- # nvmfpid=3920970 00:26:34.720 11:50:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:34.720 11:50:54 -- nvmf/common.sh@470 -- # waitforlisten 3920970 00:26:34.720 11:50:54 -- common/autotest_common.sh@829 -- # '[' -z 3920970 ']' 00:26:34.720 11:50:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:34.720 11:50:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:34.720 11:50:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:34.720 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:34.720 11:50:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:34.720 11:50:54 -- common/autotest_common.sh@10 -- # set +x 00:26:34.720 [2024-11-28 11:50:54.629152] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:34.720 [2024-11-28 11:50:54.629239] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:34.720 EAL: No free 2048 kB hugepages reported on node 1 00:26:34.720 [2024-11-28 11:50:54.691716] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:34.979 [2024-11-28 11:50:54.798334] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:34.979 [2024-11-28 11:50:54.798474] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:34.979 [2024-11-28 11:50:54.798489] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:34.979 [2024-11-28 11:50:54.798515] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:34.979 [2024-11-28 11:50:54.798580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:34.979 11:50:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:34.979 11:50:54 -- common/autotest_common.sh@862 -- # return 0 00:26:34.979 11:50:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:34.979 11:50:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:34.979 11:50:54 -- common/autotest_common.sh@10 -- # set +x 00:26:34.979 11:50:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:34.979 11:50:54 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:26:34.979 11:50:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.979 11:50:54 -- common/autotest_common.sh@10 -- # set +x 00:26:34.979 [2024-11-28 11:50:54.875178] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:26:34.979 11:50:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.979 11:50:54 -- host/digest.sh@104 -- # common_target_config 00:26:34.979 11:50:54 -- host/digest.sh@43 -- # rpc_cmd 00:26:34.979 11:50:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.979 11:50:54 -- common/autotest_common.sh@10 -- # set +x 00:26:34.979 null0 00:26:34.979 [2024-11-28 11:50:54.992383] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:34.979 [2024-11-28 11:50:55.016630] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:34.979 11:50:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.979 11:50:55 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:26:34.979 11:50:55 -- host/digest.sh@54 -- # local rw bs qd 00:26:34.979 11:50:55 -- host/digest.sh@56 -- # rw=randread 00:26:34.979 11:50:55 -- host/digest.sh@56 -- # bs=4096 00:26:34.979 11:50:55 -- host/digest.sh@56 -- # qd=128 00:26:34.979 11:50:55 -- host/digest.sh@58 -- # bperfpid=3920999 00:26:34.979 11:50:55 -- host/digest.sh@60 -- # waitforlisten 3920999 /var/tmp/bperf.sock 00:26:34.979 11:50:55 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:26:34.979 11:50:55 -- common/autotest_common.sh@829 -- # '[' -z 3920999 ']' 00:26:34.979 11:50:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:34.979 11:50:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:34.979 11:50:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:34.979 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:34.979 11:50:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:34.979 11:50:55 -- common/autotest_common.sh@10 -- # set +x 00:26:35.236 [2024-11-28 11:50:55.060321] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:35.236 [2024-11-28 11:50:55.060396] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3920999 ] 00:26:35.236 EAL: No free 2048 kB hugepages reported on node 1 00:26:35.236 [2024-11-28 11:50:55.121162] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:35.236 [2024-11-28 11:50:55.237123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:36.169 11:50:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:36.169 11:50:56 -- common/autotest_common.sh@862 -- # return 0 00:26:36.169 11:50:56 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:36.169 11:50:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:36.427 11:50:56 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:36.427 11:50:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.427 11:50:56 -- common/autotest_common.sh@10 -- # set +x 00:26:36.427 11:50:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:36.427 11:50:56 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:36.427 11:50:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:36.994 nvme0n1 00:26:36.994 11:50:56 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:36.994 11:50:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.994 11:50:56 -- common/autotest_common.sh@10 -- # set +x 00:26:36.994 11:50:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:36.994 11:50:56 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:36.994 11:50:56 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:36.994 Running I/O for 2 seconds... 00:26:36.994 [2024-11-28 11:50:57.033124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:36.994 [2024-11-28 11:50:57.033180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4313 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.994 [2024-11-28 11:50:57.033204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.252 [2024-11-28 11:50:57.050386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.252 [2024-11-28 11:50:57.050434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17131 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.252 [2024-11-28 11:50:57.050450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.252 [2024-11-28 11:50:57.067784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.252 [2024-11-28 11:50:57.067819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:6909 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.252 [2024-11-28 11:50:57.067838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.252 [2024-11-28 11:50:57.085041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.252 [2024-11-28 11:50:57.085076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:6559 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.252 [2024-11-28 11:50:57.085096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.252 [2024-11-28 11:50:57.096090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.252 [2024-11-28 11:50:57.096124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:4631 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.252 [2024-11-28 11:50:57.096143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.252 [2024-11-28 11:50:57.112180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.252 [2024-11-28 11:50:57.112216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:19567 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.252 [2024-11-28 11:50:57.112236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.253 [2024-11-28 11:50:57.129194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.253 [2024-11-28 11:50:57.129228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:21796 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.253 [2024-11-28 11:50:57.129248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.253 [2024-11-28 11:50:57.146318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.253 [2024-11-28 11:50:57.146363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:5870 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.253 [2024-11-28 11:50:57.146383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.253 [2024-11-28 11:50:57.163643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.253 [2024-11-28 11:50:57.163670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:9706 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.253 [2024-11-28 11:50:57.163700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.253 [2024-11-28 11:50:57.180481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.253 [2024-11-28 11:50:57.180516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:6804 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.253 [2024-11-28 11:50:57.180543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.253 [2024-11-28 11:50:57.197920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.253 [2024-11-28 11:50:57.197953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:20971 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.253 [2024-11-28 11:50:57.197972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.253 [2024-11-28 11:50:57.215216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.253 [2024-11-28 11:50:57.215250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19239 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.253 [2024-11-28 11:50:57.215268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.253 [2024-11-28 11:50:57.226294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.253 [2024-11-28 11:50:57.226328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18003 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.253 [2024-11-28 11:50:57.226347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.253 [2024-11-28 11:50:57.242450] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.253 [2024-11-28 11:50:57.242484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4662 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.253 [2024-11-28 11:50:57.242503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.253 [2024-11-28 11:50:57.259867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.253 [2024-11-28 11:50:57.259901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:17130 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.253 [2024-11-28 11:50:57.259919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.253 [2024-11-28 11:50:57.275468] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.253 [2024-11-28 11:50:57.275501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:10622 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.253 [2024-11-28 11:50:57.275519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.253 [2024-11-28 11:50:57.287761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.253 [2024-11-28 11:50:57.287789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:15361 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.253 [2024-11-28 11:50:57.287804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.253 [2024-11-28 11:50:57.304027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.253 [2024-11-28 11:50:57.304056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:8289 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.253 [2024-11-28 11:50:57.304088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.511 [2024-11-28 11:50:57.321153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.511 [2024-11-28 11:50:57.321186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:11111 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.511 [2024-11-28 11:50:57.321204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.511 [2024-11-28 11:50:57.338082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.511 [2024-11-28 11:50:57.338115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17491 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.511 [2024-11-28 11:50:57.338134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.511 [2024-11-28 11:50:57.354775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.511 [2024-11-28 11:50:57.354802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5203 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.511 [2024-11-28 11:50:57.354817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.511 [2024-11-28 11:50:57.371972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.511 [2024-11-28 11:50:57.372007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:14415 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.511 [2024-11-28 11:50:57.372025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.511 [2024-11-28 11:50:57.389066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.511 [2024-11-28 11:50:57.389099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:1626 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.511 [2024-11-28 11:50:57.389118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.511 [2024-11-28 11:50:57.406046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.511 [2024-11-28 11:50:57.406079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:19261 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.511 [2024-11-28 11:50:57.406097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.511 [2024-11-28 11:50:57.423126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.512 [2024-11-28 11:50:57.423160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:25435 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.512 [2024-11-28 11:50:57.423185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.512 [2024-11-28 11:50:57.439891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.512 [2024-11-28 11:50:57.439925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:10605 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.512 [2024-11-28 11:50:57.439944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.512 [2024-11-28 11:50:57.456890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.512 [2024-11-28 11:50:57.456924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:5228 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.512 [2024-11-28 11:50:57.456943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.512 [2024-11-28 11:50:57.474067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.512 [2024-11-28 11:50:57.474102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:21758 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.512 [2024-11-28 11:50:57.474120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.512 [2024-11-28 11:50:57.490997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.512 [2024-11-28 11:50:57.491031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:8661 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.512 [2024-11-28 11:50:57.491050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.512 [2024-11-28 11:50:57.507956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.512 [2024-11-28 11:50:57.507989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:1366 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.512 [2024-11-28 11:50:57.508008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.512 [2024-11-28 11:50:57.524787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.512 [2024-11-28 11:50:57.524814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:8691 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.512 [2024-11-28 11:50:57.524830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.512 [2024-11-28 11:50:57.541671] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.512 [2024-11-28 11:50:57.541700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:394 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.512 [2024-11-28 11:50:57.541730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.512 [2024-11-28 11:50:57.559121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.512 [2024-11-28 11:50:57.559156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:23346 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.512 [2024-11-28 11:50:57.559175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.770 [2024-11-28 11:50:57.576500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.770 [2024-11-28 11:50:57.576548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:2517 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.770 [2024-11-28 11:50:57.576569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.770 [2024-11-28 11:50:57.593641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.770 [2024-11-28 11:50:57.593668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:18679 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.770 [2024-11-28 11:50:57.593698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.770 [2024-11-28 11:50:57.610635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.770 [2024-11-28 11:50:57.610663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:22531 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.770 [2024-11-28 11:50:57.610693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.770 [2024-11-28 11:50:57.627581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.770 [2024-11-28 11:50:57.627609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8081 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.770 [2024-11-28 11:50:57.627638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.770 [2024-11-28 11:50:57.644618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.771 [2024-11-28 11:50:57.644646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:6886 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.771 [2024-11-28 11:50:57.644677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.771 [2024-11-28 11:50:57.661659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.771 [2024-11-28 11:50:57.661687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:13102 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.771 [2024-11-28 11:50:57.661718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.771 [2024-11-28 11:50:57.678977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.771 [2024-11-28 11:50:57.679011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22719 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.771 [2024-11-28 11:50:57.679030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.771 [2024-11-28 11:50:57.696587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.771 [2024-11-28 11:50:57.696616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:16835 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.771 [2024-11-28 11:50:57.696632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.771 [2024-11-28 11:50:57.712987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.771 [2024-11-28 11:50:57.713021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:16565 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.771 [2024-11-28 11:50:57.713039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.771 [2024-11-28 11:50:57.730051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.771 [2024-11-28 11:50:57.730084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21506 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.771 [2024-11-28 11:50:57.730102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.771 [2024-11-28 11:50:57.747388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.771 [2024-11-28 11:50:57.747422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:9024 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.771 [2024-11-28 11:50:57.747441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.771 [2024-11-28 11:50:57.765154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.771 [2024-11-28 11:50:57.765188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:5447 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.771 [2024-11-28 11:50:57.765206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.771 [2024-11-28 11:50:57.781750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.771 [2024-11-28 11:50:57.781779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:17820 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.771 [2024-11-28 11:50:57.781810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.771 [2024-11-28 11:50:57.797887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.771 [2024-11-28 11:50:57.797921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:21128 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.771 [2024-11-28 11:50:57.797939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.771 [2024-11-28 11:50:57.815675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:37.771 [2024-11-28 11:50:57.815719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8249 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.771 [2024-11-28 11:50:57.815735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.029 [2024-11-28 11:50:57.831759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.029 [2024-11-28 11:50:57.831815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:23627 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.029 [2024-11-28 11:50:57.831830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.029 [2024-11-28 11:50:57.848168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.029 [2024-11-28 11:50:57.848202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:18472 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.029 [2024-11-28 11:50:57.848220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.029 [2024-11-28 11:50:57.865884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.029 [2024-11-28 11:50:57.865930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23434 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.029 [2024-11-28 11:50:57.865956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.029 [2024-11-28 11:50:57.889484] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.029 [2024-11-28 11:50:57.889517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:12174 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.030 [2024-11-28 11:50:57.889547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.030 [2024-11-28 11:50:57.906334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.030 [2024-11-28 11:50:57.906367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19888 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.030 [2024-11-28 11:50:57.906386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.030 [2024-11-28 11:50:57.923420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.030 [2024-11-28 11:50:57.923453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:7444 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.030 [2024-11-28 11:50:57.923471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.030 [2024-11-28 11:50:57.940586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.030 [2024-11-28 11:50:57.940616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:14206 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.030 [2024-11-28 11:50:57.940647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.030 [2024-11-28 11:50:57.957294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.030 [2024-11-28 11:50:57.957328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:1620 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.030 [2024-11-28 11:50:57.957346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.030 [2024-11-28 11:50:57.974339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.030 [2024-11-28 11:50:57.974373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:6916 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.030 [2024-11-28 11:50:57.974391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.030 [2024-11-28 11:50:57.991412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.030 [2024-11-28 11:50:57.991446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:332 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.030 [2024-11-28 11:50:57.991465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.030 [2024-11-28 11:50:58.008577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.030 [2024-11-28 11:50:58.008605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:16524 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.030 [2024-11-28 11:50:58.008634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.030 [2024-11-28 11:50:58.019684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.030 [2024-11-28 11:50:58.019726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:7372 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.030 [2024-11-28 11:50:58.019741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.030 [2024-11-28 11:50:58.035520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.030 [2024-11-28 11:50:58.035559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:17033 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.030 [2024-11-28 11:50:58.035592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.030 [2024-11-28 11:50:58.052619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.030 [2024-11-28 11:50:58.052647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:16361 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.030 [2024-11-28 11:50:58.052663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.030 [2024-11-28 11:50:58.075113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.030 [2024-11-28 11:50:58.075140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:23691 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.030 [2024-11-28 11:50:58.075172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.288 [2024-11-28 11:50:58.091940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.091973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:4202 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.091991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.108919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.108953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:8493 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.108971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.125882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.125916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:22586 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.125934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.142954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.142988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:22276 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.143006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.158679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.158709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:469 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.158732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.170200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.170233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:17551 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.170251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.187621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.187649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19384 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.187680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.205618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.205649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:9004 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.205665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.221883] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.221916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:2779 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.221934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.238813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.238846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:4351 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.238864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.256175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.256208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:2065 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.256227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.273191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.273224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8684 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.273242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.290389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.290423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:21634 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.290442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.307532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.307591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:12157 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.307608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.324783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.324811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:1310 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.324826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.289 [2024-11-28 11:50:58.341964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.289 [2024-11-28 11:50:58.341998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:15323 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.289 [2024-11-28 11:50:58.342030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.359190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.359223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6399 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.359241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.376340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.376374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:5048 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.376393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.393503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.393546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:17131 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.393580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.410676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.410704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:6977 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.410735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.427719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.427747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:12724 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.427778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.444782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.444809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19983 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.444824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.461771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.461798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:5044 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.461828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.479033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.479065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17941 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.479083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.495762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.495790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:15669 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.495805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.512880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.512913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:23954 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.512931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.529713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.529739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:3557 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.529770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.546931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.546964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:25599 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.546982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.564055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.564089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:16709 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.564107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.581185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.581219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:513 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.581238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.548 [2024-11-28 11:50:58.598240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.548 [2024-11-28 11:50:58.598274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:21017 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.548 [2024-11-28 11:50:58.598300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.807 [2024-11-28 11:50:58.615359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.807 [2024-11-28 11:50:58.615393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:1111 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.807 [2024-11-28 11:50:58.615412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.807 [2024-11-28 11:50:58.633432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.807 [2024-11-28 11:50:58.633465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:11479 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.807 [2024-11-28 11:50:58.633484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.807 [2024-11-28 11:50:58.649827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.807 [2024-11-28 11:50:58.649875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:13771 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.807 [2024-11-28 11:50:58.649894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.807 [2024-11-28 11:50:58.667062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.807 [2024-11-28 11:50:58.667096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:6427 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.807 [2024-11-28 11:50:58.667115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.807 [2024-11-28 11:50:58.684459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.807 [2024-11-28 11:50:58.684494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:8227 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.807 [2024-11-28 11:50:58.684512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.807 [2024-11-28 11:50:58.701543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.807 [2024-11-28 11:50:58.701589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:10768 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.807 [2024-11-28 11:50:58.701606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.807 [2024-11-28 11:50:58.718742] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.807 [2024-11-28 11:50:58.718771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:23568 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.807 [2024-11-28 11:50:58.718802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.807 [2024-11-28 11:50:58.736814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.807 [2024-11-28 11:50:58.736845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:17894 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.807 [2024-11-28 11:50:58.736861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.807 [2024-11-28 11:50:58.752951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.807 [2024-11-28 11:50:58.752985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:8220 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.807 [2024-11-28 11:50:58.753003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.807 [2024-11-28 11:50:58.770009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.807 [2024-11-28 11:50:58.770042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:17474 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.807 [2024-11-28 11:50:58.770060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.807 [2024-11-28 11:50:58.794605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.807 [2024-11-28 11:50:58.794635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:7838 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.807 [2024-11-28 11:50:58.794667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.807 [2024-11-28 11:50:58.811668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.807 [2024-11-28 11:50:58.811699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:8103 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.807 [2024-11-28 11:50:58.811716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.807 [2024-11-28 11:50:58.828819] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.807 [2024-11-28 11:50:58.828850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1704 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.807 [2024-11-28 11:50:58.828881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.807 [2024-11-28 11:50:58.846171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:38.807 [2024-11-28 11:50:58.846205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14833 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.807 [2024-11-28 11:50:58.846224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.066 [2024-11-28 11:50:58.863572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:39.066 [2024-11-28 11:50:58.863605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:10230 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.066 [2024-11-28 11:50:58.863622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.066 [2024-11-28 11:50:58.880700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:39.066 [2024-11-28 11:50:58.880728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:6074 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.066 [2024-11-28 11:50:58.880759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.066 [2024-11-28 11:50:58.897815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:39.066 [2024-11-28 11:50:58.897842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:4576 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.066 [2024-11-28 11:50:58.897881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.066 [2024-11-28 11:50:58.915047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:39.066 [2024-11-28 11:50:58.915080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:14033 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.066 [2024-11-28 11:50:58.915099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.066 [2024-11-28 11:50:58.932005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:39.066 [2024-11-28 11:50:58.932039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:9544 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.066 [2024-11-28 11:50:58.932057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.066 [2024-11-28 11:50:58.949003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:39.066 [2024-11-28 11:50:58.949036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12201 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.066 [2024-11-28 11:50:58.949054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.066 [2024-11-28 11:50:58.965832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:39.066 [2024-11-28 11:50:58.965859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:10634 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.066 [2024-11-28 11:50:58.965892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.066 [2024-11-28 11:50:58.982616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:39.066 [2024-11-28 11:50:58.982643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:5573 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.066 [2024-11-28 11:50:58.982674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.066 [2024-11-28 11:50:58.999680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:39.066 [2024-11-28 11:50:58.999708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:14449 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.066 [2024-11-28 11:50:58.999743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.066 [2024-11-28 11:50:59.016499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1359bb0) 00:26:39.066 [2024-11-28 11:50:59.016539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:2864 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.066 [2024-11-28 11:50:59.016560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.066 00:26:39.066 Latency(us) 00:26:39.066 [2024-11-28T10:50:59.122Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:39.066 [2024-11-28T10:50:59.122Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:39.066 nvme0n1 : 2.01 15051.05 58.79 0.00 0.00 8496.86 3786.52 32039.82 00:26:39.066 [2024-11-28T10:50:59.122Z] =================================================================================================================== 00:26:39.066 [2024-11-28T10:50:59.122Z] Total : 15051.05 58.79 0.00 0.00 8496.86 3786.52 32039.82 00:26:39.066 0 00:26:39.066 11:50:59 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:39.066 11:50:59 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:39.066 11:50:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:39.066 11:50:59 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:39.066 | .driver_specific 00:26:39.066 | .nvme_error 00:26:39.066 | .status_code 00:26:39.066 | .command_transient_transport_error' 00:26:39.324 11:50:59 -- host/digest.sh@71 -- # (( 118 > 0 )) 00:26:39.324 11:50:59 -- host/digest.sh@73 -- # killprocess 3920999 00:26:39.324 11:50:59 -- common/autotest_common.sh@936 -- # '[' -z 3920999 ']' 00:26:39.324 11:50:59 -- common/autotest_common.sh@940 -- # kill -0 3920999 00:26:39.325 11:50:59 -- common/autotest_common.sh@941 -- # uname 00:26:39.325 11:50:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:39.325 11:50:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3920999 00:26:39.325 11:50:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:39.325 11:50:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:39.325 11:50:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3920999' 00:26:39.325 killing process with pid 3920999 00:26:39.325 11:50:59 -- common/autotest_common.sh@955 -- # kill 3920999 00:26:39.325 Received shutdown signal, test time was about 2.000000 seconds 00:26:39.325 00:26:39.325 Latency(us) 00:26:39.325 [2024-11-28T10:50:59.381Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:39.325 [2024-11-28T10:50:59.381Z] =================================================================================================================== 00:26:39.325 [2024-11-28T10:50:59.381Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:39.325 11:50:59 -- common/autotest_common.sh@960 -- # wait 3920999 00:26:39.583 11:50:59 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:26:39.583 11:50:59 -- host/digest.sh@54 -- # local rw bs qd 00:26:39.583 11:50:59 -- host/digest.sh@56 -- # rw=randread 00:26:39.583 11:50:59 -- host/digest.sh@56 -- # bs=131072 00:26:39.583 11:50:59 -- host/digest.sh@56 -- # qd=16 00:26:39.583 11:50:59 -- host/digest.sh@58 -- # bperfpid=3921547 00:26:39.583 11:50:59 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:26:39.583 11:50:59 -- host/digest.sh@60 -- # waitforlisten 3921547 /var/tmp/bperf.sock 00:26:39.583 11:50:59 -- common/autotest_common.sh@829 -- # '[' -z 3921547 ']' 00:26:39.583 11:50:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:39.583 11:50:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:39.583 11:50:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:39.583 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:39.583 11:50:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:39.583 11:50:59 -- common/autotest_common.sh@10 -- # set +x 00:26:39.841 [2024-11-28 11:50:59.640574] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:39.841 [2024-11-28 11:50:59.640659] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3921547 ] 00:26:39.841 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:39.841 Zero copy mechanism will not be used. 00:26:39.841 EAL: No free 2048 kB hugepages reported on node 1 00:26:39.841 [2024-11-28 11:50:59.701227] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:39.841 [2024-11-28 11:50:59.820842] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:40.773 11:51:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:40.773 11:51:00 -- common/autotest_common.sh@862 -- # return 0 00:26:40.773 11:51:00 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:40.774 11:51:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:41.032 11:51:00 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:41.032 11:51:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:41.032 11:51:00 -- common/autotest_common.sh@10 -- # set +x 00:26:41.032 11:51:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:41.032 11:51:00 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:41.032 11:51:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:41.596 nvme0n1 00:26:41.596 11:51:01 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:26:41.596 11:51:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:41.596 11:51:01 -- common/autotest_common.sh@10 -- # set +x 00:26:41.596 11:51:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:41.596 11:51:01 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:41.596 11:51:01 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:41.596 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:41.596 Zero copy mechanism will not be used. 00:26:41.596 Running I/O for 2 seconds... 00:26:41.597 [2024-11-28 11:51:01.501744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.501811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.501836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.511180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.511228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.511245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.520217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.520252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.520273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.528691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.528722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.528754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.536934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.536963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.536996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.544557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.544588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.544622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.552470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.552500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.552542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.560437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.560466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.560498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.568770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.568801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.568836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.578291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.578323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.578340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.586402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.586437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.586457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.594195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.594230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.594251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.603186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.603215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.603247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.612022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.612053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.612086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.620217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.620247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.620287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.628427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.628456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.628488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.637394] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.637429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.637449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.597 [2024-11-28 11:51:01.646264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.597 [2024-11-28 11:51:01.646294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.597 [2024-11-28 11:51:01.646312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.854 [2024-11-28 11:51:01.654462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.854 [2024-11-28 11:51:01.654493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.854 [2024-11-28 11:51:01.654511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.854 [2024-11-28 11:51:01.662972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.854 [2024-11-28 11:51:01.663006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.854 [2024-11-28 11:51:01.663025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.854 [2024-11-28 11:51:01.670879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.854 [2024-11-28 11:51:01.670914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.854 [2024-11-28 11:51:01.670934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.854 [2024-11-28 11:51:01.678879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.854 [2024-11-28 11:51:01.678914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.854 [2024-11-28 11:51:01.678934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.854 [2024-11-28 11:51:01.686895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.854 [2024-11-28 11:51:01.686941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.854 [2024-11-28 11:51:01.686957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.696638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.696690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.696708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.704878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.704925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.704945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.713365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.713395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.713428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.721356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.721386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.721403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.730329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.730359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.730391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.738577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.738609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.738626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.746428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.746471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.746488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.754184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.754215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.754232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.762068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.762099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.762124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.769899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.769929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.769946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.777222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.777253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.777270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.784908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.784953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.784970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.792765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.792795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.792813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.800788] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.800818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.800835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.808630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.808660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.808677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.816627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.816658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.816691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.824439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.824484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.824502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.832276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.832329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.832348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.840205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.840237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.840254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.848033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.848065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.848083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.857500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.857554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.857586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.865315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.865358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.865375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.873743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.873774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.873792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.881560] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.881591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.881609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.890301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.890330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.890362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.898800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.898832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.898850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.855 [2024-11-28 11:51:01.906532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:41.855 [2024-11-28 11:51:01.906563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.855 [2024-11-28 11:51:01.906580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.113 [2024-11-28 11:51:01.914110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.113 [2024-11-28 11:51:01.914140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.113 [2024-11-28 11:51:01.914158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.113 [2024-11-28 11:51:01.921800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.113 [2024-11-28 11:51:01.921831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.113 [2024-11-28 11:51:01.921848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.113 [2024-11-28 11:51:01.929389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.113 [2024-11-28 11:51:01.929419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.113 [2024-11-28 11:51:01.929451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.113 [2024-11-28 11:51:01.937462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.113 [2024-11-28 11:51:01.937491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.113 [2024-11-28 11:51:01.937523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.113 [2024-11-28 11:51:01.945820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.113 [2024-11-28 11:51:01.945851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:01.945883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:01.954408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:01.954439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:01.954471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:01.962504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:01.962558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:01.962577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:01.970326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:01.970357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:01.970382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:01.978516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:01.978555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:01.978591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:01.986588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:01.986620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:01.986637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:01.994491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:01.994546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:01.994565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.002872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.002904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.002922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.011315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.011345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.011361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.019748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.019779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.019796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.027580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.027611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.027629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.035177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.035215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.035252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.042537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.042576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.042594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.050087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.050119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.050136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.057800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.057832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.057850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.065333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.065365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.065382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.073048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.073080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.073098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.080518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.080557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.080574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.088336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.088376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.088393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.095791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.095832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.095850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.103437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.103469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.103486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.111260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.114 [2024-11-28 11:51:02.111305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.114 [2024-11-28 11:51:02.111321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.114 [2024-11-28 11:51:02.119285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.115 [2024-11-28 11:51:02.119315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.115 [2024-11-28 11:51:02.119333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.115 [2024-11-28 11:51:02.126879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.115 [2024-11-28 11:51:02.126910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.115 [2024-11-28 11:51:02.126928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.115 [2024-11-28 11:51:02.134553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.115 [2024-11-28 11:51:02.134594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.115 [2024-11-28 11:51:02.134611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.115 [2024-11-28 11:51:02.142602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.115 [2024-11-28 11:51:02.142648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.115 [2024-11-28 11:51:02.142666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.115 [2024-11-28 11:51:02.148178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.115 [2024-11-28 11:51:02.148209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.115 [2024-11-28 11:51:02.148227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.115 [2024-11-28 11:51:02.155332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.115 [2024-11-28 11:51:02.155363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.115 [2024-11-28 11:51:02.155380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.115 [2024-11-28 11:51:02.162861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.115 [2024-11-28 11:51:02.162892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.115 [2024-11-28 11:51:02.162909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.373 [2024-11-28 11:51:02.170129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.373 [2024-11-28 11:51:02.170161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.373 [2024-11-28 11:51:02.170185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.373 [2024-11-28 11:51:02.177467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.373 [2024-11-28 11:51:02.177499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.373 [2024-11-28 11:51:02.177517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.373 [2024-11-28 11:51:02.185313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.373 [2024-11-28 11:51:02.185345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.373 [2024-11-28 11:51:02.185363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.373 [2024-11-28 11:51:02.193379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.373 [2024-11-28 11:51:02.193410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.373 [2024-11-28 11:51:02.193428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.373 [2024-11-28 11:51:02.201766] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.373 [2024-11-28 11:51:02.201797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.373 [2024-11-28 11:51:02.201815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.373 [2024-11-28 11:51:02.209357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.373 [2024-11-28 11:51:02.209402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.373 [2024-11-28 11:51:02.209418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.373 [2024-11-28 11:51:02.217169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.373 [2024-11-28 11:51:02.217200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.373 [2024-11-28 11:51:02.217218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.373 [2024-11-28 11:51:02.224987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.373 [2024-11-28 11:51:02.225019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.373 [2024-11-28 11:51:02.225037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.373 [2024-11-28 11:51:02.233206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.373 [2024-11-28 11:51:02.233237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.373 [2024-11-28 11:51:02.233255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.373 [2024-11-28 11:51:02.240986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.373 [2024-11-28 11:51:02.241017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.373 [2024-11-28 11:51:02.241035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.248866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.248911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.248928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.256588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.256619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.256636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.264880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.264910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.264928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.272916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.272947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.272979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.280792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.280824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.280841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.288014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.288046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.288064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.295368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.295399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.295417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.302755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.302786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.302810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.310175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.310205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.310238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.318080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.318112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.318130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.326237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.326282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.326300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.333650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.333681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.333699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.341549] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.341580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.341597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.349869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.349915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.349933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.358708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.358739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.358757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.367844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.367876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.367910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.376009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.376053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.376085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.383993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.384023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.384041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.392679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.392711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.392728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.401157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.401188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.401206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.409135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.409179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.409195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.417400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.417428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.417459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.374 [2024-11-28 11:51:02.426259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.374 [2024-11-28 11:51:02.426290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.374 [2024-11-28 11:51:02.426307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.633 [2024-11-28 11:51:02.434561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.633 [2024-11-28 11:51:02.434615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.633 [2024-11-28 11:51:02.434633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.633 [2024-11-28 11:51:02.442814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.633 [2024-11-28 11:51:02.442860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.633 [2024-11-28 11:51:02.442877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.633 [2024-11-28 11:51:02.450799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.633 [2024-11-28 11:51:02.450844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.633 [2024-11-28 11:51:02.450861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.633 [2024-11-28 11:51:02.459349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.633 [2024-11-28 11:51:02.459379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.633 [2024-11-28 11:51:02.459397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.633 [2024-11-28 11:51:02.468423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.633 [2024-11-28 11:51:02.468454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.633 [2024-11-28 11:51:02.468472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.633 [2024-11-28 11:51:02.476780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.633 [2024-11-28 11:51:02.476827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.633 [2024-11-28 11:51:02.476844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.633 [2024-11-28 11:51:02.484626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.633 [2024-11-28 11:51:02.484658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.633 [2024-11-28 11:51:02.484675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.633 [2024-11-28 11:51:02.492838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.633 [2024-11-28 11:51:02.492884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.633 [2024-11-28 11:51:02.492902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.633 [2024-11-28 11:51:02.500801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.633 [2024-11-28 11:51:02.500832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.500850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.509111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.509140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.509156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.517250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.517295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.517323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.525078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.525110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.525128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.533222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.533254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.533272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.540729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.540760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.540778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.548822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.548853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.548871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.555400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.555431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.555448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.562832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.562864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.562881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.570244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.570274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.570292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.578177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.578208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.578225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.583462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.583508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.583536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.590615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.590646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.590663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.598231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.598262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.598280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.605613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.605644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.605661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.615263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.615295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.615313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.623018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.623049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.623067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.631011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.631041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.631058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.638702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.638733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.638750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.647120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.647167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.647184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.655386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.655431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.655448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.664230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.664277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.664293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.673398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.673428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.673459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.634 [2024-11-28 11:51:02.683088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.634 [2024-11-28 11:51:02.683118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.634 [2024-11-28 11:51:02.683151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.898 [2024-11-28 11:51:02.690471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.898 [2024-11-28 11:51:02.690516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.898 [2024-11-28 11:51:02.690541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.898 [2024-11-28 11:51:02.699496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.898 [2024-11-28 11:51:02.699548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.898 [2024-11-28 11:51:02.699569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.898 [2024-11-28 11:51:02.707707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.898 [2024-11-28 11:51:02.707737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.898 [2024-11-28 11:51:02.707769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.898 [2024-11-28 11:51:02.713036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.898 [2024-11-28 11:51:02.713070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.898 [2024-11-28 11:51:02.713090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.898 [2024-11-28 11:51:02.722252] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.898 [2024-11-28 11:51:02.722280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.898 [2024-11-28 11:51:02.722318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.898 [2024-11-28 11:51:02.730300] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.898 [2024-11-28 11:51:02.730329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.898 [2024-11-28 11:51:02.730361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.898 [2024-11-28 11:51:02.739657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.898 [2024-11-28 11:51:02.739688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.898 [2024-11-28 11:51:02.739705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.898 [2024-11-28 11:51:02.746974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.898 [2024-11-28 11:51:02.747002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.898 [2024-11-28 11:51:02.747035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.898 [2024-11-28 11:51:02.755314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.898 [2024-11-28 11:51:02.755343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.898 [2024-11-28 11:51:02.755374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.898 [2024-11-28 11:51:02.763315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.898 [2024-11-28 11:51:02.763349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.898 [2024-11-28 11:51:02.763368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.898 [2024-11-28 11:51:02.771974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.898 [2024-11-28 11:51:02.772008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.898 [2024-11-28 11:51:02.772027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.898 [2024-11-28 11:51:02.779782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.898 [2024-11-28 11:51:02.779827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.898 [2024-11-28 11:51:02.779848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.898 [2024-11-28 11:51:02.788146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.898 [2024-11-28 11:51:02.788180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.898 [2024-11-28 11:51:02.788199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.898 [2024-11-28 11:51:02.796006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.796040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.796060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.804295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.804329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.804348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.811984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.812031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.812052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.820226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.820260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.820279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.828003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.828034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.828051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.836104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.836149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.836165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.844360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.844395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.844414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.852077] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.852108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.852140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.858656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.858687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.858726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.866600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.866631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.866648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.874704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.874749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.874766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.882275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.882304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.882336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.890790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.890836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.890855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.900511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.900553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.900573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.909188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.909223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.909242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.918006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.918041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.918060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.927134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.927169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.927188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.935840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.935878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.935896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:42.899 [2024-11-28 11:51:02.944176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:42.899 [2024-11-28 11:51:02.944207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.899 [2024-11-28 11:51:02.944224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.187 [2024-11-28 11:51:02.952829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:02.952863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:02.952881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:02.961978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:02.962010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:02.962028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:02.970623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:02.970655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:02.970672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:02.980007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:02.980041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:02.980060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:02.989420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:02.989454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:02.989473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:02.998473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:02.998506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:02.998535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.007895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.007941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.007960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.017312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.017347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.017366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.026818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.026866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.026885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.036261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.036306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.036323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.045887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.045921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.045940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.054309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.054340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.054358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.062612] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.062643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.062660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.070557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.070602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.070619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.078534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.078564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.078582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.086473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.086522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.086557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.094677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.094708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.094735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.102444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.102479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.102498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.109900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.109931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.109964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.117625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.117656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.117674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.126096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.126131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.126150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.134713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.134745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.134763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.143217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.143252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.143271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.152061] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.152097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.152116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.160141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.160176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.160195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.168749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.188 [2024-11-28 11:51:03.168781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.188 [2024-11-28 11:51:03.168798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.188 [2024-11-28 11:51:03.177490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.189 [2024-11-28 11:51:03.177522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.189 [2024-11-28 11:51:03.177550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.189 [2024-11-28 11:51:03.186265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.189 [2024-11-28 11:51:03.186296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.189 [2024-11-28 11:51:03.186329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.189 [2024-11-28 11:51:03.194102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.189 [2024-11-28 11:51:03.194147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.189 [2024-11-28 11:51:03.194164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.189 [2024-11-28 11:51:03.202069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.189 [2024-11-28 11:51:03.202101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.189 [2024-11-28 11:51:03.202118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.189 [2024-11-28 11:51:03.210719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.189 [2024-11-28 11:51:03.210750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.189 [2024-11-28 11:51:03.210783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.189 [2024-11-28 11:51:03.219221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.189 [2024-11-28 11:51:03.219256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.189 [2024-11-28 11:51:03.219275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.189 [2024-11-28 11:51:03.227044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.189 [2024-11-28 11:51:03.227079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.189 [2024-11-28 11:51:03.227104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.189 [2024-11-28 11:51:03.235352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.189 [2024-11-28 11:51:03.235384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.189 [2024-11-28 11:51:03.235401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.460 [2024-11-28 11:51:03.243275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.460 [2024-11-28 11:51:03.243308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.460 [2024-11-28 11:51:03.243325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.460 [2024-11-28 11:51:03.251274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.460 [2024-11-28 11:51:03.251305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.460 [2024-11-28 11:51:03.251323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.460 [2024-11-28 11:51:03.258818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.460 [2024-11-28 11:51:03.258851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.460 [2024-11-28 11:51:03.258870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.460 [2024-11-28 11:51:03.266967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.460 [2024-11-28 11:51:03.266998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.460 [2024-11-28 11:51:03.267031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.460 [2024-11-28 11:51:03.274551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.460 [2024-11-28 11:51:03.274599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.460 [2024-11-28 11:51:03.274617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.460 [2024-11-28 11:51:03.282771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.460 [2024-11-28 11:51:03.282802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.460 [2024-11-28 11:51:03.282820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.460 [2024-11-28 11:51:03.290875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.460 [2024-11-28 11:51:03.290910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.460 [2024-11-28 11:51:03.290929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.460 [2024-11-28 11:51:03.298615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.460 [2024-11-28 11:51:03.298653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.298671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.306587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.306618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.306635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.311927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.311960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.311979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.319738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.319769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.319786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.327293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.327326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.327346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.335326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.335354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.335386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.343595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.343641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.343659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.351555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.351599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.351616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.360162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.360196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.360216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.368551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.368598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.368615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.376944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.376989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.377006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.385197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.385231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.385250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.392842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.392878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.392897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.401170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.401201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.401218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.409721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.409766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.409782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.418192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.418221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.418238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.426311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.426346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.426365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.434404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.434439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.434464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.442708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.442738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.442755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.450514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.450554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.450573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.458553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.458600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.458618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.466714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.466746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.466762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.475261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.475295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.475315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.483126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.483155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.483186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:43.461 [2024-11-28 11:51:03.491827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1e66bb0) 00:26:43.461 [2024-11-28 11:51:03.491857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:43.461 [2024-11-28 11:51:03.491888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:43.461 00:26:43.461 Latency(us) 00:26:43.461 [2024-11-28T10:51:03.517Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:43.461 [2024-11-28T10:51:03.517Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:43.461 nvme0n1 : 2.00 3820.49 477.56 0.00 0.00 4183.68 813.13 10194.49 00:26:43.461 [2024-11-28T10:51:03.517Z] =================================================================================================================== 00:26:43.461 [2024-11-28T10:51:03.517Z] Total : 3820.49 477.56 0.00 0.00 4183.68 813.13 10194.49 00:26:43.461 0 00:26:43.461 11:51:03 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:43.461 11:51:03 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:43.461 11:51:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:43.462 11:51:03 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:43.462 | .driver_specific 00:26:43.462 | .nvme_error 00:26:43.462 | .status_code 00:26:43.462 | .command_transient_transport_error' 00:26:43.720 11:51:03 -- host/digest.sh@71 -- # (( 246 > 0 )) 00:26:43.720 11:51:03 -- host/digest.sh@73 -- # killprocess 3921547 00:26:43.720 11:51:03 -- common/autotest_common.sh@936 -- # '[' -z 3921547 ']' 00:26:43.979 11:51:03 -- common/autotest_common.sh@940 -- # kill -0 3921547 00:26:43.979 11:51:03 -- common/autotest_common.sh@941 -- # uname 00:26:43.979 11:51:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:43.979 11:51:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3921547 00:26:43.979 11:51:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:43.979 11:51:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:43.979 11:51:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3921547' 00:26:43.979 killing process with pid 3921547 00:26:43.979 11:51:03 -- common/autotest_common.sh@955 -- # kill 3921547 00:26:43.979 Received shutdown signal, test time was about 2.000000 seconds 00:26:43.979 00:26:43.979 Latency(us) 00:26:43.979 [2024-11-28T10:51:04.035Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:43.979 [2024-11-28T10:51:04.035Z] =================================================================================================================== 00:26:43.979 [2024-11-28T10:51:04.035Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:43.979 11:51:03 -- common/autotest_common.sh@960 -- # wait 3921547 00:26:44.237 11:51:04 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:26:44.237 11:51:04 -- host/digest.sh@54 -- # local rw bs qd 00:26:44.237 11:51:04 -- host/digest.sh@56 -- # rw=randwrite 00:26:44.237 11:51:04 -- host/digest.sh@56 -- # bs=4096 00:26:44.237 11:51:04 -- host/digest.sh@56 -- # qd=128 00:26:44.237 11:51:04 -- host/digest.sh@58 -- # bperfpid=3922224 00:26:44.237 11:51:04 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:26:44.237 11:51:04 -- host/digest.sh@60 -- # waitforlisten 3922224 /var/tmp/bperf.sock 00:26:44.237 11:51:04 -- common/autotest_common.sh@829 -- # '[' -z 3922224 ']' 00:26:44.237 11:51:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:44.237 11:51:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:44.237 11:51:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:44.237 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:44.237 11:51:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:44.237 11:51:04 -- common/autotest_common.sh@10 -- # set +x 00:26:44.237 [2024-11-28 11:51:04.130500] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:44.237 [2024-11-28 11:51:04.130601] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3922224 ] 00:26:44.237 EAL: No free 2048 kB hugepages reported on node 1 00:26:44.237 [2024-11-28 11:51:04.188531] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:44.495 [2024-11-28 11:51:04.298762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:45.062 11:51:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:45.062 11:51:05 -- common/autotest_common.sh@862 -- # return 0 00:26:45.062 11:51:05 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:45.062 11:51:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:45.627 11:51:05 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:45.627 11:51:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.627 11:51:05 -- common/autotest_common.sh@10 -- # set +x 00:26:45.627 11:51:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:45.627 11:51:05 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:45.627 11:51:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:45.885 nvme0n1 00:26:45.885 11:51:05 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:45.885 11:51:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.885 11:51:05 -- common/autotest_common.sh@10 -- # set +x 00:26:45.885 11:51:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:45.885 11:51:05 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:45.885 11:51:05 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:45.885 Running I/O for 2 seconds... 00:26:45.885 [2024-11-28 11:51:05.911332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190ee5c8 00:26:45.886 [2024-11-28 11:51:05.911739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:16232 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.886 [2024-11-28 11:51:05.911778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:26:45.886 [2024-11-28 11:51:05.923851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e5ec8 00:26:45.886 [2024-11-28 11:51:05.924168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:2733 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.886 [2024-11-28 11:51:05.924239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:26:45.886 [2024-11-28 11:51:05.937754] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e5ec8 00:26:45.886 [2024-11-28 11:51:05.938130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:7603 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.886 [2024-11-28 11:51:05.938163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:26:46.143 [2024-11-28 11:51:05.951596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e0630 00:26:46.143 [2024-11-28 11:51:05.952058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:447 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.143 [2024-11-28 11:51:05.952155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:26:46.143 [2024-11-28 11:51:05.965390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f4b08 00:26:46.143 [2024-11-28 11:51:05.965853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:5777 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.143 [2024-11-28 11:51:05.965933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:26:46.143 [2024-11-28 11:51:05.981253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0ff8 00:26:46.143 [2024-11-28 11:51:05.983155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:8518 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.143 [2024-11-28 11:51:05.983189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:46.143 [2024-11-28 11:51:05.994955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190edd58 00:26:46.143 [2024-11-28 11:51:05.996830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:6560 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.143 [2024-11-28 11:51:05.996879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:46.143 [2024-11-28 11:51:06.008698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e5658 00:26:46.143 [2024-11-28 11:51:06.010551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:11306 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.010595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.022343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4578 00:26:46.144 [2024-11-28 11:51:06.023405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:10867 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.023439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.034778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4578 00:26:46.144 [2024-11-28 11:51:06.037036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:23016 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.037069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.047177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4578 00:26:46.144 [2024-11-28 11:51:06.047948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:15500 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.047980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.057703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e99d8 00:26:46.144 [2024-11-28 11:51:06.057933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:17923 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.057965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0039 p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.072993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e7c50 00:26:46.144 [2024-11-28 11:51:06.073864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:10822 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.073911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.083835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f1868 00:26:46.144 [2024-11-28 11:51:06.084885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:618 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.084919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.096819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190eb328 00:26:46.144 [2024-11-28 11:51:06.097497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:25287 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.097536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0036 p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.108963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fc560 00:26:46.144 [2024-11-28 11:51:06.110218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:20724 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.110252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.121215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190ef6a8 00:26:46.144 [2024-11-28 11:51:06.122705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:19184 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.122733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.133227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fa7d8 00:26:46.144 [2024-11-28 11:51:06.133772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:24523 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.133815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.148008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f57b0 00:26:46.144 [2024-11-28 11:51:06.149641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:4430 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.149671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.159137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f6cc8 00:26:46.144 [2024-11-28 11:51:06.160283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:19675 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.160318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.171544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f6cc8 00:26:46.144 [2024-11-28 11:51:06.172377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:6409 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.172409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.183886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190ed920 00:26:46.144 [2024-11-28 11:51:06.184656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:19522 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.184684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:26:46.144 [2024-11-28 11:51:06.196575] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f9b30 00:26:46.144 [2024-11-28 11:51:06.197720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:5074 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.144 [2024-11-28 11:51:06.197763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:46.403 [2024-11-28 11:51:06.209165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190df118 00:26:46.403 [2024-11-28 11:51:06.210329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:22978 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.403 [2024-11-28 11:51:06.210368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:46.403 [2024-11-28 11:51:06.221715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fef90 00:26:46.403 [2024-11-28 11:51:06.222519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:16089 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.403 [2024-11-28 11:51:06.222574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:26:46.403 [2024-11-28 11:51:06.234249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0ff8 00:26:46.403 [2024-11-28 11:51:06.235024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:19761 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.403 [2024-11-28 11:51:06.235057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:46.403 [2024-11-28 11:51:06.246487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f81e0 00:26:46.403 [2024-11-28 11:51:06.247216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:17076 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.403 [2024-11-28 11:51:06.247250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:26:46.403 [2024-11-28 11:51:06.258910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fb8b8 00:26:46.403 [2024-11-28 11:51:06.259703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20966 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.403 [2024-11-28 11:51:06.259731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:26:46.403 [2024-11-28 11:51:06.271619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e9168 00:26:46.403 [2024-11-28 11:51:06.273425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:5720 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.403 [2024-11-28 11:51:06.273457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:26:46.403 [2024-11-28 11:51:06.284556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e0a68 00:26:46.403 [2024-11-28 11:51:06.286031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:23851 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.403 [2024-11-28 11:51:06.286134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:26:46.403 [2024-11-28 11:51:06.299614] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e0a68 00:26:46.403 [2024-11-28 11:51:06.300513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:7425 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.403 [2024-11-28 11:51:06.300571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.404 [2024-11-28 11:51:06.313355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e0a68 00:26:46.404 [2024-11-28 11:51:06.314293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:19376 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.404 [2024-11-28 11:51:06.314326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:46.404 [2024-11-28 11:51:06.325990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190ed0b0 00:26:46.404 [2024-11-28 11:51:06.328076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:10028 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.404 [2024-11-28 11:51:06.328114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:46.404 [2024-11-28 11:51:06.338946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f1ca0 00:26:46.404 [2024-11-28 11:51:06.340740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:7669 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.404 [2024-11-28 11:51:06.340825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:26:46.404 [2024-11-28 11:51:06.351340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f1ca0 00:26:46.404 [2024-11-28 11:51:06.353173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:11899 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.404 [2024-11-28 11:51:06.353205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:26:46.404 [2024-11-28 11:51:06.363748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f1ca0 00:26:46.404 [2024-11-28 11:51:06.365603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:11198 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.404 [2024-11-28 11:51:06.365631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:26:46.404 [2024-11-28 11:51:06.376197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f1ca0 00:26:46.404 [2024-11-28 11:51:06.378068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:173 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.404 [2024-11-28 11:51:06.378100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:26:46.404 [2024-11-28 11:51:06.388486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f1ca0 00:26:46.404 [2024-11-28 11:51:06.390328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:21121 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.404 [2024-11-28 11:51:06.390361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:26:46.404 [2024-11-28 11:51:06.401352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fd640 00:26:46.404 [2024-11-28 11:51:06.403088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:15758 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.404 [2024-11-28 11:51:06.403122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:26:46.404 [2024-11-28 11:51:06.413796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4de8 00:26:46.404 [2024-11-28 11:51:06.414717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:7898 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.404 [2024-11-28 11:51:06.414761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:26:46.404 [2024-11-28 11:51:06.426241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190ff3c8 00:26:46.404 [2024-11-28 11:51:06.427251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:21476 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.404 [2024-11-28 11:51:06.427286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:46.404 [2024-11-28 11:51:06.438790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f4f40 00:26:46.404 [2024-11-28 11:51:06.439768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:6388 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.404 [2024-11-28 11:51:06.439813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:26:46.404 [2024-11-28 11:51:06.451163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f8618 00:26:46.404 [2024-11-28 11:51:06.452139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:2397 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.404 [2024-11-28 11:51:06.452172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.463470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f7da8 00:26:46.663 [2024-11-28 11:51:06.465358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:5120 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.465391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.475924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f7da8 00:26:46.663 [2024-11-28 11:51:06.477430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:15750 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.477463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.489180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fcdd0 00:26:46.663 [2024-11-28 11:51:06.489572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:8352 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.489616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.501735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f8e88 00:26:46.663 [2024-11-28 11:51:06.503222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20406 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.503255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.514646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fe2e8 00:26:46.663 [2024-11-28 11:51:06.515025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:2651 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.515058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.527193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e73e0 00:26:46.663 [2024-11-28 11:51:06.528953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:21500 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.528988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.539785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0788 00:26:46.663 [2024-11-28 11:51:06.541380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:8202 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.541413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.552267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fa3a0 00:26:46.663 [2024-11-28 11:51:06.552988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:19223 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.553022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.565062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e23b8 00:26:46.663 [2024-11-28 11:51:06.565711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:22344 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.565740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.577464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e01f8 00:26:46.663 [2024-11-28 11:51:06.579399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24926 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.579433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.589759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190df988 00:26:46.663 [2024-11-28 11:51:06.591103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:24291 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.591136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.602268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fb480 00:26:46.663 [2024-11-28 11:51:06.603667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:18611 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.603697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.617202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f81e0 00:26:46.663 [2024-11-28 11:51:06.618683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:80 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.618712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.629946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190ed0b0 00:26:46.663 [2024-11-28 11:51:06.630874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:22898 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.630944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.642468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e1b48 00:26:46.663 [2024-11-28 11:51:06.644814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:3090 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.644844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.655671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e1710 00:26:46.663 [2024-11-28 11:51:06.656464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:10854 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.656503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.667945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190eb328 00:26:46.663 [2024-11-28 11:51:06.668615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:305 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.668644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.681666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190eb328 00:26:46.663 [2024-11-28 11:51:06.682450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:7089 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.663 [2024-11-28 11:51:06.682483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:26:46.663 [2024-11-28 11:51:06.694156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f96f8 00:26:46.663 [2024-11-28 11:51:06.696581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:24487 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.664 [2024-11-28 11:51:06.696612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:46.664 [2024-11-28 11:51:06.706758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190eb328 00:26:46.664 [2024-11-28 11:51:06.707495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:4290 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.664 [2024-11-28 11:51:06.707584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:26:46.922 [2024-11-28 11:51:06.720139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190eaef0 00:26:46.922 [2024-11-28 11:51:06.721945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20948 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.922 [2024-11-28 11:51:06.722015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:46.922 [2024-11-28 11:51:06.732912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fdeb0 00:26:46.922 [2024-11-28 11:51:06.733615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:3394 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.922 [2024-11-28 11:51:06.733656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:46.922 [2024-11-28 11:51:06.744428] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f96f8 00:26:46.922 [2024-11-28 11:51:06.746498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:1256 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.922 [2024-11-28 11:51:06.746539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:26:46.922 [2024-11-28 11:51:06.756898] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f6458 00:26:46.922 [2024-11-28 11:51:06.758355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:261 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.922 [2024-11-28 11:51:06.758388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:46.922 [2024-11-28 11:51:06.770781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f3a28 00:26:46.922 [2024-11-28 11:51:06.772686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:2136 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.922 [2024-11-28 11:51:06.772772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:26:46.922 [2024-11-28 11:51:06.783244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190df988 00:26:46.922 [2024-11-28 11:51:06.784986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:763 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.922 [2024-11-28 11:51:06.785019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:26:46.922 [2024-11-28 11:51:06.794493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fef90 00:26:46.922 [2024-11-28 11:51:06.795965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:3144 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.922 [2024-11-28 11:51:06.795999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:26:46.922 [2024-11-28 11:51:06.807584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e1f80 00:26:46.922 [2024-11-28 11:51:06.810072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:18208 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.922 [2024-11-28 11:51:06.810106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.922 [2024-11-28 11:51:06.818709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190ea680 00:26:46.922 [2024-11-28 11:51:06.819781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:21253 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.922 [2024-11-28 11:51:06.819808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0032 p:0 m:0 dnr:0 00:26:46.922 [2024-11-28 11:51:06.833301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190de470 00:26:46.922 [2024-11-28 11:51:06.835366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:19302 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.922 [2024-11-28 11:51:06.835432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:26:46.922 [2024-11-28 11:51:06.845655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190de470 00:26:46.922 [2024-11-28 11:51:06.847803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:2410 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.923 [2024-11-28 11:51:06.847850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:26:46.923 [2024-11-28 11:51:06.858751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e88f8 00:26:46.923 [2024-11-28 11:51:06.859511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:23473 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.923 [2024-11-28 11:51:06.859553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:26:46.923 [2024-11-28 11:51:06.870285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0bc0 00:26:46.923 [2024-11-28 11:51:06.873151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:10840 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.923 [2024-11-28 11:51:06.873183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:46.923 [2024-11-28 11:51:06.883728] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fb480 00:26:46.923 [2024-11-28 11:51:06.884490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:4281 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.923 [2024-11-28 11:51:06.884522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:26:46.923 [2024-11-28 11:51:06.896013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fda78 00:26:46.923 [2024-11-28 11:51:06.897029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:8482 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.923 [2024-11-28 11:51:06.897062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:46.923 [2024-11-28 11:51:06.909005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fc998 00:26:46.923 [2024-11-28 11:51:06.910602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:7687 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.923 [2024-11-28 11:51:06.910632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:26:46.923 [2024-11-28 11:51:06.921125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0bc0 00:26:46.923 [2024-11-28 11:51:06.922656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:22269 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.923 [2024-11-28 11:51:06.922686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:26:46.923 [2024-11-28 11:51:06.934464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f6020 00:26:46.923 [2024-11-28 11:51:06.935141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:8924 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.923 [2024-11-28 11:51:06.935212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:26:46.923 [2024-11-28 11:51:06.948111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e8d30 00:26:46.923 [2024-11-28 11:51:06.948776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:22387 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.923 [2024-11-28 11:51:06.948839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:46.923 [2024-11-28 11:51:06.961715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e0ea0 00:26:46.923 [2024-11-28 11:51:06.962518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:14884 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.923 [2024-11-28 11:51:06.962573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:26:46.923 [2024-11-28 11:51:06.974351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f20d8 00:26:46.923 [2024-11-28 11:51:06.976259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:13263 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.923 [2024-11-28 11:51:06.976327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:06.986963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f20d8 00:26:47.182 [2024-11-28 11:51:06.988750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:4454 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:06.988843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:06.999396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f20d8 00:26:47.182 [2024-11-28 11:51:07.001321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:6544 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.001354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.011935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f20d8 00:26:47.182 [2024-11-28 11:51:07.013681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:3765 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.013739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.024381] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f20d8 00:26:47.182 [2024-11-28 11:51:07.026121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:3033 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.026154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.036834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f20d8 00:26:47.182 [2024-11-28 11:51:07.038469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:415 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.038547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.049601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f9f68 00:26:47.182 [2024-11-28 11:51:07.050068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:10205 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.050100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.061921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190de8a8 00:26:47.182 [2024-11-28 11:51:07.062365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:12060 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.062398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.075646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190de8a8 00:26:47.182 [2024-11-28 11:51:07.076224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:22615 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.076257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.089282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190eaab8 00:26:47.182 [2024-11-28 11:51:07.089724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:23678 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.089785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.102920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f92c0 00:26:47.182 [2024-11-28 11:51:07.103456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:10223 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.103488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.116435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e1710 00:26:47.182 [2024-11-28 11:51:07.117025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:24934 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.117090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.129818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fef90 00:26:47.182 [2024-11-28 11:51:07.130311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:6836 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.130418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.143326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f20d8 00:26:47.182 [2024-11-28 11:51:07.143897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:18603 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.143998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.156049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f6020 00:26:47.182 [2024-11-28 11:51:07.157673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:648 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.157703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.168486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f4b08 00:26:47.182 [2024-11-28 11:51:07.169454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:22611 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.169487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.181392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e88f8 00:26:47.182 [2024-11-28 11:51:07.181571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:6797 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.181600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.195011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e88f8 00:26:47.182 [2024-11-28 11:51:07.195186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:22654 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.182 [2024-11-28 11:51:07.195218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:26:47.182 [2024-11-28 11:51:07.210932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190de038 00:26:47.183 [2024-11-28 11:51:07.211799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:6554 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.183 [2024-11-28 11:51:07.211827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.183 [2024-11-28 11:51:07.223296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f6458 00:26:47.183 [2024-11-28 11:51:07.224248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:15700 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.183 [2024-11-28 11:51:07.224281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:47.183 [2024-11-28 11:51:07.236044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f6458 00:26:47.441 [2024-11-28 11:51:07.238182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:4011 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.441 [2024-11-28 11:51:07.238215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:47.441 [2024-11-28 11:51:07.249210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0350 00:26:47.441 [2024-11-28 11:51:07.251088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:21500 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.441 [2024-11-28 11:51:07.251121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:47.441 [2024-11-28 11:51:07.261745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0350 00:26:47.441 [2024-11-28 11:51:07.263454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:7756 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.441 [2024-11-28 11:51:07.263582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.274115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0350 00:26:47.442 [2024-11-28 11:51:07.275910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:22151 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.275988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.286504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0350 00:26:47.442 [2024-11-28 11:51:07.288281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:17420 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.288374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.299080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0350 00:26:47.442 [2024-11-28 11:51:07.300832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:25312 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.300953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.311306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0350 00:26:47.442 [2024-11-28 11:51:07.313092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:16111 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.313159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.323792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0350 00:26:47.442 [2024-11-28 11:51:07.325413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:20669 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.325522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.336031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0350 00:26:47.442 [2024-11-28 11:51:07.337714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:6618 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.337743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.348549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0350 00:26:47.442 [2024-11-28 11:51:07.350285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:14991 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.350318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.361007] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0350 00:26:47.442 [2024-11-28 11:51:07.362653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:7431 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.362681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.373735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e6b70 00:26:47.442 [2024-11-28 11:51:07.374155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:8563 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.374188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.386378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e7818 00:26:47.442 [2024-11-28 11:51:07.386860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:6513 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.386907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.398511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4140 00:26:47.442 [2024-11-28 11:51:07.400462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:24609 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.400496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.410806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4140 00:26:47.442 [2024-11-28 11:51:07.412517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:22344 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.412574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.423366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4140 00:26:47.442 [2024-11-28 11:51:07.424939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:17627 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.424973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.435909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4140 00:26:47.442 [2024-11-28 11:51:07.437450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:12125 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.437488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.448039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4140 00:26:47.442 [2024-11-28 11:51:07.449537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:22110 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.449568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.460478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4140 00:26:47.442 [2024-11-28 11:51:07.462025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:6036 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.462094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.472911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4140 00:26:47.442 [2024-11-28 11:51:07.474386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:2004 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.474418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:26:47.442 [2024-11-28 11:51:07.487731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f9b30 00:26:47.442 [2024-11-28 11:51:07.488796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24153 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.442 [2024-11-28 11:51:07.488845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.501580] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f9b30 00:26:47.702 [2024-11-28 11:51:07.502487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:6078 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.502519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.515188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e3498 00:26:47.702 [2024-11-28 11:51:07.516143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:20738 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.516212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.527837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190eaef0 00:26:47.702 [2024-11-28 11:51:07.529817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:23020 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.529861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.540805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4de8 00:26:47.702 [2024-11-28 11:51:07.542630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:13647 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.542694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.553210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4de8 00:26:47.702 [2024-11-28 11:51:07.554987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:4199 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.555019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.565472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4de8 00:26:47.702 [2024-11-28 11:51:07.567344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:17873 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.567377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.577997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e4de8 00:26:47.702 [2024-11-28 11:51:07.579660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:11108 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.579721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.590742] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e5ec8 00:26:47.702 [2024-11-28 11:51:07.591215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:19804 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.591246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.603079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190dece0 00:26:47.702 [2024-11-28 11:51:07.603661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:5170 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.603689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.616770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190dece0 00:26:47.702 [2024-11-28 11:51:07.617268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:5496 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.617300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.630466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e6b70 00:26:47.702 [2024-11-28 11:51:07.630968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:11051 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.631035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.644069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e7818 00:26:47.702 [2024-11-28 11:51:07.644603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:22477 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.644633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.657903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f8e88 00:26:47.702 [2024-11-28 11:51:07.658467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:2213 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.658569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.670583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190ee190 00:26:47.702 [2024-11-28 11:51:07.672362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:16024 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.672391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.682604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190ec840 00:26:47.702 [2024-11-28 11:51:07.683461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:4321 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.683494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.695679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190ee190 00:26:47.702 [2024-11-28 11:51:07.696035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:7195 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.696078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.707279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0788 00:26:47.702 [2024-11-28 11:51:07.707482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:22265 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.707511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.720864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f0788 00:26:47.702 [2024-11-28 11:51:07.721121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:20743 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.721158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.733237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190de8a8 00:26:47.702 [2024-11-28 11:51:07.735144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:13013 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.702 [2024-11-28 11:51:07.735191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:26:47.702 [2024-11-28 11:51:07.745620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190ec840 00:26:47.703 [2024-11-28 11:51:07.746749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:4594 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.703 [2024-11-28 11:51:07.746825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:26:47.960 [2024-11-28 11:51:07.757718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fc560 00:26:47.961 [2024-11-28 11:51:07.758909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:8725 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.961 [2024-11-28 11:51:07.758938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:26:47.961 [2024-11-28 11:51:07.772298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190eb760 00:26:47.961 [2024-11-28 11:51:07.774233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:22470 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.961 [2024-11-28 11:51:07.774275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.961 [2024-11-28 11:51:07.783639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e0a68 00:26:47.961 [2024-11-28 11:51:07.785957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:16389 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.961 [2024-11-28 11:51:07.786028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.961 [2024-11-28 11:51:07.796270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f81e0 00:26:47.961 [2024-11-28 11:51:07.797892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:14126 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.961 [2024-11-28 11:51:07.797927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.961 [2024-11-28 11:51:07.808306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190eb760 00:26:47.961 [2024-11-28 11:51:07.809085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:20624 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.961 [2024-11-28 11:51:07.809153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:26:47.961 [2024-11-28 11:51:07.821311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190ea248 00:26:47.961 [2024-11-28 11:51:07.822043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:12042 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.961 [2024-11-28 11:51:07.822076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:26:47.961 [2024-11-28 11:51:07.833827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e84c0 00:26:47.961 [2024-11-28 11:51:07.834599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:12836 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.961 [2024-11-28 11:51:07.834629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:26:47.961 [2024-11-28 11:51:07.846409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190ef6a8 00:26:47.961 [2024-11-28 11:51:07.847339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:14811 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.961 [2024-11-28 11:51:07.847372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:26:47.961 [2024-11-28 11:51:07.858681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e6300 00:26:47.961 [2024-11-28 11:51:07.860671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:7857 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.961 [2024-11-28 11:51:07.860698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:26:47.961 [2024-11-28 11:51:07.870822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190f2510 00:26:47.961 [2024-11-28 11:51:07.872423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:18999 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.961 [2024-11-28 11:51:07.872455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:26:47.961 [2024-11-28 11:51:07.883279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190fef90 00:26:47.961 [2024-11-28 11:51:07.884555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:13199 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.961 [2024-11-28 11:51:07.884598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:26:47.961 [2024-11-28 11:51:07.895965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59ad0) with pdu=0x2000190e7c50 00:26:47.961 [2024-11-28 11:51:07.896635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:7733 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:47.961 [2024-11-28 11:51:07.896665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:26:47.961 00:26:47.961 Latency(us) 00:26:47.961 [2024-11-28T10:51:08.017Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:47.961 [2024-11-28T10:51:08.017Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:47.961 nvme0n1 : 2.01 19932.00 77.86 0.00 0.00 6414.10 2791.35 17087.91 00:26:47.961 [2024-11-28T10:51:08.017Z] =================================================================================================================== 00:26:47.961 [2024-11-28T10:51:08.017Z] Total : 19932.00 77.86 0.00 0.00 6414.10 2791.35 17087.91 00:26:47.961 0 00:26:47.961 11:51:07 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:47.961 11:51:07 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:47.961 11:51:07 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:47.961 11:51:07 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:47.961 | .driver_specific 00:26:47.961 | .nvme_error 00:26:47.961 | .status_code 00:26:47.961 | .command_transient_transport_error' 00:26:48.218 11:51:08 -- host/digest.sh@71 -- # (( 156 > 0 )) 00:26:48.219 11:51:08 -- host/digest.sh@73 -- # killprocess 3922224 00:26:48.219 11:51:08 -- common/autotest_common.sh@936 -- # '[' -z 3922224 ']' 00:26:48.219 11:51:08 -- common/autotest_common.sh@940 -- # kill -0 3922224 00:26:48.219 11:51:08 -- common/autotest_common.sh@941 -- # uname 00:26:48.219 11:51:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:48.219 11:51:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3922224 00:26:48.219 11:51:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:48.219 11:51:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:48.219 11:51:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3922224' 00:26:48.219 killing process with pid 3922224 00:26:48.219 11:51:08 -- common/autotest_common.sh@955 -- # kill 3922224 00:26:48.219 Received shutdown signal, test time was about 2.000000 seconds 00:26:48.219 00:26:48.219 Latency(us) 00:26:48.219 [2024-11-28T10:51:08.275Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:48.219 [2024-11-28T10:51:08.275Z] =================================================================================================================== 00:26:48.219 [2024-11-28T10:51:08.275Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:48.219 11:51:08 -- common/autotest_common.sh@960 -- # wait 3922224 00:26:48.476 11:51:08 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:26:48.476 11:51:08 -- host/digest.sh@54 -- # local rw bs qd 00:26:48.476 11:51:08 -- host/digest.sh@56 -- # rw=randwrite 00:26:48.476 11:51:08 -- host/digest.sh@56 -- # bs=131072 00:26:48.476 11:51:08 -- host/digest.sh@56 -- # qd=16 00:26:48.476 11:51:08 -- host/digest.sh@58 -- # bperfpid=3923179 00:26:48.476 11:51:08 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:26:48.476 11:51:08 -- host/digest.sh@60 -- # waitforlisten 3923179 /var/tmp/bperf.sock 00:26:48.476 11:51:08 -- common/autotest_common.sh@829 -- # '[' -z 3923179 ']' 00:26:48.476 11:51:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:48.476 11:51:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:48.476 11:51:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:48.476 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:48.476 11:51:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:48.477 11:51:08 -- common/autotest_common.sh@10 -- # set +x 00:26:48.734 [2024-11-28 11:51:08.536657] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:48.735 [2024-11-28 11:51:08.536744] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3923179 ] 00:26:48.735 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:48.735 Zero copy mechanism will not be used. 00:26:48.735 EAL: No free 2048 kB hugepages reported on node 1 00:26:48.735 [2024-11-28 11:51:08.599386] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:48.735 [2024-11-28 11:51:08.718484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:49.670 11:51:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:49.670 11:51:09 -- common/autotest_common.sh@862 -- # return 0 00:26:49.670 11:51:09 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:49.670 11:51:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:49.928 11:51:09 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:49.928 11:51:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:49.928 11:51:09 -- common/autotest_common.sh@10 -- # set +x 00:26:49.928 11:51:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:49.928 11:51:09 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:49.928 11:51:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:50.186 nvme0n1 00:26:50.186 11:51:10 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:26:50.186 11:51:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:50.186 11:51:10 -- common/autotest_common.sh@10 -- # set +x 00:26:50.186 11:51:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:50.186 11:51:10 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:50.186 11:51:10 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:50.444 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:50.444 Zero copy mechanism will not be used. 00:26:50.444 Running I/O for 2 seconds... 00:26:50.444 [2024-11-28 11:51:10.301742] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.302003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.302053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.308726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.308881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.308973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.314766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.314967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.315037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.320885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.321084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.321153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.326713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.326857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.326887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.332957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.333121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.333186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.339225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.339370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.339403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.345490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.345732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.345763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.351676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.351867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.351899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.357876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.358142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.358225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.363980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.364155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.364188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.370121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.370279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.370318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.376158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.376319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.376352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.382404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.382598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.382628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.388678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.388768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.388806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.395139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.395442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.444 [2024-11-28 11:51:10.395476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.444 [2024-11-28 11:51:10.401654] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.444 [2024-11-28 11:51:10.401921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.401955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.407799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.408172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.408206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.413735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.413824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.413874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.419893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.420058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.420090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.426258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.426365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.426395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.432332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.432429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.432458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.438550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.438662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.438693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.444422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.444790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.444821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.449767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.450149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.450220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.455155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.455394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.455426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.460009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.460158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.460206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.465188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.465573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.465633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.470103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.470479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.470511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.475065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.475399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.475429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.480108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.480422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.480500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.485113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.485341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.485372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.490203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.490471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.490500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.445 [2024-11-28 11:51:10.495133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.445 [2024-11-28 11:51:10.495510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.445 [2024-11-28 11:51:10.495549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.499841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.500126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.500213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.504861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.505165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.505237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.510052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.510366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.510427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.515100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.515319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.515354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.520306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.520666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.520697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.525263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.525582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.525656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.529941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.530205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.530290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.534951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.535115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.535196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.539953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.540211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.540265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.544789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.545185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.545229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.549693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.549879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.549910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.555246] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.555515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.555554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.560464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.560780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.560874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.565462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.565754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.565808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.570350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.570674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.570739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.575324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.575674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.575704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.580189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.580477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.580507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.585097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.585347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.585378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.589919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.590286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.590317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.594870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.595202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.595240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.599983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.600105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.600186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.604818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.605228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.705 [2024-11-28 11:51:10.605288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.705 [2024-11-28 11:51:10.609823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.705 [2024-11-28 11:51:10.610121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.610179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.614638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.614891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.614921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.619562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.619859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.619940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.624556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.624914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.624944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.629791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.630040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.630070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.634965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.635211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.635323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.640536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.640837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.640867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.646190] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.646296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.646334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.651617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.651927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.651956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.656465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.656851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.656927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.661295] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.661628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.661681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.666420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.666757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.666787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.671259] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.671650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.671680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.676048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.676323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.676352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.681141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.681440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.681519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.686143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.686440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.686470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.691064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.691322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.691406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.696232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.696494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.696567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.701200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.701469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.701499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.706301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.706571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.706616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.711020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.711299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.711340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.715826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.716001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.716068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.720861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.721133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.721162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.726032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.726319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.726365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.731071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.731320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.731388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.735943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.736299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.736329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.740843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.741103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.741183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.706 [2024-11-28 11:51:10.745801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.706 [2024-11-28 11:51:10.745999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.706 [2024-11-28 11:51:10.746052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.707 [2024-11-28 11:51:10.751188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.707 [2024-11-28 11:51:10.751536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.707 [2024-11-28 11:51:10.751566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.707 [2024-11-28 11:51:10.756238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.707 [2024-11-28 11:51:10.756631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.707 [2024-11-28 11:51:10.756718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.966 [2024-11-28 11:51:10.761191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.966 [2024-11-28 11:51:10.761702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.966 [2024-11-28 11:51:10.761732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.966 [2024-11-28 11:51:10.765965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.966 [2024-11-28 11:51:10.766305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.966 [2024-11-28 11:51:10.766337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.966 [2024-11-28 11:51:10.770926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.966 [2024-11-28 11:51:10.771149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.966 [2024-11-28 11:51:10.771179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.966 [2024-11-28 11:51:10.776258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.966 [2024-11-28 11:51:10.776444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.966 [2024-11-28 11:51:10.776535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.966 [2024-11-28 11:51:10.781151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.966 [2024-11-28 11:51:10.781497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.966 [2024-11-28 11:51:10.781535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.966 [2024-11-28 11:51:10.786005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.966 [2024-11-28 11:51:10.786198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.966 [2024-11-28 11:51:10.786227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.966 [2024-11-28 11:51:10.790896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.966 [2024-11-28 11:51:10.791237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.966 [2024-11-28 11:51:10.791267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.966 [2024-11-28 11:51:10.795782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.966 [2024-11-28 11:51:10.796052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.966 [2024-11-28 11:51:10.796130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.966 [2024-11-28 11:51:10.800590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.966 [2024-11-28 11:51:10.800829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.966 [2024-11-28 11:51:10.800905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.966 [2024-11-28 11:51:10.805275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.966 [2024-11-28 11:51:10.805606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.966 [2024-11-28 11:51:10.805669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.966 [2024-11-28 11:51:10.810234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.966 [2024-11-28 11:51:10.810517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.966 [2024-11-28 11:51:10.810599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.966 [2024-11-28 11:51:10.815428] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.966 [2024-11-28 11:51:10.815716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.966 [2024-11-28 11:51:10.815747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.820051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.820308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.820362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.825107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.825334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.825364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.830240] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.830409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.830491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.835109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.835263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.835309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.840037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.840385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.840414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.845620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.845852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.845925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.852100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.852581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.852620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.858757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.858914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.858943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.865685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.865853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.865882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.872442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.872647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.872676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.879139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.879289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.879337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.886146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.886292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.886343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.893075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.893291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.893320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.900416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.900579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.900608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.907521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.907974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.908007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.914816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.915164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.915259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.921885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.922106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.922136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.928866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.929115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.929164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.935769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.935943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.935973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.942664] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.942843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.942872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.948814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.949008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.949104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.955154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.955363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.955439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.961598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.961889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.961919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.966765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.967217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.967272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.972035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.972290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.972334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.976923] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.977135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.967 [2024-11-28 11:51:10.977164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.967 [2024-11-28 11:51:10.981920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.967 [2024-11-28 11:51:10.982087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.968 [2024-11-28 11:51:10.982153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.968 [2024-11-28 11:51:10.987029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.968 [2024-11-28 11:51:10.987316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.968 [2024-11-28 11:51:10.987382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.968 [2024-11-28 11:51:10.991874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.968 [2024-11-28 11:51:10.992143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.968 [2024-11-28 11:51:10.992173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.968 [2024-11-28 11:51:10.996976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.968 [2024-11-28 11:51:10.997430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.968 [2024-11-28 11:51:10.997539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.968 [2024-11-28 11:51:11.001936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.968 [2024-11-28 11:51:11.002208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.968 [2024-11-28 11:51:11.002241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.968 [2024-11-28 11:51:11.007190] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.968 [2024-11-28 11:51:11.007399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.968 [2024-11-28 11:51:11.007430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.968 [2024-11-28 11:51:11.012413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.968 [2024-11-28 11:51:11.012655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.968 [2024-11-28 11:51:11.012685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.968 [2024-11-28 11:51:11.017361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:50.968 [2024-11-28 11:51:11.017703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.968 [2024-11-28 11:51:11.017781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.022543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.022932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.023027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.027465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.027956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.027986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.032465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.032778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.032808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.037366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.037619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.037700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.042374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.042707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.042799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.047971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.048281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.048312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.054194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.054507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.054545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.061347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.061651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.061681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.068123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.068429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.068462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.075567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.075882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.075920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.082131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.082326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.082355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.089547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.089747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.089776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.097211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.097416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.097446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.104818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.105004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.105063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.111413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.111601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.111631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.118673] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.118993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.119022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.125860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.126080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.126162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.132914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.133265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.133325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.140408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.140712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.140775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.148109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.148314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.148343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.155852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.156155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.156212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.227 [2024-11-28 11:51:11.163514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.227 [2024-11-28 11:51:11.163747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.227 [2024-11-28 11:51:11.163828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.171133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.171340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.171369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.178680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.178939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.178968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.186098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.186289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.186318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.192783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.192988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.193018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.200131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.200297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.200329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.207806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.207961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.207991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.214471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.214656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.214686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.220301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.220517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.220617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.225618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.225835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.225883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.231086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.231418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.231470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.237693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.238058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.238120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.245422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.245628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.245657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.252228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.252558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.252588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.257818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.258014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.258088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.262666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.262799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.262860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.267769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.267953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.268036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.272605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.272853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.272882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.228 [2024-11-28 11:51:11.277939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.228 [2024-11-28 11:51:11.278295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.228 [2024-11-28 11:51:11.278354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.487 [2024-11-28 11:51:11.283847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.487 [2024-11-28 11:51:11.284127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.487 [2024-11-28 11:51:11.284158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.487 [2024-11-28 11:51:11.290931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.487 [2024-11-28 11:51:11.291126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.487 [2024-11-28 11:51:11.291156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.487 [2024-11-28 11:51:11.297773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.487 [2024-11-28 11:51:11.298096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.487 [2024-11-28 11:51:11.298141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.487 [2024-11-28 11:51:11.304857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.487 [2024-11-28 11:51:11.305174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.487 [2024-11-28 11:51:11.305208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.487 [2024-11-28 11:51:11.312522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.487 [2024-11-28 11:51:11.312684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.487 [2024-11-28 11:51:11.312714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.487 [2024-11-28 11:51:11.320442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.487 [2024-11-28 11:51:11.320644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.487 [2024-11-28 11:51:11.320673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.487 [2024-11-28 11:51:11.327887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.487 [2024-11-28 11:51:11.328031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.487 [2024-11-28 11:51:11.328075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.487 [2024-11-28 11:51:11.335252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.487 [2024-11-28 11:51:11.335418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.487 [2024-11-28 11:51:11.335463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.487 [2024-11-28 11:51:11.343140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.487 [2024-11-28 11:51:11.343313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.487 [2024-11-28 11:51:11.343342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.487 [2024-11-28 11:51:11.350933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.487 [2024-11-28 11:51:11.351161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.487 [2024-11-28 11:51:11.351190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.487 [2024-11-28 11:51:11.358366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.487 [2024-11-28 11:51:11.358620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.487 [2024-11-28 11:51:11.358704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.487 [2024-11-28 11:51:11.366046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.487 [2024-11-28 11:51:11.366343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.487 [2024-11-28 11:51:11.366390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.487 [2024-11-28 11:51:11.373012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.487 [2024-11-28 11:51:11.373306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.487 [2024-11-28 11:51:11.373342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.487 [2024-11-28 11:51:11.380466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.487 [2024-11-28 11:51:11.380741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.487 [2024-11-28 11:51:11.380771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.387698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.387853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.387894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.393251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.393454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.393513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.398884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.399070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.399100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.404038] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.404226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.404256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.409650] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.409892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.409942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.415326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.415518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.415597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.420555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.420883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.420913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.425349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.425714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.425749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.430133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.430546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.430615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.435117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.435263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.435323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.439921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.440190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.440220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.444931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.445194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.445224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.450197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.450431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.450474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.454989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.455280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.455351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.460286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.460645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.460721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.465035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.465230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.465260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.469954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.470334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.470364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.474867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.475073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.475126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.479944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.480079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.480120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.485125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.485485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.485575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.490886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.491127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.491159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.497149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.497506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.497545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.503491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.503722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.503752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.509871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.510177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.510249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.515829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.516156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.516185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.523088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.523287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.523317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.528884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.488 [2024-11-28 11:51:11.529138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.488 [2024-11-28 11:51:11.529218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.488 [2024-11-28 11:51:11.534284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.489 [2024-11-28 11:51:11.534607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.489 [2024-11-28 11:51:11.534675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.489 [2024-11-28 11:51:11.540183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.489 [2024-11-28 11:51:11.540292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.489 [2024-11-28 11:51:11.540347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.546031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.546327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.546381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.551919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.552071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.552099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.557701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.557795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.557824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.563636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.563749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.563777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.569409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.569516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.569562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.575277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.575387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.575415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.581290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.581615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.581666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.587452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.587730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.587760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.594425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.594690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.594728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.601925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.602099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.602128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.609105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.609278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.609379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.616206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.616461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.616498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.623588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.623832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.623866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.630211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.630544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.630574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.636238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.636636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.636671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.641788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.642067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.642111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.648005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.648137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.648189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.653808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.653939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.653968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.660023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.660212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.660257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.666214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.666366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.666394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.672003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.672216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.672246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.678091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.678277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.678322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.748 [2024-11-28 11:51:11.684319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.748 [2024-11-28 11:51:11.684507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.748 [2024-11-28 11:51:11.684552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.690439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.690629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.690659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.696819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.697138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.697168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.702982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.703201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.703231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.708998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.709163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.709192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.714277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.714614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.714644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.719403] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.719579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.719626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.724546] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.724810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.724872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.729485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.729776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.729865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.734597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.734787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.734872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.740040] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.740382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.740430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.745264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.745653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.745683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.750561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.750680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.750744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.756413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.756601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.756659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.763883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.764048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.764077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.771417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.771620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.771651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.778041] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.778265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.778295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.784918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.785122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.785151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.792054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.792328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.792358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:51.749 [2024-11-28 11:51:11.799063] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:51.749 [2024-11-28 11:51:11.799218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:51.749 [2024-11-28 11:51:11.799249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.008 [2024-11-28 11:51:11.805881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.008 [2024-11-28 11:51:11.806207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.008 [2024-11-28 11:51:11.806248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.008 [2024-11-28 11:51:11.812564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.008 [2024-11-28 11:51:11.812782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.008 [2024-11-28 11:51:11.812812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.008 [2024-11-28 11:51:11.819673] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.008 [2024-11-28 11:51:11.819828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.008 [2024-11-28 11:51:11.819858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.008 [2024-11-28 11:51:11.826690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.008 [2024-11-28 11:51:11.827045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.008 [2024-11-28 11:51:11.827075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.008 [2024-11-28 11:51:11.833301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.833456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.833485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.840089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.840277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.840325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.847045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.847267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.847332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.853865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.854065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.854093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.860589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.860720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.860753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.867205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.867377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.867406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.873182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.873445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.873479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.878358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.878895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.878958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.883423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.883791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.883862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.888676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.888790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.888821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.893500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.893803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.893844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.898523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.898728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.898797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.903718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.903981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.904012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.908947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.909126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.909156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.913755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.913918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.914027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.918643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.918995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.919087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.923477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.923665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.923753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.928427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.928648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.928677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.933293] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.933449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.933492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.938162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.938504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.938590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.943355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.943679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.943709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.948331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.948512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.948599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.953339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.953698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.953730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.958137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.958444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.958473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.962959] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.963240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.963277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.967906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.968185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.968216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.972848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.009 [2024-11-28 11:51:11.973031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.009 [2024-11-28 11:51:11.973079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.009 [2024-11-28 11:51:11.978094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:11.978388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:11.978419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:11.983352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:11.983790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:11.983870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:11.988963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:11.989216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:11.989246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:11.994465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:11.994713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:11.994762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:11.999231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:11.999645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:11.999676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:12.004479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:12.004850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:12.004930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:12.009415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:12.009667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:12.009749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:12.015106] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:12.015379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:12.015436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:12.020375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:12.020735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:12.020766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:12.025100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:12.025333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:12.025403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:12.029874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:12.030222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:12.030256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:12.034910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:12.035072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:12.035109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:12.040630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:12.040745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:12.040774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:12.045667] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:12.045915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:12.045984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:12.050675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:12.050931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:12.050961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:12.055633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:12.055819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:12.055888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.010 [2024-11-28 11:51:12.060665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.010 [2024-11-28 11:51:12.061002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.010 [2024-11-28 11:51:12.061032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.269 [2024-11-28 11:51:12.065855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.269 [2024-11-28 11:51:12.066128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.269 [2024-11-28 11:51:12.066158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.269 [2024-11-28 11:51:12.071293] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.269 [2024-11-28 11:51:12.071418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.269 [2024-11-28 11:51:12.071446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.269 [2024-11-28 11:51:12.077134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.269 [2024-11-28 11:51:12.077298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.269 [2024-11-28 11:51:12.077327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.269 [2024-11-28 11:51:12.083137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.269 [2024-11-28 11:51:12.083331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.269 [2024-11-28 11:51:12.083362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.089154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.089480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.089509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.095100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.095446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.095476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.101027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.101154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.101208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.107113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.107292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.107321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.112979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.113115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.113144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.118914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.119060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.119089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.125062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.125365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.125410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.131333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.131583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.131657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.138429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.138780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.138821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.144893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.145182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.145226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.150683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.150862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.150976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.157038] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.157248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.157278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.164430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.164736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.164800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.169971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.170392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.170428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.175586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.175806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.175851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.181473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.181631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.181661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.187219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.187398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.187455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.193797] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.194155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.194185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.201591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.201734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.201767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.208606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.208719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.208751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.215678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.215871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.215900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.223753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.224002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.224032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.231304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.231638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.231675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.239148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.239441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.239504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.246836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.247114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.247144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.254825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.255013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.255042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.270 [2024-11-28 11:51:12.261908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.270 [2024-11-28 11:51:12.262069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.270 [2024-11-28 11:51:12.262100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.271 [2024-11-28 11:51:12.267265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.271 [2024-11-28 11:51:12.267611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.271 [2024-11-28 11:51:12.267641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.271 [2024-11-28 11:51:12.272351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.271 [2024-11-28 11:51:12.272502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.271 [2024-11-28 11:51:12.272603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.271 [2024-11-28 11:51:12.277267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.271 [2024-11-28 11:51:12.277387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.271 [2024-11-28 11:51:12.277460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:52.271 [2024-11-28 11:51:12.282111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.271 [2024-11-28 11:51:12.282408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.271 [2024-11-28 11:51:12.282458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:52.271 [2024-11-28 11:51:12.287183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.271 [2024-11-28 11:51:12.287408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.271 [2024-11-28 11:51:12.287438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:52.271 [2024-11-28 11:51:12.292073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xa59fb0) with pdu=0x2000190fef90 00:26:52.271 [2024-11-28 11:51:12.292232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.271 [2024-11-28 11:51:12.292302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:52.271 00:26:52.271 Latency(us) 00:26:52.271 [2024-11-28T10:51:12.327Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:52.271 [2024-11-28T10:51:12.327Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:52.271 nvme0n1 : 2.00 5300.86 662.61 0.00 0.00 3008.73 1893.26 11311.03 00:26:52.271 [2024-11-28T10:51:12.327Z] =================================================================================================================== 00:26:52.271 [2024-11-28T10:51:12.327Z] Total : 5300.86 662.61 0.00 0.00 3008.73 1893.26 11311.03 00:26:52.271 0 00:26:52.271 11:51:12 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:52.271 11:51:12 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:52.271 11:51:12 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:52.271 | .driver_specific 00:26:52.271 | .nvme_error 00:26:52.271 | .status_code 00:26:52.271 | .command_transient_transport_error' 00:26:52.271 11:51:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:52.529 11:51:12 -- host/digest.sh@71 -- # (( 342 > 0 )) 00:26:52.529 11:51:12 -- host/digest.sh@73 -- # killprocess 3923179 00:26:52.529 11:51:12 -- common/autotest_common.sh@936 -- # '[' -z 3923179 ']' 00:26:52.529 11:51:12 -- common/autotest_common.sh@940 -- # kill -0 3923179 00:26:52.529 11:51:12 -- common/autotest_common.sh@941 -- # uname 00:26:52.529 11:51:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:52.529 11:51:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3923179 00:26:52.787 11:51:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:52.787 11:51:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:52.787 11:51:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3923179' 00:26:52.787 killing process with pid 3923179 00:26:52.787 11:51:12 -- common/autotest_common.sh@955 -- # kill 3923179 00:26:52.787 Received shutdown signal, test time was about 2.000000 seconds 00:26:52.787 00:26:52.787 Latency(us) 00:26:52.787 [2024-11-28T10:51:12.843Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:52.787 [2024-11-28T10:51:12.843Z] =================================================================================================================== 00:26:52.787 [2024-11-28T10:51:12.843Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:52.787 11:51:12 -- common/autotest_common.sh@960 -- # wait 3923179 00:26:53.045 11:51:12 -- host/digest.sh@115 -- # killprocess 3920970 00:26:53.045 11:51:12 -- common/autotest_common.sh@936 -- # '[' -z 3920970 ']' 00:26:53.045 11:51:12 -- common/autotest_common.sh@940 -- # kill -0 3920970 00:26:53.045 11:51:12 -- common/autotest_common.sh@941 -- # uname 00:26:53.045 11:51:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:53.045 11:51:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3920970 00:26:53.045 11:51:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:53.045 11:51:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:53.045 11:51:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3920970' 00:26:53.045 killing process with pid 3920970 00:26:53.045 11:51:12 -- common/autotest_common.sh@955 -- # kill 3920970 00:26:53.045 11:51:12 -- common/autotest_common.sh@960 -- # wait 3920970 00:26:53.303 00:26:53.303 real 0m18.607s 00:26:53.303 user 0m35.434s 00:26:53.303 sys 0m5.100s 00:26:53.303 11:51:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:53.303 11:51:13 -- common/autotest_common.sh@10 -- # set +x 00:26:53.303 ************************************ 00:26:53.303 END TEST nvmf_digest_error 00:26:53.303 ************************************ 00:26:53.303 11:51:13 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:26:53.303 11:51:13 -- host/digest.sh@139 -- # nvmftestfini 00:26:53.303 11:51:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:53.303 11:51:13 -- nvmf/common.sh@116 -- # sync 00:26:53.303 11:51:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:53.303 11:51:13 -- nvmf/common.sh@119 -- # set +e 00:26:53.303 11:51:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:53.303 11:51:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:53.303 rmmod nvme_tcp 00:26:53.303 rmmod nvme_fabrics 00:26:53.303 rmmod nvme_keyring 00:26:53.303 11:51:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:53.303 11:51:13 -- nvmf/common.sh@123 -- # set -e 00:26:53.303 11:51:13 -- nvmf/common.sh@124 -- # return 0 00:26:53.303 11:51:13 -- nvmf/common.sh@477 -- # '[' -n 3920970 ']' 00:26:53.303 11:51:13 -- nvmf/common.sh@478 -- # killprocess 3920970 00:26:53.303 11:51:13 -- common/autotest_common.sh@936 -- # '[' -z 3920970 ']' 00:26:53.303 11:51:13 -- common/autotest_common.sh@940 -- # kill -0 3920970 00:26:53.303 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3920970) - No such process 00:26:53.303 11:51:13 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3920970 is not found' 00:26:53.303 Process with pid 3920970 is not found 00:26:53.303 11:51:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:53.303 11:51:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:53.303 11:51:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:53.303 11:51:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:53.303 11:51:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:53.303 11:51:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:53.303 11:51:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:53.303 11:51:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:55.838 11:51:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:55.838 00:26:55.838 real 0m38.410s 00:26:55.838 user 1m5.489s 00:26:55.838 sys 0m11.393s 00:26:55.838 11:51:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:55.838 11:51:15 -- common/autotest_common.sh@10 -- # set +x 00:26:55.838 ************************************ 00:26:55.838 END TEST nvmf_digest 00:26:55.838 ************************************ 00:26:55.838 11:51:15 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:26:55.838 11:51:15 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:26:55.838 11:51:15 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:26:55.838 11:51:15 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:26:55.838 11:51:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:55.838 11:51:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:55.838 11:51:15 -- common/autotest_common.sh@10 -- # set +x 00:26:55.838 ************************************ 00:26:55.838 START TEST nvmf_bdevperf 00:26:55.838 ************************************ 00:26:55.838 11:51:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:26:55.838 * Looking for test storage... 00:26:55.838 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:55.838 11:51:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:55.838 11:51:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:55.838 11:51:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:55.838 11:51:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:55.838 11:51:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:55.838 11:51:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:55.838 11:51:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:55.838 11:51:15 -- scripts/common.sh@335 -- # IFS=.-: 00:26:55.838 11:51:15 -- scripts/common.sh@335 -- # read -ra ver1 00:26:55.838 11:51:15 -- scripts/common.sh@336 -- # IFS=.-: 00:26:55.838 11:51:15 -- scripts/common.sh@336 -- # read -ra ver2 00:26:55.838 11:51:15 -- scripts/common.sh@337 -- # local 'op=<' 00:26:55.838 11:51:15 -- scripts/common.sh@339 -- # ver1_l=2 00:26:55.838 11:51:15 -- scripts/common.sh@340 -- # ver2_l=1 00:26:55.838 11:51:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:55.838 11:51:15 -- scripts/common.sh@343 -- # case "$op" in 00:26:55.838 11:51:15 -- scripts/common.sh@344 -- # : 1 00:26:55.838 11:51:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:55.838 11:51:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:55.838 11:51:15 -- scripts/common.sh@364 -- # decimal 1 00:26:55.838 11:51:15 -- scripts/common.sh@352 -- # local d=1 00:26:55.838 11:51:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:55.838 11:51:15 -- scripts/common.sh@354 -- # echo 1 00:26:55.838 11:51:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:55.838 11:51:15 -- scripts/common.sh@365 -- # decimal 2 00:26:55.838 11:51:15 -- scripts/common.sh@352 -- # local d=2 00:26:55.838 11:51:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:55.838 11:51:15 -- scripts/common.sh@354 -- # echo 2 00:26:55.838 11:51:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:55.838 11:51:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:55.838 11:51:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:55.838 11:51:15 -- scripts/common.sh@367 -- # return 0 00:26:55.838 11:51:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:55.838 11:51:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:55.838 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:55.838 --rc genhtml_branch_coverage=1 00:26:55.838 --rc genhtml_function_coverage=1 00:26:55.838 --rc genhtml_legend=1 00:26:55.838 --rc geninfo_all_blocks=1 00:26:55.838 --rc geninfo_unexecuted_blocks=1 00:26:55.838 00:26:55.838 ' 00:26:55.838 11:51:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:55.838 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:55.838 --rc genhtml_branch_coverage=1 00:26:55.838 --rc genhtml_function_coverage=1 00:26:55.838 --rc genhtml_legend=1 00:26:55.838 --rc geninfo_all_blocks=1 00:26:55.838 --rc geninfo_unexecuted_blocks=1 00:26:55.838 00:26:55.838 ' 00:26:55.838 11:51:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:55.838 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:55.838 --rc genhtml_branch_coverage=1 00:26:55.838 --rc genhtml_function_coverage=1 00:26:55.838 --rc genhtml_legend=1 00:26:55.838 --rc geninfo_all_blocks=1 00:26:55.838 --rc geninfo_unexecuted_blocks=1 00:26:55.838 00:26:55.838 ' 00:26:55.838 11:51:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:55.838 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:55.838 --rc genhtml_branch_coverage=1 00:26:55.838 --rc genhtml_function_coverage=1 00:26:55.838 --rc genhtml_legend=1 00:26:55.838 --rc geninfo_all_blocks=1 00:26:55.838 --rc geninfo_unexecuted_blocks=1 00:26:55.838 00:26:55.838 ' 00:26:55.838 11:51:15 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:55.838 11:51:15 -- nvmf/common.sh@7 -- # uname -s 00:26:55.838 11:51:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:55.838 11:51:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:55.838 11:51:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:55.838 11:51:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:55.838 11:51:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:55.838 11:51:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:55.838 11:51:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:55.838 11:51:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:55.838 11:51:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:55.838 11:51:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:55.838 11:51:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:55.838 11:51:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:55.838 11:51:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:55.838 11:51:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:55.838 11:51:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:55.838 11:51:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:55.838 11:51:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:55.839 11:51:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:55.839 11:51:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:55.839 11:51:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:55.839 11:51:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:55.839 11:51:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:55.839 11:51:15 -- paths/export.sh@5 -- # export PATH 00:26:55.839 11:51:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:55.839 11:51:15 -- nvmf/common.sh@46 -- # : 0 00:26:55.839 11:51:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:55.839 11:51:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:55.839 11:51:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:55.839 11:51:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:55.839 11:51:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:55.839 11:51:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:55.839 11:51:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:55.839 11:51:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:55.839 11:51:15 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:55.839 11:51:15 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:55.839 11:51:15 -- host/bdevperf.sh@24 -- # nvmftestinit 00:26:55.839 11:51:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:55.839 11:51:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:55.839 11:51:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:55.839 11:51:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:55.839 11:51:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:55.839 11:51:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:55.839 11:51:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:55.839 11:51:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:55.839 11:51:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:55.839 11:51:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:55.839 11:51:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:55.839 11:51:15 -- common/autotest_common.sh@10 -- # set +x 00:26:57.742 11:51:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:57.742 11:51:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:57.742 11:51:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:57.742 11:51:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:57.742 11:51:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:57.742 11:51:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:57.742 11:51:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:57.742 11:51:17 -- nvmf/common.sh@294 -- # net_devs=() 00:26:57.742 11:51:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:57.742 11:51:17 -- nvmf/common.sh@295 -- # e810=() 00:26:57.742 11:51:17 -- nvmf/common.sh@295 -- # local -ga e810 00:26:57.742 11:51:17 -- nvmf/common.sh@296 -- # x722=() 00:26:57.742 11:51:17 -- nvmf/common.sh@296 -- # local -ga x722 00:26:57.742 11:51:17 -- nvmf/common.sh@297 -- # mlx=() 00:26:57.742 11:51:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:57.742 11:51:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:57.742 11:51:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:57.742 11:51:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:57.742 11:51:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:57.742 11:51:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:57.742 11:51:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:57.742 11:51:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:57.742 11:51:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:57.742 11:51:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:57.742 11:51:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:57.742 11:51:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:57.742 11:51:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:57.742 11:51:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:57.742 11:51:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:57.742 11:51:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:57.742 11:51:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:57.742 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:57.742 11:51:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:57.742 11:51:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:57.742 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:57.742 11:51:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:57.742 11:51:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:57.742 11:51:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:57.742 11:51:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:57.742 11:51:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:57.742 11:51:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:57.742 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:57.742 11:51:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:57.742 11:51:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:57.742 11:51:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:57.742 11:51:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:57.742 11:51:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:57.742 11:51:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:57.742 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:57.742 11:51:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:57.742 11:51:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:57.742 11:51:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:57.742 11:51:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:57.742 11:51:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:57.742 11:51:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:57.742 11:51:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:57.742 11:51:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:57.742 11:51:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:57.742 11:51:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:57.742 11:51:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:57.742 11:51:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:57.742 11:51:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:57.742 11:51:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:57.742 11:51:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:57.742 11:51:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:57.742 11:51:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:57.742 11:51:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:57.742 11:51:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:57.742 11:51:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:57.742 11:51:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:57.742 11:51:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:57.742 11:51:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:57.742 11:51:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:57.742 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:57.742 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.292 ms 00:26:57.742 00:26:57.742 --- 10.0.0.2 ping statistics --- 00:26:57.742 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:57.742 rtt min/avg/max/mdev = 0.292/0.292/0.292/0.000 ms 00:26:57.742 11:51:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:57.742 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:57.742 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:26:57.742 00:26:57.742 --- 10.0.0.1 ping statistics --- 00:26:57.742 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:57.742 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:26:57.742 11:51:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:57.742 11:51:17 -- nvmf/common.sh@410 -- # return 0 00:26:57.742 11:51:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:57.742 11:51:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:57.742 11:51:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:57.742 11:51:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:57.742 11:51:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:57.742 11:51:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:57.742 11:51:17 -- host/bdevperf.sh@25 -- # tgt_init 00:26:57.742 11:51:17 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:26:57.742 11:51:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:57.742 11:51:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:57.742 11:51:17 -- common/autotest_common.sh@10 -- # set +x 00:26:57.742 11:51:17 -- nvmf/common.sh@469 -- # nvmfpid=3925792 00:26:57.743 11:51:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:26:57.743 11:51:17 -- nvmf/common.sh@470 -- # waitforlisten 3925792 00:26:57.743 11:51:17 -- common/autotest_common.sh@829 -- # '[' -z 3925792 ']' 00:26:57.743 11:51:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:57.743 11:51:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:57.743 11:51:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:57.743 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:57.743 11:51:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:57.743 11:51:17 -- common/autotest_common.sh@10 -- # set +x 00:26:57.743 [2024-11-28 11:51:17.731841] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:57.743 [2024-11-28 11:51:17.731947] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:57.743 EAL: No free 2048 kB hugepages reported on node 1 00:26:58.001 [2024-11-28 11:51:17.797353] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:26:58.001 [2024-11-28 11:51:17.909816] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:58.001 [2024-11-28 11:51:17.909960] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:58.001 [2024-11-28 11:51:17.909977] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:58.001 [2024-11-28 11:51:17.909989] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:58.001 [2024-11-28 11:51:17.910096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:58.001 [2024-11-28 11:51:17.910131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:58.001 [2024-11-28 11:51:17.910135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:58.936 11:51:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:58.936 11:51:18 -- common/autotest_common.sh@862 -- # return 0 00:26:58.936 11:51:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:58.936 11:51:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:58.936 11:51:18 -- common/autotest_common.sh@10 -- # set +x 00:26:58.936 11:51:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:58.936 11:51:18 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:58.936 11:51:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.936 11:51:18 -- common/autotest_common.sh@10 -- # set +x 00:26:58.936 [2024-11-28 11:51:18.761750] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:58.936 11:51:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.936 11:51:18 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:58.936 11:51:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.936 11:51:18 -- common/autotest_common.sh@10 -- # set +x 00:26:58.936 Malloc0 00:26:58.936 11:51:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.936 11:51:18 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:58.936 11:51:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.936 11:51:18 -- common/autotest_common.sh@10 -- # set +x 00:26:58.936 11:51:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.936 11:51:18 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:58.936 11:51:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.936 11:51:18 -- common/autotest_common.sh@10 -- # set +x 00:26:58.936 11:51:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.936 11:51:18 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:58.936 11:51:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.936 11:51:18 -- common/autotest_common.sh@10 -- # set +x 00:26:58.936 [2024-11-28 11:51:18.830402] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:58.936 11:51:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.936 11:51:18 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:26:58.936 11:51:18 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:26:58.936 11:51:18 -- nvmf/common.sh@520 -- # config=() 00:26:58.936 11:51:18 -- nvmf/common.sh@520 -- # local subsystem config 00:26:58.936 11:51:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:58.936 11:51:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:58.936 { 00:26:58.936 "params": { 00:26:58.936 "name": "Nvme$subsystem", 00:26:58.936 "trtype": "$TEST_TRANSPORT", 00:26:58.936 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:58.936 "adrfam": "ipv4", 00:26:58.936 "trsvcid": "$NVMF_PORT", 00:26:58.936 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:58.936 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:58.936 "hdgst": ${hdgst:-false}, 00:26:58.936 "ddgst": ${ddgst:-false} 00:26:58.936 }, 00:26:58.936 "method": "bdev_nvme_attach_controller" 00:26:58.936 } 00:26:58.936 EOF 00:26:58.936 )") 00:26:58.936 11:51:18 -- nvmf/common.sh@542 -- # cat 00:26:58.936 11:51:18 -- nvmf/common.sh@544 -- # jq . 00:26:58.936 11:51:18 -- nvmf/common.sh@545 -- # IFS=, 00:26:58.936 11:51:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:58.936 "params": { 00:26:58.936 "name": "Nvme1", 00:26:58.936 "trtype": "tcp", 00:26:58.936 "traddr": "10.0.0.2", 00:26:58.936 "adrfam": "ipv4", 00:26:58.936 "trsvcid": "4420", 00:26:58.936 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:58.936 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:58.936 "hdgst": false, 00:26:58.936 "ddgst": false 00:26:58.936 }, 00:26:58.936 "method": "bdev_nvme_attach_controller" 00:26:58.936 }' 00:26:58.936 [2024-11-28 11:51:18.874917] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:58.936 [2024-11-28 11:51:18.874982] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3925950 ] 00:26:58.936 EAL: No free 2048 kB hugepages reported on node 1 00:26:58.936 [2024-11-28 11:51:18.935213] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:59.195 [2024-11-28 11:51:19.050347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:59.454 Running I/O for 1 seconds... 00:27:00.390 00:27:00.390 Latency(us) 00:27:00.390 [2024-11-28T10:51:20.446Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:00.390 [2024-11-28T10:51:20.446Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:00.390 Verification LBA range: start 0x0 length 0x4000 00:27:00.390 Nvme1n1 : 1.01 12829.80 50.12 0.00 0.00 9930.11 1146.88 15243.19 00:27:00.390 [2024-11-28T10:51:20.446Z] =================================================================================================================== 00:27:00.390 [2024-11-28T10:51:20.446Z] Total : 12829.80 50.12 0.00 0.00 9930.11 1146.88 15243.19 00:27:00.648 11:51:20 -- host/bdevperf.sh@30 -- # bdevperfpid=3926218 00:27:00.648 11:51:20 -- host/bdevperf.sh@32 -- # sleep 3 00:27:00.648 11:51:20 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:00.648 11:51:20 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:00.648 11:51:20 -- nvmf/common.sh@520 -- # config=() 00:27:00.648 11:51:20 -- nvmf/common.sh@520 -- # local subsystem config 00:27:00.648 11:51:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:00.648 11:51:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:00.648 { 00:27:00.648 "params": { 00:27:00.648 "name": "Nvme$subsystem", 00:27:00.648 "trtype": "$TEST_TRANSPORT", 00:27:00.648 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:00.648 "adrfam": "ipv4", 00:27:00.648 "trsvcid": "$NVMF_PORT", 00:27:00.648 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:00.648 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:00.648 "hdgst": ${hdgst:-false}, 00:27:00.648 "ddgst": ${ddgst:-false} 00:27:00.648 }, 00:27:00.648 "method": "bdev_nvme_attach_controller" 00:27:00.648 } 00:27:00.648 EOF 00:27:00.648 )") 00:27:00.648 11:51:20 -- nvmf/common.sh@542 -- # cat 00:27:00.648 11:51:20 -- nvmf/common.sh@544 -- # jq . 00:27:00.648 11:51:20 -- nvmf/common.sh@545 -- # IFS=, 00:27:00.648 11:51:20 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:00.648 "params": { 00:27:00.648 "name": "Nvme1", 00:27:00.648 "trtype": "tcp", 00:27:00.648 "traddr": "10.0.0.2", 00:27:00.648 "adrfam": "ipv4", 00:27:00.648 "trsvcid": "4420", 00:27:00.648 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:00.648 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:00.648 "hdgst": false, 00:27:00.648 "ddgst": false 00:27:00.648 }, 00:27:00.648 "method": "bdev_nvme_attach_controller" 00:27:00.648 }' 00:27:00.648 [2024-11-28 11:51:20.660668] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:00.648 [2024-11-28 11:51:20.660748] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3926218 ] 00:27:00.648 EAL: No free 2048 kB hugepages reported on node 1 00:27:00.905 [2024-11-28 11:51:20.720588] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:00.905 [2024-11-28 11:51:20.825554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:01.162 Running I/O for 15 seconds... 00:27:03.694 11:51:23 -- host/bdevperf.sh@33 -- # kill -9 3925792 00:27:03.694 11:51:23 -- host/bdevperf.sh@35 -- # sleep 3 00:27:03.694 [2024-11-28 11:51:23.634997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:122720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.694 [2024-11-28 11:51:23.635051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.694 [2024-11-28 11:51:23.635082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:122736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.694 [2024-11-28 11:51:23.635099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.694 [2024-11-28 11:51:23.635119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:122744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.694 [2024-11-28 11:51:23.635135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.694 [2024-11-28 11:51:23.635155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:122760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.694 [2024-11-28 11:51:23.635171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.694 [2024-11-28 11:51:23.635198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:122776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.694 [2024-11-28 11:51:23.635215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.694 [2024-11-28 11:51:23.635233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:122792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.694 [2024-11-28 11:51:23.635248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.694 [2024-11-28 11:51:23.635265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:122800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.694 [2024-11-28 11:51:23.635281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.694 [2024-11-28 11:51:23.635297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:122808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.694 [2024-11-28 11:51:23.635312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.694 [2024-11-28 11:51:23.635329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:122840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.694 [2024-11-28 11:51:23.635346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.694 [2024-11-28 11:51:23.635363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:122848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.694 [2024-11-28 11:51:23.635380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:122856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.695 [2024-11-28 11:51:23.635414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:122864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.695 [2024-11-28 11:51:23.635448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:122872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.695 [2024-11-28 11:51:23.635479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:122880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.635511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:122888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.635568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:122896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.695 [2024-11-28 11:51:23.635597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:122904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.635631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:122912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.635660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:122920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.635689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:122928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.695 [2024-11-28 11:51:23.635719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:122936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.635747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:122944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.635776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:122952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.695 [2024-11-28 11:51:23.635804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:122960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.695 [2024-11-28 11:51:23.635846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:122968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.635874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:122208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.635915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:122232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.635941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:122240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.635968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.635981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:122248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.635993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:122256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:122288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:122304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:122312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:122320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:122448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:122464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:122480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:122496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:122512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:122560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:122592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:122976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:122984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:122992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.695 [2024-11-28 11:51:23.636391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:123000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.695 [2024-11-28 11:51:23.636417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:123008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.695 [2024-11-28 11:51:23.636443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:123016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.695 [2024-11-28 11:51:23.636485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:123024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.695 [2024-11-28 11:51:23.636517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.695 [2024-11-28 11:51:23.636543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:123032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.636559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.636592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:123040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.636606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.636622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:123048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.636636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.636651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:123056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.636664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.636679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:123064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.636693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.636708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:123072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.636721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.636736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:123080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.636753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.636768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:123088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.636782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.636797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:123096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.636810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.636825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:123104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.636855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.636872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:123112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.636887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.636903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:123120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.636918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.636935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:123128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.636950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.636966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:123136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.636980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.636997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:123144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:123152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.637044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:123160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.637074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:123168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.637106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:123176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.637138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:123184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.637175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:123192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.637207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:123200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.637238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:123208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:123216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.637300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:123224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:123232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:123240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.637394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:123248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:123256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.637455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:123264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:122616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:122624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:122640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:122648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:122680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:122688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:122696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:123272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:123280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.696 [2024-11-28 11:51:23.637784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.696 [2024-11-28 11:51:23.637799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:123288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.696 [2024-11-28 11:51:23.637827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.637842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:123296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.637855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.637885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:123304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.637901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.637917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:123312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.637932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.637948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:123320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.637962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.637983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:123328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.637998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:123336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:123344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:123352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:123360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.638122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:123368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:123376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.638185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:123384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.638224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:123392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:123400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:123408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.638317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:123416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.638349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:123424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:123432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.638416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:123440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.638446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:123448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.638477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:123456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.638508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:123464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.638549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:123472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:123480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:123488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.638653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:123496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.638682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:123504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:123512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.638737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:123520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:123528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:123536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:123544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:03.697 [2024-11-28 11:51:23.638862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:122712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:122728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:122752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.638982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:122768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.638997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.639012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:122784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.639027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.639042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:122816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.639057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.697 [2024-11-28 11:51:23.639073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:122824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.697 [2024-11-28 11:51:23.639087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.698 [2024-11-28 11:51:23.639103] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1782740 is same with the state(5) to be set 00:27:03.698 [2024-11-28 11:51:23.639121] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:03.698 [2024-11-28 11:51:23.639133] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:03.698 [2024-11-28 11:51:23.639146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:122832 len:8 PRP1 0x0 PRP2 0x0 00:27:03.698 [2024-11-28 11:51:23.639160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:03.698 [2024-11-28 11:51:23.639231] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1782740 was disconnected and freed. reset controller. 00:27:03.698 [2024-11-28 11:51:23.641539] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.698 [2024-11-28 11:51:23.641629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.698 [2024-11-28 11:51:23.642160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.642412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.642473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.698 [2024-11-28 11:51:23.642491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.698 [2024-11-28 11:51:23.642658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.698 [2024-11-28 11:51:23.642866] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.698 [2024-11-28 11:51:23.642889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.698 [2024-11-28 11:51:23.642908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.698 [2024-11-28 11:51:23.645274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.698 [2024-11-28 11:51:23.654411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.698 [2024-11-28 11:51:23.654774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.655005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.655032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.698 [2024-11-28 11:51:23.655066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.698 [2024-11-28 11:51:23.655249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.698 [2024-11-28 11:51:23.655400] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.698 [2024-11-28 11:51:23.655425] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.698 [2024-11-28 11:51:23.655441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.698 [2024-11-28 11:51:23.657865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.698 [2024-11-28 11:51:23.667191] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.698 [2024-11-28 11:51:23.667552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.667694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.667723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.698 [2024-11-28 11:51:23.667741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.698 [2024-11-28 11:51:23.667924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.698 [2024-11-28 11:51:23.668057] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.698 [2024-11-28 11:51:23.668081] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.698 [2024-11-28 11:51:23.668096] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.698 [2024-11-28 11:51:23.670262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.698 [2024-11-28 11:51:23.679786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.698 [2024-11-28 11:51:23.680216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.680341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.680368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.698 [2024-11-28 11:51:23.680385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.698 [2024-11-28 11:51:23.680544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.698 [2024-11-28 11:51:23.680696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.698 [2024-11-28 11:51:23.680720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.698 [2024-11-28 11:51:23.680736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.698 [2024-11-28 11:51:23.683109] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.698 [2024-11-28 11:51:23.692457] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.698 [2024-11-28 11:51:23.692838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.693074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.693124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.698 [2024-11-28 11:51:23.693142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.698 [2024-11-28 11:51:23.693325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.698 [2024-11-28 11:51:23.693475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.698 [2024-11-28 11:51:23.693499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.698 [2024-11-28 11:51:23.693514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.698 [2024-11-28 11:51:23.695932] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.698 [2024-11-28 11:51:23.705242] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.698 [2024-11-28 11:51:23.705589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.705816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.705842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.698 [2024-11-28 11:51:23.705857] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.698 [2024-11-28 11:51:23.706018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.698 [2024-11-28 11:51:23.706172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.698 [2024-11-28 11:51:23.706210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.698 [2024-11-28 11:51:23.706223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.698 [2024-11-28 11:51:23.708414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.698 [2024-11-28 11:51:23.717801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.698 [2024-11-28 11:51:23.718202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.718370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.718399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.698 [2024-11-28 11:51:23.718417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.698 [2024-11-28 11:51:23.718539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.698 [2024-11-28 11:51:23.718678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.698 [2024-11-28 11:51:23.718699] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.698 [2024-11-28 11:51:23.718713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.698 [2024-11-28 11:51:23.720948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.698 [2024-11-28 11:51:23.730306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.698 [2024-11-28 11:51:23.730669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.730792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.730834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.698 [2024-11-28 11:51:23.730852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.698 [2024-11-28 11:51:23.731018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.698 [2024-11-28 11:51:23.731187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.698 [2024-11-28 11:51:23.731210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.698 [2024-11-28 11:51:23.731227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.698 [2024-11-28 11:51:23.733736] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.698 [2024-11-28 11:51:23.742737] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.698 [2024-11-28 11:51:23.743080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.743256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.698 [2024-11-28 11:51:23.743284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.698 [2024-11-28 11:51:23.743301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.698 [2024-11-28 11:51:23.743483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.699 [2024-11-28 11:51:23.743670] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.699 [2024-11-28 11:51:23.743701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.699 [2024-11-28 11:51:23.743716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.699 [2024-11-28 11:51:23.746126] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.959 [2024-11-28 11:51:23.755439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.959 [2024-11-28 11:51:23.755760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.959 [2024-11-28 11:51:23.755963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.959 [2024-11-28 11:51:23.755996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.959 [2024-11-28 11:51:23.756014] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.959 [2024-11-28 11:51:23.756161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.959 [2024-11-28 11:51:23.756348] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.959 [2024-11-28 11:51:23.756371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.959 [2024-11-28 11:51:23.756387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.959 [2024-11-28 11:51:23.758843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.959 [2024-11-28 11:51:23.767917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.959 [2024-11-28 11:51:23.768287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.959 [2024-11-28 11:51:23.768438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.959 [2024-11-28 11:51:23.768466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.959 [2024-11-28 11:51:23.768483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.959 [2024-11-28 11:51:23.768700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.959 [2024-11-28 11:51:23.768905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.959 [2024-11-28 11:51:23.768929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.959 [2024-11-28 11:51:23.768945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.959 [2024-11-28 11:51:23.771347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.959 [2024-11-28 11:51:23.780437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.959 [2024-11-28 11:51:23.780811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.959 [2024-11-28 11:51:23.780984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.959 [2024-11-28 11:51:23.781013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.959 [2024-11-28 11:51:23.781031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.959 [2024-11-28 11:51:23.781177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.959 [2024-11-28 11:51:23.781364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.959 [2024-11-28 11:51:23.781388] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.959 [2024-11-28 11:51:23.781403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.959 [2024-11-28 11:51:23.783638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.959 [2024-11-28 11:51:23.792748] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.959 [2024-11-28 11:51:23.793117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.959 [2024-11-28 11:51:23.793265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.959 [2024-11-28 11:51:23.793310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.959 [2024-11-28 11:51:23.793333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.959 [2024-11-28 11:51:23.793445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.959 [2024-11-28 11:51:23.793618] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.960 [2024-11-28 11:51:23.793640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.960 [2024-11-28 11:51:23.793653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.960 [2024-11-28 11:51:23.795830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.960 [2024-11-28 11:51:23.805411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.960 [2024-11-28 11:51:23.805698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.805860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.805886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.960 [2024-11-28 11:51:23.805902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.960 [2024-11-28 11:51:23.806077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.960 [2024-11-28 11:51:23.806242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.960 [2024-11-28 11:51:23.806266] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.960 [2024-11-28 11:51:23.806281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.960 [2024-11-28 11:51:23.808642] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.960 [2024-11-28 11:51:23.818306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.960 [2024-11-28 11:51:23.818611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.818830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.818855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.960 [2024-11-28 11:51:23.818870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.960 [2024-11-28 11:51:23.819069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.960 [2024-11-28 11:51:23.819256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.960 [2024-11-28 11:51:23.819280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.960 [2024-11-28 11:51:23.819295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.960 [2024-11-28 11:51:23.821617] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.960 [2024-11-28 11:51:23.830825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.960 [2024-11-28 11:51:23.831170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.831336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.831361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.960 [2024-11-28 11:51:23.831377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.960 [2024-11-28 11:51:23.831572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.960 [2024-11-28 11:51:23.831760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.960 [2024-11-28 11:51:23.831784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.960 [2024-11-28 11:51:23.831800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.960 [2024-11-28 11:51:23.834136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.960 [2024-11-28 11:51:23.843531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.960 [2024-11-28 11:51:23.843836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.844047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.844093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.960 [2024-11-28 11:51:23.844110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.960 [2024-11-28 11:51:23.844275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.960 [2024-11-28 11:51:23.844425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.960 [2024-11-28 11:51:23.844448] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.960 [2024-11-28 11:51:23.844463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.960 [2024-11-28 11:51:23.846931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.960 [2024-11-28 11:51:23.855983] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.960 [2024-11-28 11:51:23.856319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.856503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.856540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.960 [2024-11-28 11:51:23.856559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.960 [2024-11-28 11:51:23.856724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.960 [2024-11-28 11:51:23.856857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.960 [2024-11-28 11:51:23.856880] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.960 [2024-11-28 11:51:23.856896] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.960 [2024-11-28 11:51:23.859191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.960 [2024-11-28 11:51:23.868502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.960 [2024-11-28 11:51:23.868826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.869005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.869033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.960 [2024-11-28 11:51:23.869050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.960 [2024-11-28 11:51:23.869214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.960 [2024-11-28 11:51:23.869389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.960 [2024-11-28 11:51:23.869413] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.960 [2024-11-28 11:51:23.869428] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.960 [2024-11-28 11:51:23.871988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.960 [2024-11-28 11:51:23.881059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.960 [2024-11-28 11:51:23.881425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.881551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.881581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.960 [2024-11-28 11:51:23.881598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.960 [2024-11-28 11:51:23.881781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.960 [2024-11-28 11:51:23.881950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.960 [2024-11-28 11:51:23.881974] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.960 [2024-11-28 11:51:23.881990] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.960 [2024-11-28 11:51:23.884485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.960 [2024-11-28 11:51:23.893538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.960 [2024-11-28 11:51:23.894186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.894361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.894390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.960 [2024-11-28 11:51:23.894408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.960 [2024-11-28 11:51:23.894569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.960 [2024-11-28 11:51:23.894739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.960 [2024-11-28 11:51:23.894763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.960 [2024-11-28 11:51:23.894779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.960 [2024-11-28 11:51:23.896953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.960 [2024-11-28 11:51:23.906217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.960 [2024-11-28 11:51:23.906579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.906746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.960 [2024-11-28 11:51:23.906772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.960 [2024-11-28 11:51:23.906806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.960 [2024-11-28 11:51:23.906990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.960 [2024-11-28 11:51:23.907178] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.960 [2024-11-28 11:51:23.907207] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.961 [2024-11-28 11:51:23.907223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.961 [2024-11-28 11:51:23.909621] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.961 [2024-11-28 11:51:23.918799] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.961 [2024-11-28 11:51:23.919097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:23.919283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:23.919309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.961 [2024-11-28 11:51:23.919325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.961 [2024-11-28 11:51:23.919505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.961 [2024-11-28 11:51:23.919689] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.961 [2024-11-28 11:51:23.919714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.961 [2024-11-28 11:51:23.919731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.961 [2024-11-28 11:51:23.922030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.961 [2024-11-28 11:51:23.931282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.961 [2024-11-28 11:51:23.931590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:23.931703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:23.931729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.961 [2024-11-28 11:51:23.931746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.961 [2024-11-28 11:51:23.931899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.961 [2024-11-28 11:51:23.932032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.961 [2024-11-28 11:51:23.932056] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.961 [2024-11-28 11:51:23.932071] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.961 [2024-11-28 11:51:23.934333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.961 [2024-11-28 11:51:23.943858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.961 [2024-11-28 11:51:23.944278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:23.944446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:23.944474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.961 [2024-11-28 11:51:23.944492] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.961 [2024-11-28 11:51:23.944652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.961 [2024-11-28 11:51:23.944894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.961 [2024-11-28 11:51:23.944917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.961 [2024-11-28 11:51:23.944939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.961 [2024-11-28 11:51:23.947255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.961 [2024-11-28 11:51:23.956513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.961 [2024-11-28 11:51:23.956800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:23.956947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:23.956975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.961 [2024-11-28 11:51:23.956993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.961 [2024-11-28 11:51:23.957158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.961 [2024-11-28 11:51:23.957327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.961 [2024-11-28 11:51:23.957351] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.961 [2024-11-28 11:51:23.957366] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.961 [2024-11-28 11:51:23.959815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.961 [2024-11-28 11:51:23.969008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.961 [2024-11-28 11:51:23.969387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:23.969533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:23.969559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.961 [2024-11-28 11:51:23.969575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.961 [2024-11-28 11:51:23.969736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.961 [2024-11-28 11:51:23.969942] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.961 [2024-11-28 11:51:23.969965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.961 [2024-11-28 11:51:23.969980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.961 [2024-11-28 11:51:23.972345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.961 [2024-11-28 11:51:23.981428] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.961 [2024-11-28 11:51:23.981778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:23.981979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:23.982004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.961 [2024-11-28 11:51:23.982020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.961 [2024-11-28 11:51:23.982260] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.961 [2024-11-28 11:51:23.982430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.961 [2024-11-28 11:51:23.982453] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.961 [2024-11-28 11:51:23.982468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.961 [2024-11-28 11:51:23.984765] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.961 [2024-11-28 11:51:23.994064] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.961 [2024-11-28 11:51:23.994365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:23.994516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:23.994556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.961 [2024-11-28 11:51:23.994575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.961 [2024-11-28 11:51:23.994777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.961 [2024-11-28 11:51:23.994928] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.961 [2024-11-28 11:51:23.994952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.961 [2024-11-28 11:51:23.994967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.961 [2024-11-28 11:51:23.997175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.961 [2024-11-28 11:51:24.006557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.961 [2024-11-28 11:51:24.006859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:24.007046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.961 [2024-11-28 11:51:24.007075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:03.961 [2024-11-28 11:51:24.007092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:03.961 [2024-11-28 11:51:24.007257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:03.961 [2024-11-28 11:51:24.007426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.961 [2024-11-28 11:51:24.007449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.961 [2024-11-28 11:51:24.007464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.961 [2024-11-28 11:51:24.009860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.221 [2024-11-28 11:51:24.019272] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.221 [2024-11-28 11:51:24.019596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.221 [2024-11-28 11:51:24.019714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.221 [2024-11-28 11:51:24.019739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.221 [2024-11-28 11:51:24.019755] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.221 [2024-11-28 11:51:24.019914] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.221 [2024-11-28 11:51:24.020083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.221 [2024-11-28 11:51:24.020107] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.221 [2024-11-28 11:51:24.020122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.221 [2024-11-28 11:51:24.022439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.221 [2024-11-28 11:51:24.031732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.221 [2024-11-28 11:51:24.032057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.221 [2024-11-28 11:51:24.032236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.221 [2024-11-28 11:51:24.032265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.221 [2024-11-28 11:51:24.032282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.221 [2024-11-28 11:51:24.032447] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.221 [2024-11-28 11:51:24.032646] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.221 [2024-11-28 11:51:24.032671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.221 [2024-11-28 11:51:24.032687] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.221 [2024-11-28 11:51:24.035126] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.221 [2024-11-28 11:51:24.044305] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.221 [2024-11-28 11:51:24.044665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.221 [2024-11-28 11:51:24.044779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.221 [2024-11-28 11:51:24.044804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.221 [2024-11-28 11:51:24.044820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.221 [2024-11-28 11:51:24.045019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.221 [2024-11-28 11:51:24.045172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.221 [2024-11-28 11:51:24.045195] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.221 [2024-11-28 11:51:24.045210] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.221 [2024-11-28 11:51:24.047455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.221 [2024-11-28 11:51:24.056941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.221 [2024-11-28 11:51:24.057289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.221 [2024-11-28 11:51:24.057517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.221 [2024-11-28 11:51:24.057555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.221 [2024-11-28 11:51:24.057573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.221 [2024-11-28 11:51:24.057684] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.221 [2024-11-28 11:51:24.057816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.221 [2024-11-28 11:51:24.057839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.221 [2024-11-28 11:51:24.057855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.221 [2024-11-28 11:51:24.060315] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.221 [2024-11-28 11:51:24.069543] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.222 [2024-11-28 11:51:24.069913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.070047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.070088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.222 [2024-11-28 11:51:24.070104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.222 [2024-11-28 11:51:24.070323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.222 [2024-11-28 11:51:24.070535] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.222 [2024-11-28 11:51:24.070559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.222 [2024-11-28 11:51:24.070573] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.222 [2024-11-28 11:51:24.072924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.222 [2024-11-28 11:51:24.081909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.222 [2024-11-28 11:51:24.082257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.082413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.082441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.222 [2024-11-28 11:51:24.082459] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.222 [2024-11-28 11:51:24.082653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.222 [2024-11-28 11:51:24.082805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.222 [2024-11-28 11:51:24.082829] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.222 [2024-11-28 11:51:24.082844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.222 [2024-11-28 11:51:24.085193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.222 [2024-11-28 11:51:24.094541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.222 [2024-11-28 11:51:24.094889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.095067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.095095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.222 [2024-11-28 11:51:24.095112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.222 [2024-11-28 11:51:24.095277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.222 [2024-11-28 11:51:24.095463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.222 [2024-11-28 11:51:24.095486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.222 [2024-11-28 11:51:24.095502] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.222 [2024-11-28 11:51:24.097842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.222 [2024-11-28 11:51:24.106960] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.222 [2024-11-28 11:51:24.107273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.107448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.107481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.222 [2024-11-28 11:51:24.107499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.222 [2024-11-28 11:51:24.107676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.222 [2024-11-28 11:51:24.107773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.222 [2024-11-28 11:51:24.107796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.222 [2024-11-28 11:51:24.107811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.222 [2024-11-28 11:51:24.110015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.222 [2024-11-28 11:51:24.119381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.222 [2024-11-28 11:51:24.119780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.119954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.120006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.222 [2024-11-28 11:51:24.120024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.222 [2024-11-28 11:51:24.120153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.222 [2024-11-28 11:51:24.120303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.222 [2024-11-28 11:51:24.120326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.222 [2024-11-28 11:51:24.120342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.222 [2024-11-28 11:51:24.122723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.222 [2024-11-28 11:51:24.131991] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.222 [2024-11-28 11:51:24.132398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.132594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.132628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.222 [2024-11-28 11:51:24.132662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.222 [2024-11-28 11:51:24.132845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.222 [2024-11-28 11:51:24.133016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.222 [2024-11-28 11:51:24.133040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.222 [2024-11-28 11:51:24.133056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.222 [2024-11-28 11:51:24.135149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.222 [2024-11-28 11:51:24.144586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.222 [2024-11-28 11:51:24.144959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.145150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.145177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.222 [2024-11-28 11:51:24.145199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.222 [2024-11-28 11:51:24.145398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.222 [2024-11-28 11:51:24.145585] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.222 [2024-11-28 11:51:24.145611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.222 [2024-11-28 11:51:24.145627] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.222 [2024-11-28 11:51:24.147975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.222 [2024-11-28 11:51:24.157074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.222 [2024-11-28 11:51:24.157371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.157570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.157597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.222 [2024-11-28 11:51:24.157614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.222 [2024-11-28 11:51:24.157762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.222 [2024-11-28 11:51:24.157912] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.222 [2024-11-28 11:51:24.157935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.222 [2024-11-28 11:51:24.157950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.222 [2024-11-28 11:51:24.160175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.222 [2024-11-28 11:51:24.169662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.222 [2024-11-28 11:51:24.170105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.170395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.170444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.222 [2024-11-28 11:51:24.170461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.222 [2024-11-28 11:51:24.170673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.222 [2024-11-28 11:51:24.170843] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.222 [2024-11-28 11:51:24.170866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.222 [2024-11-28 11:51:24.170881] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.222 [2024-11-28 11:51:24.173120] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.222 [2024-11-28 11:51:24.182231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.222 [2024-11-28 11:51:24.182541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.182721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.222 [2024-11-28 11:51:24.182750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.223 [2024-11-28 11:51:24.182767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.223 [2024-11-28 11:51:24.182902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.223 [2024-11-28 11:51:24.183072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.223 [2024-11-28 11:51:24.183095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.223 [2024-11-28 11:51:24.183111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.223 [2024-11-28 11:51:24.185352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.223 [2024-11-28 11:51:24.194907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.223 [2024-11-28 11:51:24.195246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.223 [2024-11-28 11:51:24.195420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.223 [2024-11-28 11:51:24.195447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.223 [2024-11-28 11:51:24.195463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.223 [2024-11-28 11:51:24.195663] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.223 [2024-11-28 11:51:24.195871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.223 [2024-11-28 11:51:24.195894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.223 [2024-11-28 11:51:24.195910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.223 [2024-11-28 11:51:24.198116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.223 [2024-11-28 11:51:24.207534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.223 [2024-11-28 11:51:24.207894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.223 [2024-11-28 11:51:24.208073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.223 [2024-11-28 11:51:24.208102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.223 [2024-11-28 11:51:24.208120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.223 [2024-11-28 11:51:24.208320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.223 [2024-11-28 11:51:24.208454] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.223 [2024-11-28 11:51:24.208477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.223 [2024-11-28 11:51:24.208493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.223 [2024-11-28 11:51:24.210883] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.223 [2024-11-28 11:51:24.220130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.223 [2024-11-28 11:51:24.220436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.223 [2024-11-28 11:51:24.220609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.223 [2024-11-28 11:51:24.220636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.223 [2024-11-28 11:51:24.220652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.223 [2024-11-28 11:51:24.220853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.223 [2024-11-28 11:51:24.221011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.223 [2024-11-28 11:51:24.221034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.223 [2024-11-28 11:51:24.221050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.223 [2024-11-28 11:51:24.223300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.223 [2024-11-28 11:51:24.232671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.223 [2024-11-28 11:51:24.233014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.223 [2024-11-28 11:51:24.233160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.223 [2024-11-28 11:51:24.233188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.223 [2024-11-28 11:51:24.233206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.223 [2024-11-28 11:51:24.233353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.223 [2024-11-28 11:51:24.233486] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.223 [2024-11-28 11:51:24.233509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.223 [2024-11-28 11:51:24.233533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.223 [2024-11-28 11:51:24.235942] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.223 [2024-11-28 11:51:24.245167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.223 [2024-11-28 11:51:24.245476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.223 [2024-11-28 11:51:24.245652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.223 [2024-11-28 11:51:24.245680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.223 [2024-11-28 11:51:24.245698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.223 [2024-11-28 11:51:24.245899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.223 [2024-11-28 11:51:24.246086] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.223 [2024-11-28 11:51:24.246109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.223 [2024-11-28 11:51:24.246125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.223 [2024-11-28 11:51:24.248571] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.223 [2024-11-28 11:51:24.257448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.223 [2024-11-28 11:51:24.257811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.223 [2024-11-28 11:51:24.257961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.223 [2024-11-28 11:51:24.257990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.223 [2024-11-28 11:51:24.258007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.223 [2024-11-28 11:51:24.258190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.223 [2024-11-28 11:51:24.258359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.223 [2024-11-28 11:51:24.258388] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.223 [2024-11-28 11:51:24.258405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.223 [2024-11-28 11:51:24.260638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.223 [2024-11-28 11:51:24.269838] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.223 [2024-11-28 11:51:24.270156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.223 [2024-11-28 11:51:24.270269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.223 [2024-11-28 11:51:24.270310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.223 [2024-11-28 11:51:24.270326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.223 [2024-11-28 11:51:24.270458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.223 [2024-11-28 11:51:24.270616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.223 [2024-11-28 11:51:24.270638] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.223 [2024-11-28 11:51:24.270652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.223 [2024-11-28 11:51:24.272797] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.483 [2024-11-28 11:51:24.282498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.483 [2024-11-28 11:51:24.282844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.483 [2024-11-28 11:51:24.282988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.483 [2024-11-28 11:51:24.283014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.483 [2024-11-28 11:51:24.283029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.483 [2024-11-28 11:51:24.283161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.483 [2024-11-28 11:51:24.283351] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.483 [2024-11-28 11:51:24.283370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.483 [2024-11-28 11:51:24.283383] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.483 [2024-11-28 11:51:24.285468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.483 [2024-11-28 11:51:24.294547] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.483 [2024-11-28 11:51:24.294898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.483 [2024-11-28 11:51:24.295009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.483 [2024-11-28 11:51:24.295035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.483 [2024-11-28 11:51:24.295050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.483 [2024-11-28 11:51:24.295199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.483 [2024-11-28 11:51:24.295357] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.483 [2024-11-28 11:51:24.295376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.483 [2024-11-28 11:51:24.295394] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.483 [2024-11-28 11:51:24.297380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.483 [2024-11-28 11:51:24.306833] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.483 [2024-11-28 11:51:24.307176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.307319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.307344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.484 [2024-11-28 11:51:24.307360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.484 [2024-11-28 11:51:24.307509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.484 [2024-11-28 11:51:24.307666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.484 [2024-11-28 11:51:24.307687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.484 [2024-11-28 11:51:24.307700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.484 [2024-11-28 11:51:24.309587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.484 [2024-11-28 11:51:24.318984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.484 [2024-11-28 11:51:24.319365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.319498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.319531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.484 [2024-11-28 11:51:24.319550] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.484 [2024-11-28 11:51:24.319714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.484 [2024-11-28 11:51:24.319850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.484 [2024-11-28 11:51:24.319885] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.484 [2024-11-28 11:51:24.319898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.484 [2024-11-28 11:51:24.321766] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.484 [2024-11-28 11:51:24.330953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.484 [2024-11-28 11:51:24.331301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.331462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.331488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.484 [2024-11-28 11:51:24.331504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.484 [2024-11-28 11:51:24.331661] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.484 [2024-11-28 11:51:24.331860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.484 [2024-11-28 11:51:24.331894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.484 [2024-11-28 11:51:24.331907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.484 [2024-11-28 11:51:24.333896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.484 [2024-11-28 11:51:24.343163] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.484 [2024-11-28 11:51:24.343536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.343709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.343735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.484 [2024-11-28 11:51:24.343752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.484 [2024-11-28 11:51:24.343961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.484 [2024-11-28 11:51:24.344117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.484 [2024-11-28 11:51:24.344136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.484 [2024-11-28 11:51:24.344149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.484 [2024-11-28 11:51:24.346102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.484 [2024-11-28 11:51:24.355274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.484 [2024-11-28 11:51:24.355686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.355804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.355832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.484 [2024-11-28 11:51:24.355848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.484 [2024-11-28 11:51:24.356011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.484 [2024-11-28 11:51:24.356168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.484 [2024-11-28 11:51:24.356188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.484 [2024-11-28 11:51:24.356201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.484 [2024-11-28 11:51:24.358369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.484 [2024-11-28 11:51:24.367435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.484 [2024-11-28 11:51:24.367824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.367959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.367985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.484 [2024-11-28 11:51:24.368001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.484 [2024-11-28 11:51:24.368164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.484 [2024-11-28 11:51:24.368367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.484 [2024-11-28 11:51:24.368386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.484 [2024-11-28 11:51:24.368399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.484 [2024-11-28 11:51:24.370401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.484 [2024-11-28 11:51:24.379937] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.484 [2024-11-28 11:51:24.380301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.380474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.380500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.484 [2024-11-28 11:51:24.380515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.484 [2024-11-28 11:51:24.380674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.484 [2024-11-28 11:51:24.380808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.484 [2024-11-28 11:51:24.380845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.484 [2024-11-28 11:51:24.380858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.484 [2024-11-28 11:51:24.382898] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.484 [2024-11-28 11:51:24.392094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.484 [2024-11-28 11:51:24.392430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.392565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.392592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.484 [2024-11-28 11:51:24.392608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.484 [2024-11-28 11:51:24.392724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.484 [2024-11-28 11:51:24.392870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.484 [2024-11-28 11:51:24.392905] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.484 [2024-11-28 11:51:24.392918] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.484 [2024-11-28 11:51:24.394955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.484 [2024-11-28 11:51:24.404629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.484 [2024-11-28 11:51:24.405013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.405136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.405161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.484 [2024-11-28 11:51:24.405177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.484 [2024-11-28 11:51:24.405326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.484 [2024-11-28 11:51:24.405554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.484 [2024-11-28 11:51:24.405576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.484 [2024-11-28 11:51:24.405589] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.484 [2024-11-28 11:51:24.407772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.484 [2024-11-28 11:51:24.416809] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.484 [2024-11-28 11:51:24.417184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.417321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.484 [2024-11-28 11:51:24.417347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.484 [2024-11-28 11:51:24.417364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.484 [2024-11-28 11:51:24.417568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.485 [2024-11-28 11:51:24.417726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.485 [2024-11-28 11:51:24.417746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.485 [2024-11-28 11:51:24.417759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.485 [2024-11-28 11:51:24.419668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.485 [2024-11-28 11:51:24.428842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.485 [2024-11-28 11:51:24.429160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.429277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.429303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.485 [2024-11-28 11:51:24.429319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.485 [2024-11-28 11:51:24.429466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.485 [2024-11-28 11:51:24.429652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.485 [2024-11-28 11:51:24.429675] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.485 [2024-11-28 11:51:24.429689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.485 [2024-11-28 11:51:24.431629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.485 [2024-11-28 11:51:24.441000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.485 [2024-11-28 11:51:24.441333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.441473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.441500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.485 [2024-11-28 11:51:24.441516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.485 [2024-11-28 11:51:24.441720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.485 [2024-11-28 11:51:24.441898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.485 [2024-11-28 11:51:24.441918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.485 [2024-11-28 11:51:24.441931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.485 [2024-11-28 11:51:24.443973] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.485 [2024-11-28 11:51:24.453245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.485 [2024-11-28 11:51:24.453623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.453791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.453822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.485 [2024-11-28 11:51:24.453839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.485 [2024-11-28 11:51:24.454003] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.485 [2024-11-28 11:51:24.454175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.485 [2024-11-28 11:51:24.454194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.485 [2024-11-28 11:51:24.454207] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.485 [2024-11-28 11:51:24.456236] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.485 [2024-11-28 11:51:24.465383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.485 [2024-11-28 11:51:24.465739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.465958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.465984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.485 [2024-11-28 11:51:24.465999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.485 [2024-11-28 11:51:24.466161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.485 [2024-11-28 11:51:24.466288] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.485 [2024-11-28 11:51:24.466307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.485 [2024-11-28 11:51:24.466320] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.485 [2024-11-28 11:51:24.468237] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.485 [2024-11-28 11:51:24.477776] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.485 [2024-11-28 11:51:24.478131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.478272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.478298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.485 [2024-11-28 11:51:24.478313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.485 [2024-11-28 11:51:24.478478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.485 [2024-11-28 11:51:24.478647] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.485 [2024-11-28 11:51:24.478668] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.485 [2024-11-28 11:51:24.478681] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.485 [2024-11-28 11:51:24.480683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.485 [2024-11-28 11:51:24.489926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.485 [2024-11-28 11:51:24.490258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.490393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.490419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.485 [2024-11-28 11:51:24.490440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.485 [2024-11-28 11:51:24.490606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.485 [2024-11-28 11:51:24.490767] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.485 [2024-11-28 11:51:24.490787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.485 [2024-11-28 11:51:24.490800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.485 [2024-11-28 11:51:24.492746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.485 [2024-11-28 11:51:24.502087] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.485 [2024-11-28 11:51:24.502498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.502624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.502649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.485 [2024-11-28 11:51:24.502665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.485 [2024-11-28 11:51:24.502844] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.485 [2024-11-28 11:51:24.503001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.485 [2024-11-28 11:51:24.503020] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.485 [2024-11-28 11:51:24.503033] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.485 [2024-11-28 11:51:24.505160] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.485 [2024-11-28 11:51:24.514323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.485 [2024-11-28 11:51:24.514599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.514736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.514762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.485 [2024-11-28 11:51:24.514778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.485 [2024-11-28 11:51:24.514878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.485 [2024-11-28 11:51:24.515070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.485 [2024-11-28 11:51:24.515089] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.485 [2024-11-28 11:51:24.515102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.485 [2024-11-28 11:51:24.517255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.485 [2024-11-28 11:51:24.526430] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.485 [2024-11-28 11:51:24.526796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.526938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.485 [2024-11-28 11:51:24.526964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.485 [2024-11-28 11:51:24.526979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.485 [2024-11-28 11:51:24.527149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.485 [2024-11-28 11:51:24.527310] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.485 [2024-11-28 11:51:24.527330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.485 [2024-11-28 11:51:24.527342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.486 [2024-11-28 11:51:24.529298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.745 [2024-11-28 11:51:24.538978] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.745 [2024-11-28 11:51:24.539233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.745 [2024-11-28 11:51:24.539406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.745 [2024-11-28 11:51:24.539432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.745 [2024-11-28 11:51:24.539448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.745 [2024-11-28 11:51:24.539607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.745 [2024-11-28 11:51:24.539788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.745 [2024-11-28 11:51:24.539809] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.745 [2024-11-28 11:51:24.539839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.745 [2024-11-28 11:51:24.541760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.745 [2024-11-28 11:51:24.551200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.745 [2024-11-28 11:51:24.551536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.745 [2024-11-28 11:51:24.551670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.745 [2024-11-28 11:51:24.551695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.745 [2024-11-28 11:51:24.551711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.745 [2024-11-28 11:51:24.551892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.745 [2024-11-28 11:51:24.552064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.745 [2024-11-28 11:51:24.552083] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.745 [2024-11-28 11:51:24.552095] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.745 [2024-11-28 11:51:24.554133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.745 [2024-11-28 11:51:24.563605] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.745 [2024-11-28 11:51:24.563928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.745 [2024-11-28 11:51:24.564147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.745 [2024-11-28 11:51:24.564173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.745 [2024-11-28 11:51:24.564204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.745 [2024-11-28 11:51:24.564363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.745 [2024-11-28 11:51:24.564570] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.745 [2024-11-28 11:51:24.564591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.745 [2024-11-28 11:51:24.564620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.745 [2024-11-28 11:51:24.566788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.745 [2024-11-28 11:51:24.575689] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.745 [2024-11-28 11:51:24.576012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.745 [2024-11-28 11:51:24.576147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.745 [2024-11-28 11:51:24.576173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.745 [2024-11-28 11:51:24.576189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.745 [2024-11-28 11:51:24.576352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.745 [2024-11-28 11:51:24.576567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.745 [2024-11-28 11:51:24.576588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.745 [2024-11-28 11:51:24.576616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.745 [2024-11-28 11:51:24.578549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.745 [2024-11-28 11:51:24.587841] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.745 [2024-11-28 11:51:24.588275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.588428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.588454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.746 [2024-11-28 11:51:24.588470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.746 [2024-11-28 11:51:24.588643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.746 [2024-11-28 11:51:24.588818] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.746 [2024-11-28 11:51:24.588852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.746 [2024-11-28 11:51:24.588865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.746 [2024-11-28 11:51:24.590613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.746 [2024-11-28 11:51:24.599998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.746 [2024-11-28 11:51:24.600378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.600544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.600570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.746 [2024-11-28 11:51:24.600586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.746 [2024-11-28 11:51:24.600702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.746 [2024-11-28 11:51:24.600894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.746 [2024-11-28 11:51:24.600918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.746 [2024-11-28 11:51:24.600931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.746 [2024-11-28 11:51:24.602969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.746 [2024-11-28 11:51:24.612307] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.746 [2024-11-28 11:51:24.612617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.612746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.612772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.746 [2024-11-28 11:51:24.612788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.746 [2024-11-28 11:51:24.612938] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.746 [2024-11-28 11:51:24.613127] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.746 [2024-11-28 11:51:24.613147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.746 [2024-11-28 11:51:24.613160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.746 [2024-11-28 11:51:24.615190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.746 [2024-11-28 11:51:24.624446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.746 [2024-11-28 11:51:24.624746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.624908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.624932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.746 [2024-11-28 11:51:24.624948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.746 [2024-11-28 11:51:24.625091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.746 [2024-11-28 11:51:24.625246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.746 [2024-11-28 11:51:24.625266] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.746 [2024-11-28 11:51:24.625278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.746 [2024-11-28 11:51:24.627344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.746 [2024-11-28 11:51:24.636645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.746 [2024-11-28 11:51:24.637036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.637152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.637177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.746 [2024-11-28 11:51:24.637193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.746 [2024-11-28 11:51:24.637309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.746 [2024-11-28 11:51:24.637444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.746 [2024-11-28 11:51:24.637464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.746 [2024-11-28 11:51:24.637497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.746 [2024-11-28 11:51:24.639408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.746 [2024-11-28 11:51:24.648764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.746 [2024-11-28 11:51:24.649100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.649233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.649258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.746 [2024-11-28 11:51:24.649274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.746 [2024-11-28 11:51:24.649406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.746 [2024-11-28 11:51:24.649626] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.746 [2024-11-28 11:51:24.649649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.746 [2024-11-28 11:51:24.649664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.746 [2024-11-28 11:51:24.651688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.746 [2024-11-28 11:51:24.660861] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.746 [2024-11-28 11:51:24.661181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.661323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.661348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.746 [2024-11-28 11:51:24.661364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.746 [2024-11-28 11:51:24.661538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.746 [2024-11-28 11:51:24.661692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.746 [2024-11-28 11:51:24.661713] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.746 [2024-11-28 11:51:24.661727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.746 [2024-11-28 11:51:24.663653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.746 [2024-11-28 11:51:24.673402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.746 [2024-11-28 11:51:24.673805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.674003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.674030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.746 [2024-11-28 11:51:24.674046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.746 [2024-11-28 11:51:24.674226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.746 [2024-11-28 11:51:24.674341] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.746 [2024-11-28 11:51:24.674361] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.746 [2024-11-28 11:51:24.674375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.746 [2024-11-28 11:51:24.676468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.746 [2024-11-28 11:51:24.685387] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.746 [2024-11-28 11:51:24.685708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.685846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.746 [2024-11-28 11:51:24.685872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.746 [2024-11-28 11:51:24.685887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.746 [2024-11-28 11:51:24.686051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.746 [2024-11-28 11:51:24.686167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.746 [2024-11-28 11:51:24.686187] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.746 [2024-11-28 11:51:24.686199] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.746 [2024-11-28 11:51:24.688218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.746 [2024-11-28 11:51:24.697667] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.746 [2024-11-28 11:51:24.698072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.698254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.698280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.747 [2024-11-28 11:51:24.698296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.747 [2024-11-28 11:51:24.698459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.747 [2024-11-28 11:51:24.698651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.747 [2024-11-28 11:51:24.698673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.747 [2024-11-28 11:51:24.698687] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.747 [2024-11-28 11:51:24.700711] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.747 [2024-11-28 11:51:24.709790] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.747 [2024-11-28 11:51:24.710142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.710280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.710307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.747 [2024-11-28 11:51:24.710322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.747 [2024-11-28 11:51:24.710486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.747 [2024-11-28 11:51:24.710622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.747 [2024-11-28 11:51:24.710643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.747 [2024-11-28 11:51:24.710657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.747 [2024-11-28 11:51:24.712708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.747 [2024-11-28 11:51:24.721961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.747 [2024-11-28 11:51:24.722318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.722487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.722513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.747 [2024-11-28 11:51:24.722537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.747 [2024-11-28 11:51:24.722704] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.747 [2024-11-28 11:51:24.722851] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.747 [2024-11-28 11:51:24.722871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.747 [2024-11-28 11:51:24.722883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.747 [2024-11-28 11:51:24.724882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.747 [2024-11-28 11:51:24.734071] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.747 [2024-11-28 11:51:24.734486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.734633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.734660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.747 [2024-11-28 11:51:24.734676] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.747 [2024-11-28 11:51:24.734842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.747 [2024-11-28 11:51:24.735075] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.747 [2024-11-28 11:51:24.735095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.747 [2024-11-28 11:51:24.735108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.747 [2024-11-28 11:51:24.737105] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.747 [2024-11-28 11:51:24.746108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.747 [2024-11-28 11:51:24.746455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.746626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.746652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.747 [2024-11-28 11:51:24.746668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.747 [2024-11-28 11:51:24.746817] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.747 [2024-11-28 11:51:24.746993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.747 [2024-11-28 11:51:24.747012] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.747 [2024-11-28 11:51:24.747025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.747 [2024-11-28 11:51:24.748903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.747 [2024-11-28 11:51:24.758457] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.747 [2024-11-28 11:51:24.758844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.759034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.759060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.747 [2024-11-28 11:51:24.759076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.747 [2024-11-28 11:51:24.759256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.747 [2024-11-28 11:51:24.759413] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.747 [2024-11-28 11:51:24.759433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.747 [2024-11-28 11:51:24.759445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.747 [2024-11-28 11:51:24.761455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.747 [2024-11-28 11:51:24.770809] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.747 [2024-11-28 11:51:24.771104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.771236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.771262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.747 [2024-11-28 11:51:24.771278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.747 [2024-11-28 11:51:24.771426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.747 [2024-11-28 11:51:24.771600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.747 [2024-11-28 11:51:24.771622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.747 [2024-11-28 11:51:24.771636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.747 [2024-11-28 11:51:24.773930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.747 [2024-11-28 11:51:24.782954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.747 [2024-11-28 11:51:24.783286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.783399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.783425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.747 [2024-11-28 11:51:24.783441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.747 [2024-11-28 11:51:24.783566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.747 [2024-11-28 11:51:24.783793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.747 [2024-11-28 11:51:24.783829] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.747 [2024-11-28 11:51:24.783842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.747 [2024-11-28 11:51:24.785985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.747 [2024-11-28 11:51:24.795327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.747 [2024-11-28 11:51:24.795744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.795872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.747 [2024-11-28 11:51:24.795902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:04.747 [2024-11-28 11:51:24.795918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:04.747 [2024-11-28 11:51:24.796067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:04.747 [2024-11-28 11:51:24.796242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.747 [2024-11-28 11:51:24.796261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.748 [2024-11-28 11:51:24.796274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.748 [2024-11-28 11:51:24.798430] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.007 [2024-11-28 11:51:24.807571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.007 [2024-11-28 11:51:24.807896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.007 [2024-11-28 11:51:24.808055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.007 [2024-11-28 11:51:24.808080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.007 [2024-11-28 11:51:24.808096] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.007 [2024-11-28 11:51:24.808275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.007 [2024-11-28 11:51:24.808462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.007 [2024-11-28 11:51:24.808482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.007 [2024-11-28 11:51:24.808494] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.007 [2024-11-28 11:51:24.810579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.007 [2024-11-28 11:51:24.819748] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.007 [2024-11-28 11:51:24.820172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.007 [2024-11-28 11:51:24.820318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.007 [2024-11-28 11:51:24.820344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.007 [2024-11-28 11:51:24.820360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.007 [2024-11-28 11:51:24.820550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.007 [2024-11-28 11:51:24.820710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.007 [2024-11-28 11:51:24.820730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.007 [2024-11-28 11:51:24.820744] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.007 [2024-11-28 11:51:24.822725] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.007 [2024-11-28 11:51:24.832097] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.007 [2024-11-28 11:51:24.832467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.007 [2024-11-28 11:51:24.832609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.007 [2024-11-28 11:51:24.832636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.007 [2024-11-28 11:51:24.832657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.007 [2024-11-28 11:51:24.832790] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.007 [2024-11-28 11:51:24.832964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.007 [2024-11-28 11:51:24.832984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.007 [2024-11-28 11:51:24.832996] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.007 [2024-11-28 11:51:24.834939] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.007 [2024-11-28 11:51:24.844161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.007 [2024-11-28 11:51:24.844519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.007 [2024-11-28 11:51:24.844671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.007 [2024-11-28 11:51:24.844697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.007 [2024-11-28 11:51:24.844712] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.007 [2024-11-28 11:51:24.844892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.007 [2024-11-28 11:51:24.845092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.007 [2024-11-28 11:51:24.845112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.007 [2024-11-28 11:51:24.845125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.007 [2024-11-28 11:51:24.847207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.007 [2024-11-28 11:51:24.856310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.007 [2024-11-28 11:51:24.856654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.007 [2024-11-28 11:51:24.856797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.856823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.008 [2024-11-28 11:51:24.856839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.008 [2024-11-28 11:51:24.857004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.008 [2024-11-28 11:51:24.857209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.008 [2024-11-28 11:51:24.857228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.008 [2024-11-28 11:51:24.857241] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.008 [2024-11-28 11:51:24.859170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.008 [2024-11-28 11:51:24.868600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.008 [2024-11-28 11:51:24.868892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.869028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.869054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.008 [2024-11-28 11:51:24.869070] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.008 [2024-11-28 11:51:24.869255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.008 [2024-11-28 11:51:24.869426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.008 [2024-11-28 11:51:24.869446] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.008 [2024-11-28 11:51:24.869458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.008 [2024-11-28 11:51:24.871317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.008 [2024-11-28 11:51:24.880807] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.008 [2024-11-28 11:51:24.881154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.881314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.881340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.008 [2024-11-28 11:51:24.881356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.008 [2024-11-28 11:51:24.881505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.008 [2024-11-28 11:51:24.881673] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.008 [2024-11-28 11:51:24.881694] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.008 [2024-11-28 11:51:24.881708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.008 [2024-11-28 11:51:24.883789] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.008 [2024-11-28 11:51:24.892915] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.008 [2024-11-28 11:51:24.893247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.893384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.893410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.008 [2024-11-28 11:51:24.893425] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.008 [2024-11-28 11:51:24.893597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.008 [2024-11-28 11:51:24.893760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.008 [2024-11-28 11:51:24.893780] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.008 [2024-11-28 11:51:24.893793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.008 [2024-11-28 11:51:24.895946] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.008 [2024-11-28 11:51:24.905157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.008 [2024-11-28 11:51:24.905510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.905666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.905693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.008 [2024-11-28 11:51:24.905709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.008 [2024-11-28 11:51:24.905824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.008 [2024-11-28 11:51:24.906021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.008 [2024-11-28 11:51:24.906041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.008 [2024-11-28 11:51:24.906054] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.008 [2024-11-28 11:51:24.908139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.008 [2024-11-28 11:51:24.917399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.008 [2024-11-28 11:51:24.917718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.917867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.917893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.008 [2024-11-28 11:51:24.917909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.008 [2024-11-28 11:51:24.918025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.008 [2024-11-28 11:51:24.918218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.008 [2024-11-28 11:51:24.918254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.008 [2024-11-28 11:51:24.918267] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.008 [2024-11-28 11:51:24.920309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.008 [2024-11-28 11:51:24.929691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.008 [2024-11-28 11:51:24.930110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.930252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.930279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.008 [2024-11-28 11:51:24.930295] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.008 [2024-11-28 11:51:24.930442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.008 [2024-11-28 11:51:24.930565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.008 [2024-11-28 11:51:24.930587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.008 [2024-11-28 11:51:24.930600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.008 [2024-11-28 11:51:24.932640] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.008 [2024-11-28 11:51:24.941916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.008 [2024-11-28 11:51:24.942214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.942377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.008 [2024-11-28 11:51:24.942403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.008 [2024-11-28 11:51:24.942419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.008 [2024-11-28 11:51:24.942542] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.009 [2024-11-28 11:51:24.942718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.009 [2024-11-28 11:51:24.942743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.009 [2024-11-28 11:51:24.942756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.009 [2024-11-28 11:51:24.944672] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.009 [2024-11-28 11:51:24.954164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.009 [2024-11-28 11:51:24.954544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.009 [2024-11-28 11:51:24.954683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.009 [2024-11-28 11:51:24.954708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.009 [2024-11-28 11:51:24.954724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.009 [2024-11-28 11:51:24.954893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.009 [2024-11-28 11:51:24.955066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.009 [2024-11-28 11:51:24.955085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.009 [2024-11-28 11:51:24.955098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.009 [2024-11-28 11:51:24.957164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.009 [2024-11-28 11:51:24.966289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.009 [2024-11-28 11:51:24.966634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.009 [2024-11-28 11:51:24.966751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.009 [2024-11-28 11:51:24.966776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.009 [2024-11-28 11:51:24.966792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.009 [2024-11-28 11:51:24.966986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.009 [2024-11-28 11:51:24.967115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.009 [2024-11-28 11:51:24.967134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.009 [2024-11-28 11:51:24.967147] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.009 [2024-11-28 11:51:24.969091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.009 [2024-11-28 11:51:24.978585] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.009 [2024-11-28 11:51:24.978876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.009 [2024-11-28 11:51:24.979019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.009 [2024-11-28 11:51:24.979044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.009 [2024-11-28 11:51:24.979059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.009 [2024-11-28 11:51:24.979190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.009 [2024-11-28 11:51:24.979376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.009 [2024-11-28 11:51:24.979395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.009 [2024-11-28 11:51:24.979413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.009 [2024-11-28 11:51:24.981402] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.009 [2024-11-28 11:51:24.990606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.009 [2024-11-28 11:51:24.990997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.009 [2024-11-28 11:51:24.991217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.009 [2024-11-28 11:51:24.991257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.009 [2024-11-28 11:51:24.991272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.009 [2024-11-28 11:51:24.991399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.009 [2024-11-28 11:51:24.991533] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.009 [2024-11-28 11:51:24.991568] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.009 [2024-11-28 11:51:24.991582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.009 [2024-11-28 11:51:24.993448] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.009 [2024-11-28 11:51:25.002749] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.009 [2024-11-28 11:51:25.003097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.009 [2024-11-28 11:51:25.003221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.009 [2024-11-28 11:51:25.003246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.009 [2024-11-28 11:51:25.003261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.009 [2024-11-28 11:51:25.003436] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.009 [2024-11-28 11:51:25.003624] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.009 [2024-11-28 11:51:25.003646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.009 [2024-11-28 11:51:25.003660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.009 [2024-11-28 11:51:25.005600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.009 [2024-11-28 11:51:25.015054] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.009 [2024-11-28 11:51:25.015416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.009 [2024-11-28 11:51:25.015566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.009 [2024-11-28 11:51:25.015593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.009 [2024-11-28 11:51:25.015608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.009 [2024-11-28 11:51:25.015773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.009 [2024-11-28 11:51:25.015932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.009 [2024-11-28 11:51:25.015952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.009 [2024-11-28 11:51:25.015965] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.009 [2024-11-28 11:51:25.018002] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.009 [2024-11-28 11:51:25.027229] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.009 [2024-11-28 11:51:25.027662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.009 [2024-11-28 11:51:25.027796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.009 [2024-11-28 11:51:25.027822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.009 [2024-11-28 11:51:25.027838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.010 [2024-11-28 11:51:25.028043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.010 [2024-11-28 11:51:25.028181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.010 [2024-11-28 11:51:25.028201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.010 [2024-11-28 11:51:25.028214] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.010 [2024-11-28 11:51:25.030317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.010 [2024-11-28 11:51:25.039425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.010 [2024-11-28 11:51:25.039720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.010 [2024-11-28 11:51:25.039838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.010 [2024-11-28 11:51:25.039864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.010 [2024-11-28 11:51:25.039880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.010 [2024-11-28 11:51:25.040012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.010 [2024-11-28 11:51:25.040204] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.010 [2024-11-28 11:51:25.040223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.010 [2024-11-28 11:51:25.040236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.010 [2024-11-28 11:51:25.042145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.010 [2024-11-28 11:51:25.051607] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.010 [2024-11-28 11:51:25.052001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.010 [2024-11-28 11:51:25.052128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.010 [2024-11-28 11:51:25.052153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.010 [2024-11-28 11:51:25.052169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.010 [2024-11-28 11:51:25.052348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.010 [2024-11-28 11:51:25.052518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.010 [2024-11-28 11:51:25.052548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.010 [2024-11-28 11:51:25.052561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.010 [2024-11-28 11:51:25.054475] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.277 [2024-11-28 11:51:25.063953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.277 [2024-11-28 11:51:25.064299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.278 [2024-11-28 11:51:25.064440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.278 [2024-11-28 11:51:25.064466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.278 [2024-11-28 11:51:25.064482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.278 [2024-11-28 11:51:25.064625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.278 [2024-11-28 11:51:25.064791] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.278 [2024-11-28 11:51:25.064812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.278 [2024-11-28 11:51:25.064825] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.278 [2024-11-28 11:51:25.066962] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.278 [2024-11-28 11:51:25.076157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.278 [2024-11-28 11:51:25.076491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.278 [2024-11-28 11:51:25.076643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.278 [2024-11-28 11:51:25.076669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.278 [2024-11-28 11:51:25.076685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.278 [2024-11-28 11:51:25.076833] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.278 [2024-11-28 11:51:25.076992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.278 [2024-11-28 11:51:25.077012] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.279 [2024-11-28 11:51:25.077025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.279 [2024-11-28 11:51:25.079067] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.279 [2024-11-28 11:51:25.088445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.279 [2024-11-28 11:51:25.088748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.279 [2024-11-28 11:51:25.088893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.279 [2024-11-28 11:51:25.088919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.279 [2024-11-28 11:51:25.088935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.279 [2024-11-28 11:51:25.089051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.279 [2024-11-28 11:51:25.089197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.279 [2024-11-28 11:51:25.089216] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.279 [2024-11-28 11:51:25.089229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.279 [2024-11-28 11:51:25.091226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.279 [2024-11-28 11:51:25.100621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.279 [2024-11-28 11:51:25.100915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.279 [2024-11-28 11:51:25.101033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.279 [2024-11-28 11:51:25.101060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.279 [2024-11-28 11:51:25.101076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.279 [2024-11-28 11:51:25.101269] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.279 [2024-11-28 11:51:25.101438] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.279 [2024-11-28 11:51:25.101457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.279 [2024-11-28 11:51:25.101469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.279 [2024-11-28 11:51:25.103730] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.279 [2024-11-28 11:51:25.113370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.279 [2024-11-28 11:51:25.113828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.279 [2024-11-28 11:51:25.114092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.279 [2024-11-28 11:51:25.114121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.280 [2024-11-28 11:51:25.114139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.280 [2024-11-28 11:51:25.114323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.280 [2024-11-28 11:51:25.114456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.280 [2024-11-28 11:51:25.114479] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.280 [2024-11-28 11:51:25.114494] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.280 [2024-11-28 11:51:25.116772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.280 [2024-11-28 11:51:25.125961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.280 [2024-11-28 11:51:25.126362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.280 [2024-11-28 11:51:25.126521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.280 [2024-11-28 11:51:25.126570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.280 [2024-11-28 11:51:25.126588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.280 [2024-11-28 11:51:25.126770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.280 [2024-11-28 11:51:25.126940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.280 [2024-11-28 11:51:25.126963] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.280 [2024-11-28 11:51:25.126978] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.280 [2024-11-28 11:51:25.129347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.280 [2024-11-28 11:51:25.138479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.280 [2024-11-28 11:51:25.138867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.280 [2024-11-28 11:51:25.139047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.281 [2024-11-28 11:51:25.139085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.281 [2024-11-28 11:51:25.139103] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.281 [2024-11-28 11:51:25.139287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.281 [2024-11-28 11:51:25.139420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.281 [2024-11-28 11:51:25.139444] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.281 [2024-11-28 11:51:25.139459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.281 [2024-11-28 11:51:25.142016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.281 [2024-11-28 11:51:25.151027] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.281 [2024-11-28 11:51:25.151364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.281 [2024-11-28 11:51:25.151495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.281 [2024-11-28 11:51:25.151546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.281 [2024-11-28 11:51:25.151563] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.281 [2024-11-28 11:51:25.151743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.281 [2024-11-28 11:51:25.151910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.281 [2024-11-28 11:51:25.151933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.281 [2024-11-28 11:51:25.151949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.281 [2024-11-28 11:51:25.154285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.281 [2024-11-28 11:51:25.163738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.281 [2024-11-28 11:51:25.164199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.281 [2024-11-28 11:51:25.164381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.282 [2024-11-28 11:51:25.164409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.282 [2024-11-28 11:51:25.164426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.282 [2024-11-28 11:51:25.164584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.282 [2024-11-28 11:51:25.164755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.282 [2024-11-28 11:51:25.164779] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.282 [2024-11-28 11:51:25.164796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.282 [2024-11-28 11:51:25.166920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.282 [2024-11-28 11:51:25.176354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.282 [2024-11-28 11:51:25.176703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.282 [2024-11-28 11:51:25.176881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.282 [2024-11-28 11:51:25.176909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.282 [2024-11-28 11:51:25.176933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.282 [2024-11-28 11:51:25.177045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.282 [2024-11-28 11:51:25.177196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.282 [2024-11-28 11:51:25.177220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.282 [2024-11-28 11:51:25.177236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.282 [2024-11-28 11:51:25.179678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.282 [2024-11-28 11:51:25.188891] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.282 [2024-11-28 11:51:25.189297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.282 [2024-11-28 11:51:25.189459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.282 [2024-11-28 11:51:25.189485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.282 [2024-11-28 11:51:25.189501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.282 [2024-11-28 11:51:25.189625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.282 [2024-11-28 11:51:25.189809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.282 [2024-11-28 11:51:25.189833] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.282 [2024-11-28 11:51:25.189849] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.282 [2024-11-28 11:51:25.192253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.282 [2024-11-28 11:51:25.201598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.282 [2024-11-28 11:51:25.202015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.282 [2024-11-28 11:51:25.202284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.282 [2024-11-28 11:51:25.202313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.282 [2024-11-28 11:51:25.202330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.282 [2024-11-28 11:51:25.202513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.282 [2024-11-28 11:51:25.202730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.282 [2024-11-28 11:51:25.202754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.282 [2024-11-28 11:51:25.202770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.282 [2024-11-28 11:51:25.205141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.282 [2024-11-28 11:51:25.214161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.282 [2024-11-28 11:51:25.214530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.282 [2024-11-28 11:51:25.214691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.282 [2024-11-28 11:51:25.214717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.282 [2024-11-28 11:51:25.214749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.282 [2024-11-28 11:51:25.214939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.282 [2024-11-28 11:51:25.215072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.282 [2024-11-28 11:51:25.215096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.282 [2024-11-28 11:51:25.215111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.282 [2024-11-28 11:51:25.217350] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.282 [2024-11-28 11:51:25.226536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.282 [2024-11-28 11:51:25.226903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.282 [2024-11-28 11:51:25.227088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.282 [2024-11-28 11:51:25.227117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.282 [2024-11-28 11:51:25.227133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.282 [2024-11-28 11:51:25.227295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.283 [2024-11-28 11:51:25.227498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.283 [2024-11-28 11:51:25.227522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.283 [2024-11-28 11:51:25.227550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.283 [2024-11-28 11:51:25.230026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.283 [2024-11-28 11:51:25.238915] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.283 [2024-11-28 11:51:25.239289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.239470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.239495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.283 [2024-11-28 11:51:25.239511] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.283 [2024-11-28 11:51:25.239665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.283 [2024-11-28 11:51:25.239812] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.283 [2024-11-28 11:51:25.239836] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.283 [2024-11-28 11:51:25.239852] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.283 [2024-11-28 11:51:25.241932] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.283 [2024-11-28 11:51:25.251547] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.283 [2024-11-28 11:51:25.251918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.252144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.252169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.283 [2024-11-28 11:51:25.252185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.283 [2024-11-28 11:51:25.252316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.283 [2024-11-28 11:51:25.252560] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.283 [2024-11-28 11:51:25.252584] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.283 [2024-11-28 11:51:25.252601] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.283 [2024-11-28 11:51:25.254930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.283 [2024-11-28 11:51:25.264082] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.283 [2024-11-28 11:51:25.264450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.264600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.264631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.283 [2024-11-28 11:51:25.264648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.283 [2024-11-28 11:51:25.264795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.283 [2024-11-28 11:51:25.264964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.283 [2024-11-28 11:51:25.264988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.283 [2024-11-28 11:51:25.265003] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.283 [2024-11-28 11:51:25.267340] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.283 [2024-11-28 11:51:25.276574] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.283 [2024-11-28 11:51:25.276906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.277165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.277190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.283 [2024-11-28 11:51:25.277206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.283 [2024-11-28 11:51:25.277380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.283 [2024-11-28 11:51:25.277575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.283 [2024-11-28 11:51:25.277600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.283 [2024-11-28 11:51:25.277616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.283 [2024-11-28 11:51:25.279878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.283 [2024-11-28 11:51:25.289170] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.283 [2024-11-28 11:51:25.289541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.289711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.289736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.283 [2024-11-28 11:51:25.289752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.283 [2024-11-28 11:51:25.289964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.283 [2024-11-28 11:51:25.290151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.283 [2024-11-28 11:51:25.290180] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.283 [2024-11-28 11:51:25.290196] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.283 [2024-11-28 11:51:25.292513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.283 [2024-11-28 11:51:25.301596] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.283 [2024-11-28 11:51:25.301949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.302148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.302174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.283 [2024-11-28 11:51:25.302189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.283 [2024-11-28 11:51:25.302441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.283 [2024-11-28 11:51:25.302622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.283 [2024-11-28 11:51:25.302647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.283 [2024-11-28 11:51:25.302663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.283 [2024-11-28 11:51:25.305084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.283 [2024-11-28 11:51:25.314309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.283 [2024-11-28 11:51:25.314598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.314718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.314743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.283 [2024-11-28 11:51:25.314759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.283 [2024-11-28 11:51:25.314901] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.283 [2024-11-28 11:51:25.315052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.283 [2024-11-28 11:51:25.315076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.283 [2024-11-28 11:51:25.315091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.283 [2024-11-28 11:51:25.317335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.283 [2024-11-28 11:51:25.327085] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.283 [2024-11-28 11:51:25.327423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.327582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.283 [2024-11-28 11:51:25.327610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.283 [2024-11-28 11:51:25.327628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.283 [2024-11-28 11:51:25.327792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.283 [2024-11-28 11:51:25.327979] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.283 [2024-11-28 11:51:25.328003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.283 [2024-11-28 11:51:25.328024] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.582 [2024-11-28 11:51:25.330479] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.582 [2024-11-28 11:51:25.339447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.582 [2024-11-28 11:51:25.339747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.582 [2024-11-28 11:51:25.339899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.582 [2024-11-28 11:51:25.339928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.582 [2024-11-28 11:51:25.339946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.582 [2024-11-28 11:51:25.340111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.582 [2024-11-28 11:51:25.340334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.582 [2024-11-28 11:51:25.340358] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.582 [2024-11-28 11:51:25.340374] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.582 [2024-11-28 11:51:25.342781] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.582 [2024-11-28 11:51:25.352056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.582 [2024-11-28 11:51:25.352313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.582 [2024-11-28 11:51:25.352540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.582 [2024-11-28 11:51:25.352567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.582 [2024-11-28 11:51:25.352583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.582 [2024-11-28 11:51:25.352735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.582 [2024-11-28 11:51:25.352921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.582 [2024-11-28 11:51:25.352945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.582 [2024-11-28 11:51:25.352960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.582 [2024-11-28 11:51:25.355315] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.582 [2024-11-28 11:51:25.364623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.582 [2024-11-28 11:51:25.365022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.582 [2024-11-28 11:51:25.365243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.582 [2024-11-28 11:51:25.365268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.582 [2024-11-28 11:51:25.365284] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.582 [2024-11-28 11:51:25.365476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.582 [2024-11-28 11:51:25.365666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.582 [2024-11-28 11:51:25.365691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.582 [2024-11-28 11:51:25.365707] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.582 [2024-11-28 11:51:25.368079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.582 [2024-11-28 11:51:25.377238] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.582 [2024-11-28 11:51:25.377598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.582 [2024-11-28 11:51:25.377907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.582 [2024-11-28 11:51:25.377933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.582 [2024-11-28 11:51:25.377949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.582 [2024-11-28 11:51:25.378132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.582 [2024-11-28 11:51:25.378265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.582 [2024-11-28 11:51:25.378288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.582 [2024-11-28 11:51:25.378304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.582 [2024-11-28 11:51:25.380630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.582 [2024-11-28 11:51:25.390004] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.582 [2024-11-28 11:51:25.390336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.582 [2024-11-28 11:51:25.390457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.582 [2024-11-28 11:51:25.390486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.582 [2024-11-28 11:51:25.390503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.582 [2024-11-28 11:51:25.390696] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.582 [2024-11-28 11:51:25.390849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.582 [2024-11-28 11:51:25.390872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.582 [2024-11-28 11:51:25.390887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.582 [2024-11-28 11:51:25.393218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.582 [2024-11-28 11:51:25.402321] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.582 [2024-11-28 11:51:25.402604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.582 [2024-11-28 11:51:25.402733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.582 [2024-11-28 11:51:25.402762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.582 [2024-11-28 11:51:25.402779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.582 [2024-11-28 11:51:25.402926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.582 [2024-11-28 11:51:25.403114] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.583 [2024-11-28 11:51:25.403137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.583 [2024-11-28 11:51:25.403153] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.583 [2024-11-28 11:51:25.405267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.583 [2024-11-28 11:51:25.414930] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.583 [2024-11-28 11:51:25.415261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.415418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.415446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.583 [2024-11-28 11:51:25.415465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.583 [2024-11-28 11:51:25.415612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.583 [2024-11-28 11:51:25.415819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.583 [2024-11-28 11:51:25.415843] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.583 [2024-11-28 11:51:25.415859] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.583 [2024-11-28 11:51:25.418286] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.583 [2024-11-28 11:51:25.427640] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.583 [2024-11-28 11:51:25.428017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.428178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.428204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.583 [2024-11-28 11:51:25.428219] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.583 [2024-11-28 11:51:25.428395] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.583 [2024-11-28 11:51:25.428578] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.583 [2024-11-28 11:51:25.428602] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.583 [2024-11-28 11:51:25.428619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.583 [2024-11-28 11:51:25.431166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.583 [2024-11-28 11:51:25.440367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.583 [2024-11-28 11:51:25.440655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.440841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.440894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.583 [2024-11-28 11:51:25.440911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.583 [2024-11-28 11:51:25.441094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.583 [2024-11-28 11:51:25.441262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.583 [2024-11-28 11:51:25.441286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.583 [2024-11-28 11:51:25.441301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.583 [2024-11-28 11:51:25.443460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.583 [2024-11-28 11:51:25.452810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.583 [2024-11-28 11:51:25.453271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.453434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.453459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.583 [2024-11-28 11:51:25.453475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.583 [2024-11-28 11:51:25.453632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.583 [2024-11-28 11:51:25.453844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.583 [2024-11-28 11:51:25.453868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.583 [2024-11-28 11:51:25.453884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.583 [2024-11-28 11:51:25.456194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.583 [2024-11-28 11:51:25.465332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.583 [2024-11-28 11:51:25.465704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.465884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.465913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.583 [2024-11-28 11:51:25.465931] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.583 [2024-11-28 11:51:25.466132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.583 [2024-11-28 11:51:25.466265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.583 [2024-11-28 11:51:25.466288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.583 [2024-11-28 11:51:25.466303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.583 [2024-11-28 11:51:25.468596] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.583 [2024-11-28 11:51:25.478009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.583 [2024-11-28 11:51:25.478390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.478571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.478597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.583 [2024-11-28 11:51:25.478613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.583 [2024-11-28 11:51:25.478867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.583 [2024-11-28 11:51:25.479054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.583 [2024-11-28 11:51:25.479077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.583 [2024-11-28 11:51:25.479092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.583 [2024-11-28 11:51:25.481442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.583 [2024-11-28 11:51:25.490678] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.583 [2024-11-28 11:51:25.490999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.491149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.491184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.583 [2024-11-28 11:51:25.491202] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.583 [2024-11-28 11:51:25.491367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.583 [2024-11-28 11:51:25.491517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.583 [2024-11-28 11:51:25.491551] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.583 [2024-11-28 11:51:25.491567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.583 [2024-11-28 11:51:25.493919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.583 [2024-11-28 11:51:25.503382] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.583 [2024-11-28 11:51:25.503777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.503938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.503964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.583 [2024-11-28 11:51:25.503981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.583 [2024-11-28 11:51:25.504144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.583 [2024-11-28 11:51:25.504277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.583 [2024-11-28 11:51:25.504300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.583 [2024-11-28 11:51:25.504316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.583 [2024-11-28 11:51:25.506782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.583 [2024-11-28 11:51:25.516223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.583 [2024-11-28 11:51:25.516612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.516792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.583 [2024-11-28 11:51:25.516820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.583 [2024-11-28 11:51:25.516837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.583 [2024-11-28 11:51:25.517021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.583 [2024-11-28 11:51:25.517153] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.583 [2024-11-28 11:51:25.517176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.583 [2024-11-28 11:51:25.517192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.583 [2024-11-28 11:51:25.519601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.583 [2024-11-28 11:51:25.528826] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.584 [2024-11-28 11:51:25.529124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.529286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.529314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.584 [2024-11-28 11:51:25.529337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.584 [2024-11-28 11:51:25.529485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.584 [2024-11-28 11:51:25.529611] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.584 [2024-11-28 11:51:25.529635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.584 [2024-11-28 11:51:25.529651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.584 [2024-11-28 11:51:25.532015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.584 [2024-11-28 11:51:25.541414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.584 [2024-11-28 11:51:25.541713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.541878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.541903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.584 [2024-11-28 11:51:25.541919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.584 [2024-11-28 11:51:25.542079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.584 [2024-11-28 11:51:25.542230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.584 [2024-11-28 11:51:25.542253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.584 [2024-11-28 11:51:25.542268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.584 [2024-11-28 11:51:25.544695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.584 [2024-11-28 11:51:25.553959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.584 [2024-11-28 11:51:25.554269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.554413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.554441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.584 [2024-11-28 11:51:25.554459] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.584 [2024-11-28 11:51:25.554670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.584 [2024-11-28 11:51:25.554839] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.584 [2024-11-28 11:51:25.554863] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.584 [2024-11-28 11:51:25.554879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.584 [2024-11-28 11:51:25.557227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.584 [2024-11-28 11:51:25.566595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.584 [2024-11-28 11:51:25.566933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.567083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.567112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.584 [2024-11-28 11:51:25.567129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.584 [2024-11-28 11:51:25.567264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.584 [2024-11-28 11:51:25.567398] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.584 [2024-11-28 11:51:25.567421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.584 [2024-11-28 11:51:25.567437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.584 [2024-11-28 11:51:25.569798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.584 [2024-11-28 11:51:25.579039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.584 [2024-11-28 11:51:25.579388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.579499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.579531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.584 [2024-11-28 11:51:25.579549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.584 [2024-11-28 11:51:25.579698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.584 [2024-11-28 11:51:25.579906] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.584 [2024-11-28 11:51:25.579930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.584 [2024-11-28 11:51:25.579946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.584 [2024-11-28 11:51:25.582240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.584 [2024-11-28 11:51:25.591667] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.584 [2024-11-28 11:51:25.592053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.592277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.592305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.584 [2024-11-28 11:51:25.592322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.584 [2024-11-28 11:51:25.592487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.584 [2024-11-28 11:51:25.592632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.584 [2024-11-28 11:51:25.592656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.584 [2024-11-28 11:51:25.592672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.584 [2024-11-28 11:51:25.594811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.584 [2024-11-28 11:51:25.604451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.584 [2024-11-28 11:51:25.604801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.604996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.605021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.584 [2024-11-28 11:51:25.605037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.584 [2024-11-28 11:51:25.605234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.584 [2024-11-28 11:51:25.605391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.584 [2024-11-28 11:51:25.605415] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.584 [2024-11-28 11:51:25.605431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.584 [2024-11-28 11:51:25.607682] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.584 [2024-11-28 11:51:25.617060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.584 [2024-11-28 11:51:25.617365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.617559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.584 [2024-11-28 11:51:25.617589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.584 [2024-11-28 11:51:25.617605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.584 [2024-11-28 11:51:25.617720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.584 [2024-11-28 11:51:25.617908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.584 [2024-11-28 11:51:25.617933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.584 [2024-11-28 11:51:25.617948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.864 [2024-11-28 11:51:25.620400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.864 [2024-11-28 11:51:25.629723] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.864 [2024-11-28 11:51:25.630116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.864 [2024-11-28 11:51:25.630282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.864 [2024-11-28 11:51:25.630311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.864 [2024-11-28 11:51:25.630329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.864 [2024-11-28 11:51:25.630512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.864 [2024-11-28 11:51:25.630709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.864 [2024-11-28 11:51:25.630731] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.864 [2024-11-28 11:51:25.630745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.864 [2024-11-28 11:51:25.633170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.864 [2024-11-28 11:51:25.642162] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.864 [2024-11-28 11:51:25.642498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.864 [2024-11-28 11:51:25.642658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.864 [2024-11-28 11:51:25.642687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.864 [2024-11-28 11:51:25.642705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.864 [2024-11-28 11:51:25.642851] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.864 [2024-11-28 11:51:25.643038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.864 [2024-11-28 11:51:25.643067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.864 [2024-11-28 11:51:25.643083] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.864 [2024-11-28 11:51:25.645379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.864 [2024-11-28 11:51:25.654657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.864 [2024-11-28 11:51:25.655012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.864 [2024-11-28 11:51:25.655272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.864 [2024-11-28 11:51:25.655298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.864 [2024-11-28 11:51:25.655314] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.864 [2024-11-28 11:51:25.655410] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.864 [2024-11-28 11:51:25.655608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.864 [2024-11-28 11:51:25.655633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.864 [2024-11-28 11:51:25.655649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.864 [2024-11-28 11:51:25.658088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.864 [2024-11-28 11:51:25.667179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.864 [2024-11-28 11:51:25.667543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.864 [2024-11-28 11:51:25.667719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.864 [2024-11-28 11:51:25.667748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.864 [2024-11-28 11:51:25.667765] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.864 [2024-11-28 11:51:25.667931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.864 [2024-11-28 11:51:25.668118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.865 [2024-11-28 11:51:25.668142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.865 [2024-11-28 11:51:25.668157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.865 [2024-11-28 11:51:25.670376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.865 [2024-11-28 11:51:25.679877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.865 [2024-11-28 11:51:25.680319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.680516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.680552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.865 [2024-11-28 11:51:25.680570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.865 [2024-11-28 11:51:25.680752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.865 [2024-11-28 11:51:25.680941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.865 [2024-11-28 11:51:25.680964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.865 [2024-11-28 11:51:25.680986] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.865 [2024-11-28 11:51:25.683357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.865 [2024-11-28 11:51:25.692411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.865 [2024-11-28 11:51:25.692809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.693009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.693051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.865 [2024-11-28 11:51:25.693069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.865 [2024-11-28 11:51:25.693252] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.865 [2024-11-28 11:51:25.693403] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.865 [2024-11-28 11:51:25.693426] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.865 [2024-11-28 11:51:25.693441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.865 [2024-11-28 11:51:25.695895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.865 [2024-11-28 11:51:25.704878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.865 [2024-11-28 11:51:25.705327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.705538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.705567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.865 [2024-11-28 11:51:25.705585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.865 [2024-11-28 11:51:25.705695] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.865 [2024-11-28 11:51:25.705846] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.865 [2024-11-28 11:51:25.705869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.865 [2024-11-28 11:51:25.705885] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.865 [2024-11-28 11:51:25.708178] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.865 [2024-11-28 11:51:25.717324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.865 [2024-11-28 11:51:25.717718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.717853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.717878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.865 [2024-11-28 11:51:25.717893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.865 [2024-11-28 11:51:25.718055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.865 [2024-11-28 11:51:25.718293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.865 [2024-11-28 11:51:25.718316] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.865 [2024-11-28 11:51:25.718332] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.865 [2024-11-28 11:51:25.720543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.865 [2024-11-28 11:51:25.729849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.865 [2024-11-28 11:51:25.730193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.730387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.730413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.865 [2024-11-28 11:51:25.730429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.865 [2024-11-28 11:51:25.730621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.865 [2024-11-28 11:51:25.730768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.865 [2024-11-28 11:51:25.730792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.865 [2024-11-28 11:51:25.730807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.865 [2024-11-28 11:51:25.733190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.865 [2024-11-28 11:51:25.742546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.865 [2024-11-28 11:51:25.742990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.743205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.743234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.865 [2024-11-28 11:51:25.743252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.865 [2024-11-28 11:51:25.743399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.865 [2024-11-28 11:51:25.743599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.865 [2024-11-28 11:51:25.743623] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.865 [2024-11-28 11:51:25.743639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.865 [2024-11-28 11:51:25.746132] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.865 [2024-11-28 11:51:25.755049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.865 [2024-11-28 11:51:25.755347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.755501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.755539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.865 [2024-11-28 11:51:25.755559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.865 [2024-11-28 11:51:25.755724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.865 [2024-11-28 11:51:25.755929] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.865 [2024-11-28 11:51:25.755952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.865 [2024-11-28 11:51:25.755967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.865 [2024-11-28 11:51:25.758285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.865 [2024-11-28 11:51:25.767518] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.865 [2024-11-28 11:51:25.767851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.767979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.768010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.865 [2024-11-28 11:51:25.768027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.865 [2024-11-28 11:51:25.768174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.865 [2024-11-28 11:51:25.768361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.865 [2024-11-28 11:51:25.768384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.865 [2024-11-28 11:51:25.768399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.865 [2024-11-28 11:51:25.770873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.865 [2024-11-28 11:51:25.780186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.865 [2024-11-28 11:51:25.780497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.780655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.865 [2024-11-28 11:51:25.780684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.865 [2024-11-28 11:51:25.780702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.865 [2024-11-28 11:51:25.780903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.866 [2024-11-28 11:51:25.781054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.866 [2024-11-28 11:51:25.781077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.866 [2024-11-28 11:51:25.781093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.866 [2024-11-28 11:51:25.783598] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.866 [2024-11-28 11:51:25.792674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.866 [2024-11-28 11:51:25.793016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.793169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.793197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.866 [2024-11-28 11:51:25.793214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.866 [2024-11-28 11:51:25.793397] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.866 [2024-11-28 11:51:25.793561] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.866 [2024-11-28 11:51:25.793586] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.866 [2024-11-28 11:51:25.793601] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.866 [2024-11-28 11:51:25.795840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.866 [2024-11-28 11:51:25.805277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.866 [2024-11-28 11:51:25.805572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.805763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.805789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.866 [2024-11-28 11:51:25.805804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.866 [2024-11-28 11:51:25.805950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.866 [2024-11-28 11:51:25.806161] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.866 [2024-11-28 11:51:25.806184] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.866 [2024-11-28 11:51:25.806200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.866 [2024-11-28 11:51:25.808461] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.866 [2024-11-28 11:51:25.817667] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.866 [2024-11-28 11:51:25.817966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.818112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.818137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.866 [2024-11-28 11:51:25.818153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.866 [2024-11-28 11:51:25.818308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.866 [2024-11-28 11:51:25.818545] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.866 [2024-11-28 11:51:25.818569] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.866 [2024-11-28 11:51:25.818585] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.866 [2024-11-28 11:51:25.820812] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.866 [2024-11-28 11:51:25.830213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.866 [2024-11-28 11:51:25.830522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.830684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.830712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.866 [2024-11-28 11:51:25.830729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.866 [2024-11-28 11:51:25.830894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.866 [2024-11-28 11:51:25.831046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.866 [2024-11-28 11:51:25.831069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.866 [2024-11-28 11:51:25.831085] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.866 [2024-11-28 11:51:25.833331] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.866 [2024-11-28 11:51:25.842820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.866 [2024-11-28 11:51:25.843078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.843207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.843240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.866 [2024-11-28 11:51:25.843259] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.866 [2024-11-28 11:51:25.843406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.866 [2024-11-28 11:51:25.843550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.866 [2024-11-28 11:51:25.843574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.866 [2024-11-28 11:51:25.843590] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.866 [2024-11-28 11:51:25.846008] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.866 [2024-11-28 11:51:25.855504] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.866 [2024-11-28 11:51:25.855887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.856069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.856111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.866 [2024-11-28 11:51:25.856128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.866 [2024-11-28 11:51:25.856311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.866 [2024-11-28 11:51:25.856497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.866 [2024-11-28 11:51:25.856520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.866 [2024-11-28 11:51:25.856548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.866 [2024-11-28 11:51:25.858905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.866 [2024-11-28 11:51:25.868245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.866 [2024-11-28 11:51:25.868601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.868790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.868816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.866 [2024-11-28 11:51:25.868832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.866 [2024-11-28 11:51:25.868946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.866 [2024-11-28 11:51:25.869133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.866 [2024-11-28 11:51:25.869157] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.866 [2024-11-28 11:51:25.869172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.866 [2024-11-28 11:51:25.871370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.866 [2024-11-28 11:51:25.880974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.866 [2024-11-28 11:51:25.881327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.881478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.881507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.866 [2024-11-28 11:51:25.881543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.866 [2024-11-28 11:51:25.881711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.866 [2024-11-28 11:51:25.881881] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.866 [2024-11-28 11:51:25.881904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.866 [2024-11-28 11:51:25.881920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.866 [2024-11-28 11:51:25.884363] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.866 [2024-11-28 11:51:25.893576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.866 [2024-11-28 11:51:25.893905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.894134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.866 [2024-11-28 11:51:25.894163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.866 [2024-11-28 11:51:25.894180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.866 [2024-11-28 11:51:25.894308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.866 [2024-11-28 11:51:25.894477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.866 [2024-11-28 11:51:25.894501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.867 [2024-11-28 11:51:25.894517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.867 [2024-11-28 11:51:25.896844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.867 [2024-11-28 11:51:25.906121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.867 [2024-11-28 11:51:25.906469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.867 [2024-11-28 11:51:25.906623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.867 [2024-11-28 11:51:25.906652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:05.867 [2024-11-28 11:51:25.906670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:05.867 [2024-11-28 11:51:25.906872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:05.867 [2024-11-28 11:51:25.907059] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.867 [2024-11-28 11:51:25.907082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.867 [2024-11-28 11:51:25.907098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.867 [2024-11-28 11:51:25.909602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.127 [2024-11-28 11:51:25.918694] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.127 [2024-11-28 11:51:25.918957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:25.919119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:25.919144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.127 [2024-11-28 11:51:25.919161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.127 [2024-11-28 11:51:25.919331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.127 [2024-11-28 11:51:25.919574] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.127 [2024-11-28 11:51:25.919603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.127 [2024-11-28 11:51:25.919619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.127 [2024-11-28 11:51:25.922020] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.127 [2024-11-28 11:51:25.931442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.127 [2024-11-28 11:51:25.931756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:25.931891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:25.931921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.127 [2024-11-28 11:51:25.931940] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.127 [2024-11-28 11:51:25.932069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.127 [2024-11-28 11:51:25.932238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.127 [2024-11-28 11:51:25.932261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.127 [2024-11-28 11:51:25.932276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.127 [2024-11-28 11:51:25.934646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.127 [2024-11-28 11:51:25.944013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.127 [2024-11-28 11:51:25.944277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:25.944427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:25.944452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.127 [2024-11-28 11:51:25.944468] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.127 [2024-11-28 11:51:25.944610] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.127 [2024-11-28 11:51:25.944747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.127 [2024-11-28 11:51:25.944769] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.127 [2024-11-28 11:51:25.944782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.127 [2024-11-28 11:51:25.947137] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.127 [2024-11-28 11:51:25.956848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.127 [2024-11-28 11:51:25.957170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:25.957351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:25.957379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.127 [2024-11-28 11:51:25.957397] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.127 [2024-11-28 11:51:25.957620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.127 [2024-11-28 11:51:25.957795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.127 [2024-11-28 11:51:25.957832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.127 [2024-11-28 11:51:25.957848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.127 [2024-11-28 11:51:25.960259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.127 [2024-11-28 11:51:25.969175] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.127 [2024-11-28 11:51:25.969503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:25.969689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:25.969719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.127 [2024-11-28 11:51:25.969736] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.127 [2024-11-28 11:51:25.969846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.127 [2024-11-28 11:51:25.970016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.127 [2024-11-28 11:51:25.970041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.127 [2024-11-28 11:51:25.970056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.127 [2024-11-28 11:51:25.972435] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.127 [2024-11-28 11:51:25.981792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.127 [2024-11-28 11:51:25.982124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:25.982283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:25.982309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.127 [2024-11-28 11:51:25.982325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.127 [2024-11-28 11:51:25.982472] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.127 [2024-11-28 11:51:25.982686] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.127 [2024-11-28 11:51:25.982711] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.127 [2024-11-28 11:51:25.982727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.127 [2024-11-28 11:51:25.984987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.127 [2024-11-28 11:51:25.994438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.127 [2024-11-28 11:51:25.994766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:25.994986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:25.995011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.127 [2024-11-28 11:51:25.995026] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.127 [2024-11-28 11:51:25.995226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.127 [2024-11-28 11:51:25.995406] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.127 [2024-11-28 11:51:25.995440] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.127 [2024-11-28 11:51:25.995456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.127 [2024-11-28 11:51:25.997762] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.127 [2024-11-28 11:51:26.007165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.127 [2024-11-28 11:51:26.007572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:26.007743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.127 [2024-11-28 11:51:26.007772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.127 [2024-11-28 11:51:26.007789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.128 [2024-11-28 11:51:26.007955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.128 [2024-11-28 11:51:26.008088] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.128 [2024-11-28 11:51:26.008112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.128 [2024-11-28 11:51:26.008127] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.128 [2024-11-28 11:51:26.010580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.128 [2024-11-28 11:51:26.019840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.128 [2024-11-28 11:51:26.020300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.020498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.020534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.128 [2024-11-28 11:51:26.020554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.128 [2024-11-28 11:51:26.020683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.128 [2024-11-28 11:51:26.020817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.128 [2024-11-28 11:51:26.020840] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.128 [2024-11-28 11:51:26.020856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.128 [2024-11-28 11:51:26.022992] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.128 [2024-11-28 11:51:26.032353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.128 [2024-11-28 11:51:26.032724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.032877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.032905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.128 [2024-11-28 11:51:26.032922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.128 [2024-11-28 11:51:26.033050] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.128 [2024-11-28 11:51:26.033255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.128 [2024-11-28 11:51:26.033278] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.128 [2024-11-28 11:51:26.033300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.128 [2024-11-28 11:51:26.035293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.128 [2024-11-28 11:51:26.044763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.128 [2024-11-28 11:51:26.045181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.045344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.045372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.128 [2024-11-28 11:51:26.045390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.128 [2024-11-28 11:51:26.045546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.128 [2024-11-28 11:51:26.045717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.128 [2024-11-28 11:51:26.045740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.128 [2024-11-28 11:51:26.045756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.128 [2024-11-28 11:51:26.047998] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.128 [2024-11-28 11:51:26.057332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.128 [2024-11-28 11:51:26.057659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.057856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.057882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.128 [2024-11-28 11:51:26.057897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.128 [2024-11-28 11:51:26.058115] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.128 [2024-11-28 11:51:26.058298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.128 [2024-11-28 11:51:26.058322] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.128 [2024-11-28 11:51:26.058338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.128 [2024-11-28 11:51:26.060701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.128 [2024-11-28 11:51:26.069983] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.128 [2024-11-28 11:51:26.070355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.070598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.070646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.128 [2024-11-28 11:51:26.070664] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.128 [2024-11-28 11:51:26.070793] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.128 [2024-11-28 11:51:26.070927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.128 [2024-11-28 11:51:26.070950] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.128 [2024-11-28 11:51:26.070966] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.128 [2024-11-28 11:51:26.073175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.128 [2024-11-28 11:51:26.082566] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.128 [2024-11-28 11:51:26.082890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.083094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.083143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.128 [2024-11-28 11:51:26.083161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.128 [2024-11-28 11:51:26.083380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.128 [2024-11-28 11:51:26.083543] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.128 [2024-11-28 11:51:26.083567] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.128 [2024-11-28 11:51:26.083582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.128 [2024-11-28 11:51:26.085806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.128 [2024-11-28 11:51:26.095300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.128 [2024-11-28 11:51:26.095667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.095876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.095905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.128 [2024-11-28 11:51:26.095923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.128 [2024-11-28 11:51:26.096069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.128 [2024-11-28 11:51:26.096239] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.128 [2024-11-28 11:51:26.096262] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.128 [2024-11-28 11:51:26.096278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.128 [2024-11-28 11:51:26.098663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.128 [2024-11-28 11:51:26.107499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.128 [2024-11-28 11:51:26.107812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.107953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.107979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.128 [2024-11-28 11:51:26.107995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.128 [2024-11-28 11:51:26.108190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.128 [2024-11-28 11:51:26.108330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.128 [2024-11-28 11:51:26.108349] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.128 [2024-11-28 11:51:26.108362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.128 [2024-11-28 11:51:26.110263] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.128 [2024-11-28 11:51:26.119944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.128 [2024-11-28 11:51:26.120245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.120394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.128 [2024-11-28 11:51:26.120423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.128 [2024-11-28 11:51:26.120440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.128 [2024-11-28 11:51:26.120614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.128 [2024-11-28 11:51:26.120768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.128 [2024-11-28 11:51:26.120789] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.128 [2024-11-28 11:51:26.120819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.129 [2024-11-28 11:51:26.122996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.129 [2024-11-28 11:51:26.132722] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.129 [2024-11-28 11:51:26.133066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.129 [2024-11-28 11:51:26.133221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.129 [2024-11-28 11:51:26.133249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.129 [2024-11-28 11:51:26.133266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.129 [2024-11-28 11:51:26.133394] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.129 [2024-11-28 11:51:26.133589] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.129 [2024-11-28 11:51:26.133612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.129 [2024-11-28 11:51:26.133625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.129 [2024-11-28 11:51:26.135881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.129 [2024-11-28 11:51:26.145522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.129 [2024-11-28 11:51:26.145819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.129 [2024-11-28 11:51:26.145960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.129 [2024-11-28 11:51:26.145986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.129 [2024-11-28 11:51:26.146001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.129 [2024-11-28 11:51:26.146209] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.129 [2024-11-28 11:51:26.146380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.129 [2024-11-28 11:51:26.146403] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.129 [2024-11-28 11:51:26.146418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.129 [2024-11-28 11:51:26.148723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.129 [2024-11-28 11:51:26.157904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.129 [2024-11-28 11:51:26.158258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.129 [2024-11-28 11:51:26.158449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.129 [2024-11-28 11:51:26.158474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.129 [2024-11-28 11:51:26.158490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.129 [2024-11-28 11:51:26.158647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.129 [2024-11-28 11:51:26.158800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.129 [2024-11-28 11:51:26.158824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.129 [2024-11-28 11:51:26.158840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.129 [2024-11-28 11:51:26.161025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.129 [2024-11-28 11:51:26.170545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.129 [2024-11-28 11:51:26.170862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.129 [2024-11-28 11:51:26.170998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.129 [2024-11-28 11:51:26.171025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.129 [2024-11-28 11:51:26.171040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.129 [2024-11-28 11:51:26.171186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.129 [2024-11-28 11:51:26.171309] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.129 [2024-11-28 11:51:26.171332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.129 [2024-11-28 11:51:26.171349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.129 [2024-11-28 11:51:26.173685] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.388 [2024-11-28 11:51:26.182951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.388 [2024-11-28 11:51:26.183315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-28 11:51:26.183484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-28 11:51:26.183513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.388 [2024-11-28 11:51:26.183540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.388 [2024-11-28 11:51:26.183675] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.388 [2024-11-28 11:51:26.183795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.388 [2024-11-28 11:51:26.183830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.388 [2024-11-28 11:51:26.183843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.388 [2024-11-28 11:51:26.186037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.388 [2024-11-28 11:51:26.195383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.388 [2024-11-28 11:51:26.195735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-28 11:51:26.195904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-28 11:51:26.195933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.388 [2024-11-28 11:51:26.195950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.388 [2024-11-28 11:51:26.196114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.388 [2024-11-28 11:51:26.196266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.388 [2024-11-28 11:51:26.196289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.388 [2024-11-28 11:51:26.196304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.388 [2024-11-28 11:51:26.198457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.388 [2024-11-28 11:51:26.208142] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.388 [2024-11-28 11:51:26.208434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-28 11:51:26.208628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.388 [2024-11-28 11:51:26.208654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.388 [2024-11-28 11:51:26.208670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.388 [2024-11-28 11:51:26.208847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.388 [2024-11-28 11:51:26.209043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.388 [2024-11-28 11:51:26.209066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.388 [2024-11-28 11:51:26.209082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.388 [2024-11-28 11:51:26.211481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.388 [2024-11-28 11:51:26.220688] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.388 [2024-11-28 11:51:26.221038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.221190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.221218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.389 [2024-11-28 11:51:26.221235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.389 [2024-11-28 11:51:26.221418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.389 [2024-11-28 11:51:26.221599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.389 [2024-11-28 11:51:26.221623] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.389 [2024-11-28 11:51:26.221640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.389 [2024-11-28 11:51:26.223986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.389 [2024-11-28 11:51:26.233251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.389 [2024-11-28 11:51:26.233544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.233697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.233725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.389 [2024-11-28 11:51:26.233748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.389 [2024-11-28 11:51:26.233932] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.389 [2024-11-28 11:51:26.234118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.389 [2024-11-28 11:51:26.234142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.389 [2024-11-28 11:51:26.234158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.389 [2024-11-28 11:51:26.236585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.389 [2024-11-28 11:51:26.245795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.389 [2024-11-28 11:51:26.246093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.246270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.246299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.389 [2024-11-28 11:51:26.246316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.389 [2024-11-28 11:51:26.246463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.389 [2024-11-28 11:51:26.246624] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.389 [2024-11-28 11:51:26.246649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.389 [2024-11-28 11:51:26.246665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.389 [2024-11-28 11:51:26.248886] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.389 [2024-11-28 11:51:26.258222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.389 [2024-11-28 11:51:26.258534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.258721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.258748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.389 [2024-11-28 11:51:26.258764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.389 [2024-11-28 11:51:26.258956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.389 [2024-11-28 11:51:26.259097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.389 [2024-11-28 11:51:26.259121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.389 [2024-11-28 11:51:26.259137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.389 [2024-11-28 11:51:26.261505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.389 [2024-11-28 11:51:26.270810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.389 [2024-11-28 11:51:26.271118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.271285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.271311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.389 [2024-11-28 11:51:26.271327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.389 [2024-11-28 11:51:26.271491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.389 [2024-11-28 11:51:26.271723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.389 [2024-11-28 11:51:26.271748] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.389 [2024-11-28 11:51:26.271764] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.389 [2024-11-28 11:51:26.274292] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.389 [2024-11-28 11:51:26.283395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.389 [2024-11-28 11:51:26.283681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.283840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.283866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.389 [2024-11-28 11:51:26.283882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.389 [2024-11-28 11:51:26.284030] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.389 [2024-11-28 11:51:26.284228] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.389 [2024-11-28 11:51:26.284252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.389 [2024-11-28 11:51:26.284268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.389 [2024-11-28 11:51:26.286474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.389 [2024-11-28 11:51:26.296129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.389 [2024-11-28 11:51:26.296438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.296613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.296643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.389 [2024-11-28 11:51:26.296661] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.389 [2024-11-28 11:51:26.296790] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.389 [2024-11-28 11:51:26.296978] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.389 [2024-11-28 11:51:26.297001] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.389 [2024-11-28 11:51:26.297017] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.389 [2024-11-28 11:51:26.299400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.389 [2024-11-28 11:51:26.308751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.389 [2024-11-28 11:51:26.309067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.309222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.309248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.389 [2024-11-28 11:51:26.309263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.389 [2024-11-28 11:51:26.309427] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.389 [2024-11-28 11:51:26.309612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.389 [2024-11-28 11:51:26.309637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.389 [2024-11-28 11:51:26.309653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.389 [2024-11-28 11:51:26.311837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.389 [2024-11-28 11:51:26.321262] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.389 [2024-11-28 11:51:26.321538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.321687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.321713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.389 [2024-11-28 11:51:26.321729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.389 [2024-11-28 11:51:26.321889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.389 [2024-11-28 11:51:26.322059] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.389 [2024-11-28 11:51:26.322082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.389 [2024-11-28 11:51:26.322097] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.389 [2024-11-28 11:51:26.324501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.389 [2024-11-28 11:51:26.333695] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.389 [2024-11-28 11:51:26.334027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.334192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.389 [2024-11-28 11:51:26.334218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.389 [2024-11-28 11:51:26.334233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.390 [2024-11-28 11:51:26.334408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.390 [2024-11-28 11:51:26.334657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.390 [2024-11-28 11:51:26.334681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.390 [2024-11-28 11:51:26.334697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.390 [2024-11-28 11:51:26.336990] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.390 [2024-11-28 11:51:26.346240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.390 [2024-11-28 11:51:26.346540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.346722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.346749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.390 [2024-11-28 11:51:26.346766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.390 [2024-11-28 11:51:26.346928] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.390 [2024-11-28 11:51:26.347116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.390 [2024-11-28 11:51:26.347145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.390 [2024-11-28 11:51:26.347161] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.390 [2024-11-28 11:51:26.349303] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.390 [2024-11-28 11:51:26.358808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.390 [2024-11-28 11:51:26.359091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.359263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.359289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.390 [2024-11-28 11:51:26.359305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.390 [2024-11-28 11:51:26.359514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.390 [2024-11-28 11:51:26.359717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.390 [2024-11-28 11:51:26.359742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.390 [2024-11-28 11:51:26.359758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.390 [2024-11-28 11:51:26.361969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.390 [2024-11-28 11:51:26.371386] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.390 [2024-11-28 11:51:26.371681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.371823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.371849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.390 [2024-11-28 11:51:26.371865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.390 [2024-11-28 11:51:26.372040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.390 [2024-11-28 11:51:26.372227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.390 [2024-11-28 11:51:26.372251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.390 [2024-11-28 11:51:26.372266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.390 [2024-11-28 11:51:26.374591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.390 [2024-11-28 11:51:26.383918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.390 [2024-11-28 11:51:26.384327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.384546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.384588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.390 [2024-11-28 11:51:26.384603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.390 [2024-11-28 11:51:26.384782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.390 [2024-11-28 11:51:26.384987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.390 [2024-11-28 11:51:26.385010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.390 [2024-11-28 11:51:26.385032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.390 [2024-11-28 11:51:26.387345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.390 [2024-11-28 11:51:26.396430] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.390 [2024-11-28 11:51:26.396804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.396954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.396984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.390 [2024-11-28 11:51:26.397001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.390 [2024-11-28 11:51:26.397185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.390 [2024-11-28 11:51:26.397336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.390 [2024-11-28 11:51:26.397359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.390 [2024-11-28 11:51:26.397375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.390 [2024-11-28 11:51:26.399896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.390 [2024-11-28 11:51:26.409066] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.390 [2024-11-28 11:51:26.409373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.409543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.409570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.390 [2024-11-28 11:51:26.409585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.390 [2024-11-28 11:51:26.409780] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.390 [2024-11-28 11:51:26.409949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.390 [2024-11-28 11:51:26.409972] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.390 [2024-11-28 11:51:26.409987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.390 [2024-11-28 11:51:26.412191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.390 [2024-11-28 11:51:26.421499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.390 [2024-11-28 11:51:26.421851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.422026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.422055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.390 [2024-11-28 11:51:26.422073] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.390 [2024-11-28 11:51:26.422203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.390 [2024-11-28 11:51:26.422372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.390 [2024-11-28 11:51:26.422395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.390 [2024-11-28 11:51:26.422410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.390 [2024-11-28 11:51:26.424830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.390 [2024-11-28 11:51:26.433985] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.390 [2024-11-28 11:51:26.434247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.434413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.390 [2024-11-28 11:51:26.434441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.390 [2024-11-28 11:51:26.434457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.390 [2024-11-28 11:51:26.434650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.390 [2024-11-28 11:51:26.434832] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.390 [2024-11-28 11:51:26.434856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.390 [2024-11-28 11:51:26.434872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.390 [2024-11-28 11:51:26.436987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.650 [2024-11-28 11:51:26.446665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.650 [2024-11-28 11:51:26.446989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.650 [2024-11-28 11:51:26.447143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.650 [2024-11-28 11:51:26.447171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.650 [2024-11-28 11:51:26.447188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.650 [2024-11-28 11:51:26.447353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.650 [2024-11-28 11:51:26.447569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.650 [2024-11-28 11:51:26.447594] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.650 [2024-11-28 11:51:26.447610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.650 [2024-11-28 11:51:26.450033] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.650 [2024-11-28 11:51:26.459148] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.650 [2024-11-28 11:51:26.459440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.650 [2024-11-28 11:51:26.459593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.650 [2024-11-28 11:51:26.459620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.650 [2024-11-28 11:51:26.459636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.650 [2024-11-28 11:51:26.459737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.650 [2024-11-28 11:51:26.459863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.650 [2024-11-28 11:51:26.459886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.650 [2024-11-28 11:51:26.459902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.650 [2024-11-28 11:51:26.462214] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.650 [2024-11-28 11:51:26.471842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.650 [2024-11-28 11:51:26.472134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.650 [2024-11-28 11:51:26.472278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.650 [2024-11-28 11:51:26.472303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.650 [2024-11-28 11:51:26.472319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.650 [2024-11-28 11:51:26.472459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.650 [2024-11-28 11:51:26.472657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.650 [2024-11-28 11:51:26.472681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.650 [2024-11-28 11:51:26.472697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.650 [2024-11-28 11:51:26.475063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.650 [2024-11-28 11:51:26.484291] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.650 [2024-11-28 11:51:26.484584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.650 [2024-11-28 11:51:26.484768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.650 [2024-11-28 11:51:26.484797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.650 [2024-11-28 11:51:26.484815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.650 [2024-11-28 11:51:26.484962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.650 [2024-11-28 11:51:26.485167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.650 [2024-11-28 11:51:26.485190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.650 [2024-11-28 11:51:26.485205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.650 [2024-11-28 11:51:26.487580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.650 [2024-11-28 11:51:26.496812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.650 [2024-11-28 11:51:26.497147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.650 [2024-11-28 11:51:26.497325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.650 [2024-11-28 11:51:26.497353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.650 [2024-11-28 11:51:26.497370] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.650 [2024-11-28 11:51:26.497547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.650 [2024-11-28 11:51:26.497699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.650 [2024-11-28 11:51:26.497722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.650 [2024-11-28 11:51:26.497738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.650 [2024-11-28 11:51:26.500121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.650 [2024-11-28 11:51:26.509284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.650 [2024-11-28 11:51:26.509684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.650 [2024-11-28 11:51:26.509946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.650 [2024-11-28 11:51:26.509999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.650 [2024-11-28 11:51:26.510016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.650 [2024-11-28 11:51:26.510145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.651 [2024-11-28 11:51:26.510296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.651 [2024-11-28 11:51:26.510319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.651 [2024-11-28 11:51:26.510335] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.651 [2024-11-28 11:51:26.512470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.651 [2024-11-28 11:51:26.521886] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.651 [2024-11-28 11:51:26.522255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.522376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.522404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.651 [2024-11-28 11:51:26.522422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.651 [2024-11-28 11:51:26.522580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.651 [2024-11-28 11:51:26.522732] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.651 [2024-11-28 11:51:26.522755] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.651 [2024-11-28 11:51:26.522771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.651 [2024-11-28 11:51:26.525192] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.651 [2024-11-28 11:51:26.534378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.651 [2024-11-28 11:51:26.534749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.534900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.534928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.651 [2024-11-28 11:51:26.534945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.651 [2024-11-28 11:51:26.535181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.651 [2024-11-28 11:51:26.535350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.651 [2024-11-28 11:51:26.535373] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.651 [2024-11-28 11:51:26.535389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.651 [2024-11-28 11:51:26.537639] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.651 [2024-11-28 11:51:26.546951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.651 [2024-11-28 11:51:26.547298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.547450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.547492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.651 [2024-11-28 11:51:26.547507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.651 [2024-11-28 11:51:26.547649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.651 [2024-11-28 11:51:26.547858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.651 [2024-11-28 11:51:26.547882] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.651 [2024-11-28 11:51:26.547898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.651 [2024-11-28 11:51:26.550371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.651 [2024-11-28 11:51:26.559498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.651 [2024-11-28 11:51:26.559861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.559987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.560015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.651 [2024-11-28 11:51:26.560032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.651 [2024-11-28 11:51:26.560178] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.651 [2024-11-28 11:51:26.560311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.651 [2024-11-28 11:51:26.560335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.651 [2024-11-28 11:51:26.560351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.651 [2024-11-28 11:51:26.562584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.651 [2024-11-28 11:51:26.571962] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.651 [2024-11-28 11:51:26.572288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.572393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.572418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.651 [2024-11-28 11:51:26.572434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.651 [2024-11-28 11:51:26.572657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.651 [2024-11-28 11:51:26.572828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.651 [2024-11-28 11:51:26.572852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.651 [2024-11-28 11:51:26.572867] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.651 [2024-11-28 11:51:26.575231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.651 [2024-11-28 11:51:26.584383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.651 [2024-11-28 11:51:26.584695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.584846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.584875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.651 [2024-11-28 11:51:26.584897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.651 [2024-11-28 11:51:26.585063] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.651 [2024-11-28 11:51:26.585232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.651 [2024-11-28 11:51:26.585255] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.651 [2024-11-28 11:51:26.585271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.651 [2024-11-28 11:51:26.587574] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.651 [2024-11-28 11:51:26.596803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.651 [2024-11-28 11:51:26.597153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.597326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.597355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.651 [2024-11-28 11:51:26.597372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.651 [2024-11-28 11:51:26.597518] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.651 [2024-11-28 11:51:26.597662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.651 [2024-11-28 11:51:26.597686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.651 [2024-11-28 11:51:26.597701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.651 [2024-11-28 11:51:26.600027] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.651 [2024-11-28 11:51:26.609455] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.651 [2024-11-28 11:51:26.609811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.609948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.609974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.651 [2024-11-28 11:51:26.609989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.651 [2024-11-28 11:51:26.610185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.651 [2024-11-28 11:51:26.610336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.651 [2024-11-28 11:51:26.610360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.651 [2024-11-28 11:51:26.610375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.651 [2024-11-28 11:51:26.612626] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.651 [2024-11-28 11:51:26.622163] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.651 [2024-11-28 11:51:26.622477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.622605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.651 [2024-11-28 11:51:26.622635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.651 [2024-11-28 11:51:26.622653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.651 [2024-11-28 11:51:26.622845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.651 [2024-11-28 11:51:26.623034] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.651 [2024-11-28 11:51:26.623057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.651 [2024-11-28 11:51:26.623072] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.651 [2024-11-28 11:51:26.625405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.652 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 3925792 Killed "${NVMF_APP[@]}" "$@" 00:27:06.652 11:51:26 -- host/bdevperf.sh@36 -- # tgt_init 00:27:06.652 11:51:26 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:06.652 11:51:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:06.652 11:51:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:06.652 11:51:26 -- common/autotest_common.sh@10 -- # set +x 00:27:06.652 11:51:26 -- nvmf/common.sh@469 -- # nvmfpid=3926909 00:27:06.652 11:51:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:06.652 11:51:26 -- nvmf/common.sh@470 -- # waitforlisten 3926909 00:27:06.652 11:51:26 -- common/autotest_common.sh@829 -- # '[' -z 3926909 ']' 00:27:06.652 11:51:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:06.652 11:51:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:06.652 11:51:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:06.652 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:06.652 11:51:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:06.652 11:51:26 -- common/autotest_common.sh@10 -- # set +x 00:27:06.652 [2024-11-28 11:51:26.634520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.652 [2024-11-28 11:51:26.634788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.652 [2024-11-28 11:51:26.634926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.652 [2024-11-28 11:51:26.634952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.652 [2024-11-28 11:51:26.634969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.652 [2024-11-28 11:51:26.635127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.652 [2024-11-28 11:51:26.635317] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.652 [2024-11-28 11:51:26.635341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.652 [2024-11-28 11:51:26.635358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.652 [2024-11-28 11:51:26.637663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.652 [2024-11-28 11:51:26.647264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.652 [2024-11-28 11:51:26.647579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.652 [2024-11-28 11:51:26.647692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.652 [2024-11-28 11:51:26.647718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.652 [2024-11-28 11:51:26.647734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.652 [2024-11-28 11:51:26.647926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.652 [2024-11-28 11:51:26.648084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.652 [2024-11-28 11:51:26.648108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.652 [2024-11-28 11:51:26.648124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.652 [2024-11-28 11:51:26.650471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.652 [2024-11-28 11:51:26.659730] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.652 [2024-11-28 11:51:26.660030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.652 [2024-11-28 11:51:26.660186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.652 [2024-11-28 11:51:26.660212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.652 [2024-11-28 11:51:26.660227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.652 [2024-11-28 11:51:26.660344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.652 [2024-11-28 11:51:26.660608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.652 [2024-11-28 11:51:26.660631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.652 [2024-11-28 11:51:26.660645] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.652 [2024-11-28 11:51:26.662859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.652 [2024-11-28 11:51:26.671947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.652 [2024-11-28 11:51:26.672263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.652 [2024-11-28 11:51:26.672411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.652 [2024-11-28 11:51:26.672437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.652 [2024-11-28 11:51:26.672454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.652 [2024-11-28 11:51:26.672629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.652 [2024-11-28 11:51:26.672837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.652 [2024-11-28 11:51:26.672857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.652 [2024-11-28 11:51:26.672878] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.652 [2024-11-28 11:51:26.675092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.652 [2024-11-28 11:51:26.675786] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:06.652 [2024-11-28 11:51:26.675855] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:06.652 [2024-11-28 11:51:26.684418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.652 [2024-11-28 11:51:26.684799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.652 [2024-11-28 11:51:26.684969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.652 [2024-11-28 11:51:26.684995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.652 [2024-11-28 11:51:26.685010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.652 [2024-11-28 11:51:26.685149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.652 [2024-11-28 11:51:26.685336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.652 [2024-11-28 11:51:26.685355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.652 [2024-11-28 11:51:26.685368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.652 [2024-11-28 11:51:26.687345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.652 [2024-11-28 11:51:26.696613] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.652 [2024-11-28 11:51:26.696875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.652 [2024-11-28 11:51:26.697013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.652 [2024-11-28 11:51:26.697039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.652 [2024-11-28 11:51:26.697055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.652 [2024-11-28 11:51:26.697187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.652 [2024-11-28 11:51:26.697346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.652 [2024-11-28 11:51:26.697366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.652 [2024-11-28 11:51:26.697379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.652 [2024-11-28 11:51:26.699482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.912 [2024-11-28 11:51:26.708841] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.912 [2024-11-28 11:51:26.709190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.912 [2024-11-28 11:51:26.709314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.912 [2024-11-28 11:51:26.709340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.912 [2024-11-28 11:51:26.709356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.912 [2024-11-28 11:51:26.709596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.912 [2024-11-28 11:51:26.709765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.912 [2024-11-28 11:51:26.709786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.912 [2024-11-28 11:51:26.709800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.912 [2024-11-28 11:51:26.711961] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.912 EAL: No free 2048 kB hugepages reported on node 1 00:27:06.912 [2024-11-28 11:51:26.721665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.912 [2024-11-28 11:51:26.722022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.912 [2024-11-28 11:51:26.722166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.912 [2024-11-28 11:51:26.722194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.912 [2024-11-28 11:51:26.722212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.912 [2024-11-28 11:51:26.722401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.912 [2024-11-28 11:51:26.722629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.912 [2024-11-28 11:51:26.722651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.912 [2024-11-28 11:51:26.722665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.912 [2024-11-28 11:51:26.724996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.912 [2024-11-28 11:51:26.734094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.912 [2024-11-28 11:51:26.734462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.912 [2024-11-28 11:51:26.734625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.912 [2024-11-28 11:51:26.734651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.912 [2024-11-28 11:51:26.734667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.912 [2024-11-28 11:51:26.734784] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.912 [2024-11-28 11:51:26.734938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.912 [2024-11-28 11:51:26.734976] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.912 [2024-11-28 11:51:26.734992] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.912 [2024-11-28 11:51:26.737259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.912 [2024-11-28 11:51:26.746650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.912 [2024-11-28 11:51:26.747007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.912 [2024-11-28 11:51:26.747237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.912 [2024-11-28 11:51:26.747265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.912 [2024-11-28 11:51:26.747283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.912 [2024-11-28 11:51:26.747448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.912 [2024-11-28 11:51:26.747615] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.912 [2024-11-28 11:51:26.747637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.912 [2024-11-28 11:51:26.747650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.912 [2024-11-28 11:51:26.748015] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:06.912 [2024-11-28 11:51:26.749909] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.912 [2024-11-28 11:51:26.759383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.912 [2024-11-28 11:51:26.759972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.912 [2024-11-28 11:51:26.760134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.912 [2024-11-28 11:51:26.760161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.912 [2024-11-28 11:51:26.760181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.912 [2024-11-28 11:51:26.760330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.912 [2024-11-28 11:51:26.760497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.912 [2024-11-28 11:51:26.760539] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.912 [2024-11-28 11:51:26.760560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.912 [2024-11-28 11:51:26.762777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.912 [2024-11-28 11:51:26.771793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.912 [2024-11-28 11:51:26.772198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.912 [2024-11-28 11:51:26.772343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.912 [2024-11-28 11:51:26.772370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.912 [2024-11-28 11:51:26.772387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.912 [2024-11-28 11:51:26.772610] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.912 [2024-11-28 11:51:26.772743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.912 [2024-11-28 11:51:26.772764] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.912 [2024-11-28 11:51:26.772778] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.912 [2024-11-28 11:51:26.775252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.912 [2024-11-28 11:51:26.784284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.912 [2024-11-28 11:51:26.784637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.912 [2024-11-28 11:51:26.784790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.912 [2024-11-28 11:51:26.784816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.912 [2024-11-28 11:51:26.784852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.912 [2024-11-28 11:51:26.784982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.912 [2024-11-28 11:51:26.785151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.912 [2024-11-28 11:51:26.785175] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.912 [2024-11-28 11:51:26.785190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.912 [2024-11-28 11:51:26.787452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.912 [2024-11-28 11:51:26.796803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.913 [2024-11-28 11:51:26.797128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.797300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.797328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.913 [2024-11-28 11:51:26.797347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.913 [2024-11-28 11:51:26.797574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.913 [2024-11-28 11:51:26.797718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.913 [2024-11-28 11:51:26.797747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.913 [2024-11-28 11:51:26.797761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.913 [2024-11-28 11:51:26.800201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.913 [2024-11-28 11:51:26.809161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.913 [2024-11-28 11:51:26.809509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.809655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.809682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.913 [2024-11-28 11:51:26.809698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.913 [2024-11-28 11:51:26.809853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.913 [2024-11-28 11:51:26.810042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.913 [2024-11-28 11:51:26.810065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.913 [2024-11-28 11:51:26.810082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.913 [2024-11-28 11:51:26.812339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.913 [2024-11-28 11:51:26.821840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.913 [2024-11-28 11:51:26.822307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.822483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.822534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.913 [2024-11-28 11:51:26.822573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.913 [2024-11-28 11:51:26.822714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.913 [2024-11-28 11:51:26.822873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.913 [2024-11-28 11:51:26.822898] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.913 [2024-11-28 11:51:26.822917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.913 [2024-11-28 11:51:26.824949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.913 [2024-11-28 11:51:26.834471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.913 [2024-11-28 11:51:26.834849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.835081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.835109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.913 [2024-11-28 11:51:26.835127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.913 [2024-11-28 11:51:26.835292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.913 [2024-11-28 11:51:26.835462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.913 [2024-11-28 11:51:26.835486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.913 [2024-11-28 11:51:26.835513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.913 [2024-11-28 11:51:26.837613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.913 [2024-11-28 11:51:26.847105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.913 [2024-11-28 11:51:26.847470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.847611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.847638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.913 [2024-11-28 11:51:26.847655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.913 [2024-11-28 11:51:26.847857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.913 [2024-11-28 11:51:26.848028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.913 [2024-11-28 11:51:26.848052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.913 [2024-11-28 11:51:26.848067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.913 [2024-11-28 11:51:26.850113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.913 [2024-11-28 11:51:26.859683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.913 [2024-11-28 11:51:26.859943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.860059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.860088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.913 [2024-11-28 11:51:26.860106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.913 [2024-11-28 11:51:26.860235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.913 [2024-11-28 11:51:26.860368] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.913 [2024-11-28 11:51:26.860392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.913 [2024-11-28 11:51:26.860408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.913 [2024-11-28 11:51:26.862766] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.913 [2024-11-28 11:51:26.863518] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:06.913 [2024-11-28 11:51:26.863635] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:06.913 [2024-11-28 11:51:26.863653] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:06.913 [2024-11-28 11:51:26.863666] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:06.913 [2024-11-28 11:51:26.863723] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:06.913 [2024-11-28 11:51:26.863785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:06.913 [2024-11-28 11:51:26.863788] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:06.913 [2024-11-28 11:51:26.871765] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.913 [2024-11-28 11:51:26.872216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.872347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.872385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.913 [2024-11-28 11:51:26.872405] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.913 [2024-11-28 11:51:26.872537] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.913 [2024-11-28 11:51:26.872694] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.913 [2024-11-28 11:51:26.872717] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.913 [2024-11-28 11:51:26.872734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.913 [2024-11-28 11:51:26.874847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.913 [2024-11-28 11:51:26.884046] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.913 [2024-11-28 11:51:26.884523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.884656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.884683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.913 [2024-11-28 11:51:26.884703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.913 [2024-11-28 11:51:26.884861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.913 [2024-11-28 11:51:26.885004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.913 [2024-11-28 11:51:26.885025] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.913 [2024-11-28 11:51:26.885043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.913 [2024-11-28 11:51:26.887157] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.913 [2024-11-28 11:51:26.896330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.913 [2024-11-28 11:51:26.896794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.896960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.913 [2024-11-28 11:51:26.896986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.913 [2024-11-28 11:51:26.897006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.913 [2024-11-28 11:51:26.897196] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.913 [2024-11-28 11:51:26.897366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.914 [2024-11-28 11:51:26.897388] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.914 [2024-11-28 11:51:26.897406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.914 [2024-11-28 11:51:26.899883] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.914 [2024-11-28 11:51:26.908779] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.914 [2024-11-28 11:51:26.909205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.914 [2024-11-28 11:51:26.909335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.914 [2024-11-28 11:51:26.909362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.914 [2024-11-28 11:51:26.909391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.914 [2024-11-28 11:51:26.909575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.914 [2024-11-28 11:51:26.909716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.914 [2024-11-28 11:51:26.909738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.914 [2024-11-28 11:51:26.909756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.914 [2024-11-28 11:51:26.911699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.914 [2024-11-28 11:51:26.921018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.914 [2024-11-28 11:51:26.921402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.914 [2024-11-28 11:51:26.921536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.914 [2024-11-28 11:51:26.921562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.914 [2024-11-28 11:51:26.921580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.914 [2024-11-28 11:51:26.921767] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.914 [2024-11-28 11:51:26.921935] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.914 [2024-11-28 11:51:26.921957] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.914 [2024-11-28 11:51:26.921972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.914 [2024-11-28 11:51:26.924275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.914 [2024-11-28 11:51:26.933426] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.914 [2024-11-28 11:51:26.933854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.914 [2024-11-28 11:51:26.933976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.914 [2024-11-28 11:51:26.934012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.914 [2024-11-28 11:51:26.934032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.914 [2024-11-28 11:51:26.934158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.914 [2024-11-28 11:51:26.934314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.914 [2024-11-28 11:51:26.934346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.914 [2024-11-28 11:51:26.934364] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.914 [2024-11-28 11:51:26.936625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.914 [2024-11-28 11:51:26.945590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.914 [2024-11-28 11:51:26.945876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.914 [2024-11-28 11:51:26.946098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.914 [2024-11-28 11:51:26.946123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.914 [2024-11-28 11:51:26.946139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.914 [2024-11-28 11:51:26.946313] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.914 [2024-11-28 11:51:26.946493] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.914 [2024-11-28 11:51:26.946514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.914 [2024-11-28 11:51:26.946551] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.914 [2024-11-28 11:51:26.948771] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.914 [2024-11-28 11:51:26.957964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.914 [2024-11-28 11:51:26.958253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.914 [2024-11-28 11:51:26.958382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.914 [2024-11-28 11:51:26.958408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:06.914 [2024-11-28 11:51:26.958424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:06.914 [2024-11-28 11:51:26.958548] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:06.914 [2024-11-28 11:51:26.958669] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.914 [2024-11-28 11:51:26.958690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.914 [2024-11-28 11:51:26.958704] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.914 [2024-11-28 11:51:26.960770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.173 [2024-11-28 11:51:26.970159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.173 [2024-11-28 11:51:26.970513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:26.970694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:26.970719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.173 [2024-11-28 11:51:26.970735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.173 [2024-11-28 11:51:26.970884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.173 [2024-11-28 11:51:26.971050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.173 [2024-11-28 11:51:26.971071] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.173 [2024-11-28 11:51:26.971084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.173 [2024-11-28 11:51:26.973283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.173 [2024-11-28 11:51:26.982625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.173 [2024-11-28 11:51:26.982966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:26.983081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:26.983106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.173 [2024-11-28 11:51:26.983122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.173 [2024-11-28 11:51:26.983270] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.173 [2024-11-28 11:51:26.983408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.173 [2024-11-28 11:51:26.983430] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.173 [2024-11-28 11:51:26.983443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.173 [2024-11-28 11:51:26.985587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.173 [2024-11-28 11:51:26.995027] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.173 [2024-11-28 11:51:26.995341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:26.995484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:26.995509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.173 [2024-11-28 11:51:26.995531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.173 [2024-11-28 11:51:26.995698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.173 [2024-11-28 11:51:26.995864] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.173 [2024-11-28 11:51:26.995885] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.173 [2024-11-28 11:51:26.995899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.173 [2024-11-28 11:51:26.997881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.173 [2024-11-28 11:51:27.007421] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.173 [2024-11-28 11:51:27.007726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:27.007828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:27.007854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.173 [2024-11-28 11:51:27.007870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.173 [2024-11-28 11:51:27.008001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.173 [2024-11-28 11:51:27.008182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.173 [2024-11-28 11:51:27.008204] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.173 [2024-11-28 11:51:27.008217] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.173 [2024-11-28 11:51:27.010286] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.173 [2024-11-28 11:51:27.019664] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.173 [2024-11-28 11:51:27.019951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:27.020065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:27.020091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.173 [2024-11-28 11:51:27.020107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.173 [2024-11-28 11:51:27.020288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.173 [2024-11-28 11:51:27.020451] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.173 [2024-11-28 11:51:27.020476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.173 [2024-11-28 11:51:27.020491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.173 [2024-11-28 11:51:27.022572] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.173 [2024-11-28 11:51:27.031919] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.173 [2024-11-28 11:51:27.032241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:27.032384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:27.032410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.173 [2024-11-28 11:51:27.032425] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.173 [2024-11-28 11:51:27.032631] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.173 [2024-11-28 11:51:27.032790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.173 [2024-11-28 11:51:27.032811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.173 [2024-11-28 11:51:27.032825] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.173 [2024-11-28 11:51:27.034863] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.173 [2024-11-28 11:51:27.044279] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.173 [2024-11-28 11:51:27.044601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:27.044711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:27.044737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.173 [2024-11-28 11:51:27.044753] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.173 [2024-11-28 11:51:27.044902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.173 [2024-11-28 11:51:27.045097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.173 [2024-11-28 11:51:27.045118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.173 [2024-11-28 11:51:27.045131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.173 [2024-11-28 11:51:27.047168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.173 [2024-11-28 11:51:27.056442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.173 [2024-11-28 11:51:27.056777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:27.056925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:27.056951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.173 [2024-11-28 11:51:27.056967] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.173 [2024-11-28 11:51:27.057084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.173 [2024-11-28 11:51:27.057219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.173 [2024-11-28 11:51:27.057240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.173 [2024-11-28 11:51:27.057258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.173 [2024-11-28 11:51:27.059335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.173 [2024-11-28 11:51:27.068980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.173 [2024-11-28 11:51:27.069309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:27.069475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.173 [2024-11-28 11:51:27.069501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.173 [2024-11-28 11:51:27.069517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.174 [2024-11-28 11:51:27.069655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.174 [2024-11-28 11:51:27.069842] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.174 [2024-11-28 11:51:27.069863] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.174 [2024-11-28 11:51:27.069877] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.174 [2024-11-28 11:51:27.072097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.174 [2024-11-28 11:51:27.081388] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.174 [2024-11-28 11:51:27.081698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.081856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.081882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.174 [2024-11-28 11:51:27.081897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.174 [2024-11-28 11:51:27.082029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.174 [2024-11-28 11:51:27.082179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.174 [2024-11-28 11:51:27.082200] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.174 [2024-11-28 11:51:27.082214] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.174 [2024-11-28 11:51:27.084407] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.174 [2024-11-28 11:51:27.093652] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.174 [2024-11-28 11:51:27.093974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.094135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.094160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.174 [2024-11-28 11:51:27.094176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.174 [2024-11-28 11:51:27.094357] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.174 [2024-11-28 11:51:27.094490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.174 [2024-11-28 11:51:27.094534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.174 [2024-11-28 11:51:27.094551] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.174 [2024-11-28 11:51:27.096361] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.174 [2024-11-28 11:51:27.105757] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.174 [2024-11-28 11:51:27.106062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.106177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.106202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.174 [2024-11-28 11:51:27.106218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.174 [2024-11-28 11:51:27.106318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.174 [2024-11-28 11:51:27.106630] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.174 [2024-11-28 11:51:27.106654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.174 [2024-11-28 11:51:27.106668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.174 [2024-11-28 11:51:27.108717] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.174 [2024-11-28 11:51:27.117822] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.174 [2024-11-28 11:51:27.118210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.118374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.118400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.174 [2024-11-28 11:51:27.118415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.174 [2024-11-28 11:51:27.118589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.174 [2024-11-28 11:51:27.118710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.174 [2024-11-28 11:51:27.118732] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.174 [2024-11-28 11:51:27.118746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.174 [2024-11-28 11:51:27.120933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.174 [2024-11-28 11:51:27.130038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.174 [2024-11-28 11:51:27.130380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.130516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.130549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.174 [2024-11-28 11:51:27.130566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.174 [2024-11-28 11:51:27.130746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.174 [2024-11-28 11:51:27.130882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.174 [2024-11-28 11:51:27.130904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.174 [2024-11-28 11:51:27.130917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.174 [2024-11-28 11:51:27.133027] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.174 [2024-11-28 11:51:27.142353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.174 [2024-11-28 11:51:27.142679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.142798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.142823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.174 [2024-11-28 11:51:27.142839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.174 [2024-11-28 11:51:27.142988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.174 [2024-11-28 11:51:27.143137] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.174 [2024-11-28 11:51:27.143158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.174 [2024-11-28 11:51:27.143171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.174 [2024-11-28 11:51:27.145193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.174 [2024-11-28 11:51:27.154665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.174 [2024-11-28 11:51:27.155021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.155164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.155201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.174 [2024-11-28 11:51:27.155216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.174 [2024-11-28 11:51:27.155365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.174 [2024-11-28 11:51:27.155555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.174 [2024-11-28 11:51:27.155577] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.174 [2024-11-28 11:51:27.155591] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.174 [2024-11-28 11:51:27.157732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.174 [2024-11-28 11:51:27.166918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.174 [2024-11-28 11:51:27.167187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.167318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.167343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.174 [2024-11-28 11:51:27.167359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.174 [2024-11-28 11:51:27.167507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.174 [2024-11-28 11:51:27.167684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.174 [2024-11-28 11:51:27.167706] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.174 [2024-11-28 11:51:27.167720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.174 [2024-11-28 11:51:27.169774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.174 [2024-11-28 11:51:27.179263] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.174 [2024-11-28 11:51:27.179575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.179703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.174 [2024-11-28 11:51:27.179730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.174 [2024-11-28 11:51:27.179746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.174 [2024-11-28 11:51:27.179864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.174 [2024-11-28 11:51:27.180014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.174 [2024-11-28 11:51:27.180035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.175 [2024-11-28 11:51:27.180050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.175 [2024-11-28 11:51:27.182189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.175 [2024-11-28 11:51:27.191606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.175 [2024-11-28 11:51:27.191893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.175 [2024-11-28 11:51:27.192032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.175 [2024-11-28 11:51:27.192057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.175 [2024-11-28 11:51:27.192073] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.175 [2024-11-28 11:51:27.192238] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.175 [2024-11-28 11:51:27.192390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.175 [2024-11-28 11:51:27.192412] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.175 [2024-11-28 11:51:27.192427] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.175 [2024-11-28 11:51:27.194727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.175 [2024-11-28 11:51:27.204023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.175 [2024-11-28 11:51:27.204347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.175 [2024-11-28 11:51:27.204511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.175 [2024-11-28 11:51:27.204543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.175 [2024-11-28 11:51:27.204560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.175 [2024-11-28 11:51:27.204725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.175 [2024-11-28 11:51:27.204875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.175 [2024-11-28 11:51:27.204895] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.175 [2024-11-28 11:51:27.204909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.175 [2024-11-28 11:51:27.207022] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.175 [2024-11-28 11:51:27.216069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.175 [2024-11-28 11:51:27.216388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.175 [2024-11-28 11:51:27.216511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.175 [2024-11-28 11:51:27.216548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.175 [2024-11-28 11:51:27.216566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.175 [2024-11-28 11:51:27.216731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.175 [2024-11-28 11:51:27.216913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.175 [2024-11-28 11:51:27.216934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.175 [2024-11-28 11:51:27.216947] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.175 [2024-11-28 11:51:27.219089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.433 [2024-11-28 11:51:27.228364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.433 [2024-11-28 11:51:27.228658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.433 [2024-11-28 11:51:27.228824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.433 [2024-11-28 11:51:27.228850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.433 [2024-11-28 11:51:27.228865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.433 [2024-11-28 11:51:27.229014] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.433 [2024-11-28 11:51:27.229195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.433 [2024-11-28 11:51:27.229215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.433 [2024-11-28 11:51:27.229229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.433 [2024-11-28 11:51:27.231357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.433 [2024-11-28 11:51:27.240768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.433 [2024-11-28 11:51:27.241092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.433 [2024-11-28 11:51:27.241216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.433 [2024-11-28 11:51:27.241241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.433 [2024-11-28 11:51:27.241257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.433 [2024-11-28 11:51:27.241389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.433 [2024-11-28 11:51:27.241594] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.433 [2024-11-28 11:51:27.241616] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.433 [2024-11-28 11:51:27.241630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.433 [2024-11-28 11:51:27.243931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.433 [2024-11-28 11:51:27.253102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.433 [2024-11-28 11:51:27.253447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.433 [2024-11-28 11:51:27.253566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.433 [2024-11-28 11:51:27.253592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.434 [2024-11-28 11:51:27.253613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.434 [2024-11-28 11:51:27.253746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.434 [2024-11-28 11:51:27.253927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.434 [2024-11-28 11:51:27.253948] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.434 [2024-11-28 11:51:27.253962] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.434 [2024-11-28 11:51:27.255955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.434 [2024-11-28 11:51:27.265338] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.434 [2024-11-28 11:51:27.265635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.434 [2024-11-28 11:51:27.265773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.434 [2024-11-28 11:51:27.265799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.434 [2024-11-28 11:51:27.265815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.434 [2024-11-28 11:51:27.265996] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.434 [2024-11-28 11:51:27.266160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.434 [2024-11-28 11:51:27.266181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.434 [2024-11-28 11:51:27.266194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.434 [2024-11-28 11:51:27.268311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.434 [2024-11-28 11:51:27.277747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.434 [2024-11-28 11:51:27.278076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.434 [2024-11-28 11:51:27.278182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.434 [2024-11-28 11:51:27.278208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.434 [2024-11-28 11:51:27.278224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.434 [2024-11-28 11:51:27.278340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.434 [2024-11-28 11:51:27.278506] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.434 [2024-11-28 11:51:27.278550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.434 [2024-11-28 11:51:27.278565] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.434 [2024-11-28 11:51:27.280434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.434 [2024-11-28 11:51:27.289941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.434 [2024-11-28 11:51:27.290273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.434 [2024-11-28 11:51:27.290406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.434 [2024-11-28 11:51:27.290432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.434 [2024-11-28 11:51:27.290447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.434 [2024-11-28 11:51:27.290626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.434 [2024-11-28 11:51:27.290800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.434 [2024-11-28 11:51:27.290821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.434 [2024-11-28 11:51:27.290835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.434 [2024-11-28 11:51:27.292968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.434 [2024-11-28 11:51:27.302123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.434 [2024-11-28 11:51:27.302430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.434 [2024-11-28 11:51:27.302575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.434 [2024-11-28 11:51:27.302601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.434 [2024-11-28 11:51:27.302617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.434 [2024-11-28 11:51:27.302765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.434 [2024-11-28 11:51:27.302915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.434 [2024-11-28 11:51:27.302936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.434 [2024-11-28 11:51:27.302949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.434 [2024-11-28 11:51:27.304924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.434 [2024-11-28 11:51:27.314450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.434 [2024-11-28 11:51:27.314857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.434 [2024-11-28 11:51:27.315021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.434 [2024-11-28 11:51:27.315046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.434 [2024-11-28 11:51:27.315062] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.434 [2024-11-28 11:51:27.315227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.434 [2024-11-28 11:51:27.315392] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.434 [2024-11-28 11:51:27.315412] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.434 [2024-11-28 11:51:27.315426] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.434 [2024-11-28 11:51:27.317472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.434 [2024-11-28 11:51:27.326544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.434 [2024-11-28 11:51:27.326822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.434 [2024-11-28 11:51:27.326937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.434 [2024-11-28 11:51:27.326962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.434 [2024-11-28 11:51:27.326978] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.434 [2024-11-28 11:51:27.327093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.434 [2024-11-28 11:51:27.327248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.434 [2024-11-28 11:51:27.327269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.434 [2024-11-28 11:51:27.327283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.434 [2024-11-28 11:51:27.329399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.434 [2024-11-28 11:51:27.338964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.434 [2024-11-28 11:51:27.339248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.434 [2024-11-28 11:51:27.339393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.434 [2024-11-28 11:51:27.339418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.434 [2024-11-28 11:51:27.339433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.435 [2024-11-28 11:51:27.339557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.435 [2024-11-28 11:51:27.339743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.435 [2024-11-28 11:51:27.339764] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.435 [2024-11-28 11:51:27.339779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.435 [2024-11-28 11:51:27.341969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.435 [2024-11-28 11:51:27.351432] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.435 [2024-11-28 11:51:27.351752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.435 [2024-11-28 11:51:27.351893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.435 [2024-11-28 11:51:27.351918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.435 [2024-11-28 11:51:27.351933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.435 [2024-11-28 11:51:27.352048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.435 [2024-11-28 11:51:27.352228] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.435 [2024-11-28 11:51:27.352250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.435 [2024-11-28 11:51:27.352264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.435 [2024-11-28 11:51:27.354345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.435 [2024-11-28 11:51:27.363835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.435 [2024-11-28 11:51:27.364110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.435 [2024-11-28 11:51:27.364246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.435 [2024-11-28 11:51:27.364271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.435 [2024-11-28 11:51:27.364286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.435 [2024-11-28 11:51:27.364435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.435 [2024-11-28 11:51:27.364612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.435 [2024-11-28 11:51:27.364639] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.435 [2024-11-28 11:51:27.364654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.435 [2024-11-28 11:51:27.366713] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.435 [2024-11-28 11:51:27.376003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.435 [2024-11-28 11:51:27.376279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.435 [2024-11-28 11:51:27.376404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.435 [2024-11-28 11:51:27.376430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.435 [2024-11-28 11:51:27.376445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.435 [2024-11-28 11:51:27.376618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.435 [2024-11-28 11:51:27.376787] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.435 [2024-11-28 11:51:27.376808] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.435 [2024-11-28 11:51:27.376822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.435 [2024-11-28 11:51:27.379062] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.435 [2024-11-28 11:51:27.388259] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.435 [2024-11-28 11:51:27.388592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.435 [2024-11-28 11:51:27.388723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.435 [2024-11-28 11:51:27.388749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.435 [2024-11-28 11:51:27.388764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.435 [2024-11-28 11:51:27.388929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.435 [2024-11-28 11:51:27.389094] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.435 [2024-11-28 11:51:27.389115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.435 [2024-11-28 11:51:27.389128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.435 [2024-11-28 11:51:27.391187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.435 [2024-11-28 11:51:27.400700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.435 [2024-11-28 11:51:27.401027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.435 [2024-11-28 11:51:27.401165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.435 [2024-11-28 11:51:27.401190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.435 [2024-11-28 11:51:27.401207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.435 [2024-11-28 11:51:27.401355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.435 [2024-11-28 11:51:27.401519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.435 [2024-11-28 11:51:27.401552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.435 [2024-11-28 11:51:27.401572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.435 [2024-11-28 11:51:27.403619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.435 [2024-11-28 11:51:27.412947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.435 [2024-11-28 11:51:27.413248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.435 [2024-11-28 11:51:27.413385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.435 [2024-11-28 11:51:27.413412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.435 [2024-11-28 11:51:27.413428] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.435 [2024-11-28 11:51:27.413603] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.435 [2024-11-28 11:51:27.413756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.435 [2024-11-28 11:51:27.413778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.435 [2024-11-28 11:51:27.413792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.435 [2024-11-28 11:51:27.416051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.435 [2024-11-28 11:51:27.425225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.435 [2024-11-28 11:51:27.425508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.435 [2024-11-28 11:51:27.425650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.435 [2024-11-28 11:51:27.425676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.435 [2024-11-28 11:51:27.425691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.435 [2024-11-28 11:51:27.425839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.435 [2024-11-28 11:51:27.426052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.435 [2024-11-28 11:51:27.426072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.435 [2024-11-28 11:51:27.426086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.435 [2024-11-28 11:51:27.428161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.435 [2024-11-28 11:51:27.437623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.436 [2024-11-28 11:51:27.437909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.436 [2024-11-28 11:51:27.438126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.436 [2024-11-28 11:51:27.438152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.436 [2024-11-28 11:51:27.438168] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.436 [2024-11-28 11:51:27.438332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.436 [2024-11-28 11:51:27.438485] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.436 [2024-11-28 11:51:27.438506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.436 [2024-11-28 11:51:27.438521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.436 [2024-11-28 11:51:27.440595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.436 [2024-11-28 11:51:27.450008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.436 [2024-11-28 11:51:27.450277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.436 [2024-11-28 11:51:27.450411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.436 [2024-11-28 11:51:27.450437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.436 [2024-11-28 11:51:27.450452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.436 [2024-11-28 11:51:27.450629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.436 [2024-11-28 11:51:27.450783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.436 [2024-11-28 11:51:27.450804] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.436 [2024-11-28 11:51:27.450832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.436 [2024-11-28 11:51:27.452774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.436 [2024-11-28 11:51:27.462211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.436 [2024-11-28 11:51:27.462492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.436 [2024-11-28 11:51:27.462607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.436 [2024-11-28 11:51:27.462633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.436 [2024-11-28 11:51:27.462649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.436 [2024-11-28 11:51:27.462813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.436 [2024-11-28 11:51:27.462980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.436 [2024-11-28 11:51:27.463001] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.436 [2024-11-28 11:51:27.463014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.436 [2024-11-28 11:51:27.465179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.436 [2024-11-28 11:51:27.474447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.436 [2024-11-28 11:51:27.474786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.436 [2024-11-28 11:51:27.474929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.436 [2024-11-28 11:51:27.474955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.436 [2024-11-28 11:51:27.474970] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.436 [2024-11-28 11:51:27.475070] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.436 [2024-11-28 11:51:27.475189] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.436 [2024-11-28 11:51:27.475225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.436 [2024-11-28 11:51:27.475238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.436 [2024-11-28 11:51:27.477250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.436 [2024-11-28 11:51:27.486547] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.436 [2024-11-28 11:51:27.486799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.436 [2024-11-28 11:51:27.486960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.436 [2024-11-28 11:51:27.486985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.436 [2024-11-28 11:51:27.487001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.436 [2024-11-28 11:51:27.487117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.436 [2024-11-28 11:51:27.487267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.436 [2024-11-28 11:51:27.487288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.436 [2024-11-28 11:51:27.487318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.695 [2024-11-28 11:51:27.489396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.695 [2024-11-28 11:51:27.498800] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.695 [2024-11-28 11:51:27.499136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-28 11:51:27.499298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.695 [2024-11-28 11:51:27.499324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.695 [2024-11-28 11:51:27.499339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.695 [2024-11-28 11:51:27.499504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.695 [2024-11-28 11:51:27.499663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.696 [2024-11-28 11:51:27.499685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.696 [2024-11-28 11:51:27.499699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.696 [2024-11-28 11:51:27.501720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.696 [2024-11-28 11:51:27.511185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.696 [2024-11-28 11:51:27.511522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.511665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.511691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.696 [2024-11-28 11:51:27.511706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.696 [2024-11-28 11:51:27.511872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.696 [2024-11-28 11:51:27.512084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.696 [2024-11-28 11:51:27.512105] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.696 [2024-11-28 11:51:27.512119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.696 [2024-11-28 11:51:27.514453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.696 [2024-11-28 11:51:27.523681] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.696 [2024-11-28 11:51:27.524021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.524188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.524214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.696 [2024-11-28 11:51:27.524230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.696 [2024-11-28 11:51:27.524380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.696 [2024-11-28 11:51:27.524574] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.696 [2024-11-28 11:51:27.524597] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.696 [2024-11-28 11:51:27.524611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.696 [2024-11-28 11:51:27.526563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.696 [2024-11-28 11:51:27.535948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.696 [2024-11-28 11:51:27.536336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.536449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.536475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.696 [2024-11-28 11:51:27.536491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.696 [2024-11-28 11:51:27.536681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.696 [2024-11-28 11:51:27.536864] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.696 [2024-11-28 11:51:27.536885] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.696 [2024-11-28 11:51:27.536898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.696 [2024-11-28 11:51:27.538961] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.696 [2024-11-28 11:51:27.547949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.696 [2024-11-28 11:51:27.548221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.548383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.548408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.696 [2024-11-28 11:51:27.548424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.696 [2024-11-28 11:51:27.548597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.696 [2024-11-28 11:51:27.548701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.696 [2024-11-28 11:51:27.548722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.696 [2024-11-28 11:51:27.548736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.696 [2024-11-28 11:51:27.550877] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.696 [2024-11-28 11:51:27.560210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.696 [2024-11-28 11:51:27.560502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.560617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.560648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.696 [2024-11-28 11:51:27.560664] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.696 [2024-11-28 11:51:27.560813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.696 [2024-11-28 11:51:27.560946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.696 [2024-11-28 11:51:27.560966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.696 [2024-11-28 11:51:27.560979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.696 [2024-11-28 11:51:27.563052] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.696 [2024-11-28 11:51:27.572468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.696 [2024-11-28 11:51:27.572807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.572939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.572964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.696 [2024-11-28 11:51:27.572980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.696 [2024-11-28 11:51:27.573111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.696 [2024-11-28 11:51:27.573292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.696 [2024-11-28 11:51:27.573313] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.696 [2024-11-28 11:51:27.573327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.696 [2024-11-28 11:51:27.575619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.696 [2024-11-28 11:51:27.584903] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.696 [2024-11-28 11:51:27.585177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.585306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.585331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.696 [2024-11-28 11:51:27.585347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.696 [2024-11-28 11:51:27.585512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.696 [2024-11-28 11:51:27.585689] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.696 [2024-11-28 11:51:27.585711] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.696 [2024-11-28 11:51:27.585725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.696 [2024-11-28 11:51:27.587925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.696 [2024-11-28 11:51:27.597079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.696 [2024-11-28 11:51:27.597372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.597538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.597564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.696 [2024-11-28 11:51:27.597584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.696 [2024-11-28 11:51:27.597765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.696 [2024-11-28 11:51:27.597946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.696 [2024-11-28 11:51:27.597967] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.696 [2024-11-28 11:51:27.597981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.696 [2024-11-28 11:51:27.600040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.696 [2024-11-28 11:51:27.609304] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.696 [2024-11-28 11:51:27.609572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.609674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.696 [2024-11-28 11:51:27.609699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.696 [2024-11-28 11:51:27.609715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.696 [2024-11-28 11:51:27.609880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.696 [2024-11-28 11:51:27.610061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.696 [2024-11-28 11:51:27.610082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.696 [2024-11-28 11:51:27.610095] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.697 [2024-11-28 11:51:27.612199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.697 [2024-11-28 11:51:27.621629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.697 [2024-11-28 11:51:27.621853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.621994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.622020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.697 [2024-11-28 11:51:27.622036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.697 [2024-11-28 11:51:27.622169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.697 [2024-11-28 11:51:27.622334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.697 [2024-11-28 11:51:27.622355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.697 [2024-11-28 11:51:27.622368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.697 [2024-11-28 11:51:27.624398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.697 [2024-11-28 11:51:27.633889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.697 [2024-11-28 11:51:27.634183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.634320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.634345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.697 [2024-11-28 11:51:27.634360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.697 [2024-11-28 11:51:27.634608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.697 [2024-11-28 11:51:27.634745] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.697 [2024-11-28 11:51:27.634767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.697 [2024-11-28 11:51:27.634781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.697 [2024-11-28 11:51:27.636875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.697 [2024-11-28 11:51:27.646238] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.697 [2024-11-28 11:51:27.646516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.646649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.646674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.697 [2024-11-28 11:51:27.646690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.697 [2024-11-28 11:51:27.646806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.697 [2024-11-28 11:51:27.646971] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.697 [2024-11-28 11:51:27.646993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.697 [2024-11-28 11:51:27.647006] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.697 [2024-11-28 11:51:27.649144] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.697 [2024-11-28 11:51:27.658432] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.697 [2024-11-28 11:51:27.658738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.658849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.658875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.697 [2024-11-28 11:51:27.658891] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.697 [2024-11-28 11:51:27.659088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.697 [2024-11-28 11:51:27.659251] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.697 [2024-11-28 11:51:27.659272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.697 [2024-11-28 11:51:27.659286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.697 [2024-11-28 11:51:27.661227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.697 [2024-11-28 11:51:27.670961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.697 [2024-11-28 11:51:27.671222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.671384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.671410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.697 [2024-11-28 11:51:27.671426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.697 [2024-11-28 11:51:27.671566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.697 [2024-11-28 11:51:27.671724] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.697 [2024-11-28 11:51:27.671747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.697 [2024-11-28 11:51:27.671761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.697 [2024-11-28 11:51:27.673791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.697 [2024-11-28 11:51:27.683155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.697 [2024-11-28 11:51:27.683414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.683563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.683590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.697 [2024-11-28 11:51:27.683606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.697 [2024-11-28 11:51:27.683722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.697 [2024-11-28 11:51:27.683859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.697 [2024-11-28 11:51:27.683880] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.697 [2024-11-28 11:51:27.683894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.697 [2024-11-28 11:51:27.685876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.697 11:51:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:07.697 11:51:27 -- common/autotest_common.sh@862 -- # return 0 00:27:07.697 11:51:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:07.697 11:51:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:07.697 [2024-11-28 11:51:27.695582] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.697 11:51:27 -- common/autotest_common.sh@10 -- # set +x 00:27:07.697 [2024-11-28 11:51:27.695831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.695967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.695993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.697 [2024-11-28 11:51:27.696009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.697 [2024-11-28 11:51:27.696142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.697 [2024-11-28 11:51:27.696344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.697 [2024-11-28 11:51:27.696366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.697 [2024-11-28 11:51:27.696380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.697 [2024-11-28 11:51:27.698473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.697 [2024-11-28 11:51:27.707972] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.697 [2024-11-28 11:51:27.708253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.708402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.708429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.697 [2024-11-28 11:51:27.708445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.697 [2024-11-28 11:51:27.708612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.697 [2024-11-28 11:51:27.708733] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.697 [2024-11-28 11:51:27.708754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.697 [2024-11-28 11:51:27.708768] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.697 [2024-11-28 11:51:27.710845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.697 [2024-11-28 11:51:27.720366] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.697 [2024-11-28 11:51:27.720703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.720812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.697 [2024-11-28 11:51:27.720838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.697 [2024-11-28 11:51:27.720854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.697 11:51:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:07.697 [2024-11-28 11:51:27.720954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.697 [2024-11-28 11:51:27.721106] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.697 [2024-11-28 11:51:27.721127] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.697 [2024-11-28 11:51:27.721141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.698 11:51:27 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:07.698 11:51:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:07.698 11:51:27 -- common/autotest_common.sh@10 -- # set +x 00:27:07.698 [2024-11-28 11:51:27.723328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.698 [2024-11-28 11:51:27.726134] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:07.698 11:51:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:07.698 11:51:27 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:07.698 11:51:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:07.698 11:51:27 -- common/autotest_common.sh@10 -- # set +x 00:27:07.698 [2024-11-28 11:51:27.732854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.698 [2024-11-28 11:51:27.733250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-28 11:51:27.733365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-28 11:51:27.733390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.698 [2024-11-28 11:51:27.733406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.698 [2024-11-28 11:51:27.733506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.698 [2024-11-28 11:51:27.733634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.698 [2024-11-28 11:51:27.733656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.698 [2024-11-28 11:51:27.733669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.698 [2024-11-28 11:51:27.735854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.698 [2024-11-28 11:51:27.745028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.698 [2024-11-28 11:51:27.745352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-28 11:51:27.745472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.698 [2024-11-28 11:51:27.745497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.698 [2024-11-28 11:51:27.745513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.698 [2024-11-28 11:51:27.745636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.698 [2024-11-28 11:51:27.745789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.698 [2024-11-28 11:51:27.745810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.698 [2024-11-28 11:51:27.745824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.698 [2024-11-28 11:51:27.748133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.956 [2024-11-28 11:51:27.757327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.956 [2024-11-28 11:51:27.757708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.956 [2024-11-28 11:51:27.757885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.956 [2024-11-28 11:51:27.757911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.956 [2024-11-28 11:51:27.757930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.956 [2024-11-28 11:51:27.758085] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.956 [2024-11-28 11:51:27.758239] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.956 [2024-11-28 11:51:27.758261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.956 [2024-11-28 11:51:27.758278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.956 [2024-11-28 11:51:27.760455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.956 [2024-11-28 11:51:27.769849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.956 [2024-11-28 11:51:27.770339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.956 [2024-11-28 11:51:27.770482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.956 [2024-11-28 11:51:27.770508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.956 [2024-11-28 11:51:27.770537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.956 [2024-11-28 11:51:27.770698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.956 [2024-11-28 11:51:27.770871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.956 [2024-11-28 11:51:27.770893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.956 [2024-11-28 11:51:27.770911] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.956 Malloc0 00:27:07.956 11:51:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:07.956 11:51:27 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:07.956 11:51:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:07.956 [2024-11-28 11:51:27.773003] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.956 11:51:27 -- common/autotest_common.sh@10 -- # set +x 00:27:07.956 11:51:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:07.956 11:51:27 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:07.956 11:51:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:07.956 11:51:27 -- common/autotest_common.sh@10 -- # set +x 00:27:07.956 [2024-11-28 11:51:27.782233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.956 [2024-11-28 11:51:27.782536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.956 [2024-11-28 11:51:27.782684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.956 [2024-11-28 11:51:27.782710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1763160 with addr=10.0.0.2, port=4420 00:27:07.956 [2024-11-28 11:51:27.782726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1763160 is same with the state(5) to be set 00:27:07.956 [2024-11-28 11:51:27.782890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1763160 (9): Bad file descriptor 00:27:07.956 [2024-11-28 11:51:27.783025] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.956 [2024-11-28 11:51:27.783045] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.956 [2024-11-28 11:51:27.783059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.956 [2024-11-28 11:51:27.785209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.956 11:51:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:07.956 11:51:27 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:07.956 11:51:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:07.956 11:51:27 -- common/autotest_common.sh@10 -- # set +x 00:27:07.956 [2024-11-28 11:51:27.792096] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:07.956 [2024-11-28 11:51:27.794665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.956 11:51:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:07.956 11:51:27 -- host/bdevperf.sh@38 -- # wait 3926218 00:27:07.956 [2024-11-28 11:51:27.828390] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:17.919 00:27:17.919 Latency(us) 00:27:17.919 [2024-11-28T10:51:37.975Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:17.919 [2024-11-28T10:51:37.975Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:17.919 Verification LBA range: start 0x0 length 0x4000 00:27:17.919 Nvme1n1 : 15.01 9325.88 36.43 16558.10 0.00 4930.73 709.97 18350.08 00:27:17.919 [2024-11-28T10:51:37.975Z] =================================================================================================================== 00:27:17.919 [2024-11-28T10:51:37.975Z] Total : 9325.88 36.43 16558.10 0.00 4930.73 709.97 18350.08 00:27:17.919 11:51:36 -- host/bdevperf.sh@39 -- # sync 00:27:17.919 11:51:36 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:17.919 11:51:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:17.919 11:51:36 -- common/autotest_common.sh@10 -- # set +x 00:27:17.919 11:51:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:17.919 11:51:36 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:17.919 11:51:36 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:17.919 11:51:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:17.919 11:51:36 -- nvmf/common.sh@116 -- # sync 00:27:17.919 11:51:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:17.919 11:51:36 -- nvmf/common.sh@119 -- # set +e 00:27:17.919 11:51:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:17.919 11:51:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:17.919 rmmod nvme_tcp 00:27:17.919 rmmod nvme_fabrics 00:27:17.919 rmmod nvme_keyring 00:27:17.919 11:51:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:17.919 11:51:36 -- nvmf/common.sh@123 -- # set -e 00:27:17.919 11:51:36 -- nvmf/common.sh@124 -- # return 0 00:27:17.919 11:51:36 -- nvmf/common.sh@477 -- # '[' -n 3926909 ']' 00:27:17.919 11:51:36 -- nvmf/common.sh@478 -- # killprocess 3926909 00:27:17.919 11:51:36 -- common/autotest_common.sh@936 -- # '[' -z 3926909 ']' 00:27:17.919 11:51:36 -- common/autotest_common.sh@940 -- # kill -0 3926909 00:27:17.919 11:51:36 -- common/autotest_common.sh@941 -- # uname 00:27:17.919 11:51:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:17.919 11:51:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3926909 00:27:17.919 11:51:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:17.919 11:51:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:17.919 11:51:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3926909' 00:27:17.919 killing process with pid 3926909 00:27:17.919 11:51:36 -- common/autotest_common.sh@955 -- # kill 3926909 00:27:17.919 11:51:36 -- common/autotest_common.sh@960 -- # wait 3926909 00:27:17.919 11:51:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:17.919 11:51:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:17.919 11:51:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:17.919 11:51:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:17.919 11:51:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:17.919 11:51:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:17.919 11:51:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:17.919 11:51:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:19.296 11:51:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:19.296 00:27:19.296 real 0m23.609s 00:27:19.296 user 1m4.116s 00:27:19.296 sys 0m4.179s 00:27:19.296 11:51:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:19.296 11:51:38 -- common/autotest_common.sh@10 -- # set +x 00:27:19.296 ************************************ 00:27:19.296 END TEST nvmf_bdevperf 00:27:19.296 ************************************ 00:27:19.296 11:51:38 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:19.296 11:51:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:19.296 11:51:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:19.296 11:51:38 -- common/autotest_common.sh@10 -- # set +x 00:27:19.296 ************************************ 00:27:19.296 START TEST nvmf_target_disconnect 00:27:19.296 ************************************ 00:27:19.296 11:51:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:19.296 * Looking for test storage... 00:27:19.296 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:19.296 11:51:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:19.296 11:51:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:19.296 11:51:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:19.296 11:51:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:19.296 11:51:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:19.296 11:51:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:19.296 11:51:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:19.296 11:51:39 -- scripts/common.sh@335 -- # IFS=.-: 00:27:19.296 11:51:39 -- scripts/common.sh@335 -- # read -ra ver1 00:27:19.296 11:51:39 -- scripts/common.sh@336 -- # IFS=.-: 00:27:19.296 11:51:39 -- scripts/common.sh@336 -- # read -ra ver2 00:27:19.296 11:51:39 -- scripts/common.sh@337 -- # local 'op=<' 00:27:19.296 11:51:39 -- scripts/common.sh@339 -- # ver1_l=2 00:27:19.296 11:51:39 -- scripts/common.sh@340 -- # ver2_l=1 00:27:19.296 11:51:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:19.296 11:51:39 -- scripts/common.sh@343 -- # case "$op" in 00:27:19.296 11:51:39 -- scripts/common.sh@344 -- # : 1 00:27:19.296 11:51:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:19.296 11:51:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:19.296 11:51:39 -- scripts/common.sh@364 -- # decimal 1 00:27:19.296 11:51:39 -- scripts/common.sh@352 -- # local d=1 00:27:19.296 11:51:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:19.296 11:51:39 -- scripts/common.sh@354 -- # echo 1 00:27:19.296 11:51:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:19.296 11:51:39 -- scripts/common.sh@365 -- # decimal 2 00:27:19.296 11:51:39 -- scripts/common.sh@352 -- # local d=2 00:27:19.297 11:51:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:19.297 11:51:39 -- scripts/common.sh@354 -- # echo 2 00:27:19.297 11:51:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:19.297 11:51:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:19.297 11:51:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:19.297 11:51:39 -- scripts/common.sh@367 -- # return 0 00:27:19.297 11:51:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:19.297 11:51:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:19.297 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:19.297 --rc genhtml_branch_coverage=1 00:27:19.297 --rc genhtml_function_coverage=1 00:27:19.297 --rc genhtml_legend=1 00:27:19.297 --rc geninfo_all_blocks=1 00:27:19.297 --rc geninfo_unexecuted_blocks=1 00:27:19.297 00:27:19.297 ' 00:27:19.297 11:51:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:19.297 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:19.297 --rc genhtml_branch_coverage=1 00:27:19.297 --rc genhtml_function_coverage=1 00:27:19.297 --rc genhtml_legend=1 00:27:19.297 --rc geninfo_all_blocks=1 00:27:19.297 --rc geninfo_unexecuted_blocks=1 00:27:19.297 00:27:19.297 ' 00:27:19.297 11:51:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:19.297 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:19.297 --rc genhtml_branch_coverage=1 00:27:19.297 --rc genhtml_function_coverage=1 00:27:19.297 --rc genhtml_legend=1 00:27:19.297 --rc geninfo_all_blocks=1 00:27:19.297 --rc geninfo_unexecuted_blocks=1 00:27:19.297 00:27:19.297 ' 00:27:19.297 11:51:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:19.297 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:19.297 --rc genhtml_branch_coverage=1 00:27:19.297 --rc genhtml_function_coverage=1 00:27:19.297 --rc genhtml_legend=1 00:27:19.297 --rc geninfo_all_blocks=1 00:27:19.297 --rc geninfo_unexecuted_blocks=1 00:27:19.297 00:27:19.297 ' 00:27:19.297 11:51:39 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:19.297 11:51:39 -- nvmf/common.sh@7 -- # uname -s 00:27:19.297 11:51:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:19.297 11:51:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:19.297 11:51:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:19.297 11:51:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:19.297 11:51:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:19.297 11:51:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:19.297 11:51:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:19.297 11:51:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:19.297 11:51:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:19.297 11:51:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:19.297 11:51:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:19.297 11:51:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:19.297 11:51:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:19.297 11:51:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:19.297 11:51:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:19.297 11:51:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:19.297 11:51:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:19.297 11:51:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:19.297 11:51:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:19.297 11:51:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:19.297 11:51:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:19.297 11:51:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:19.297 11:51:39 -- paths/export.sh@5 -- # export PATH 00:27:19.297 11:51:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:19.297 11:51:39 -- nvmf/common.sh@46 -- # : 0 00:27:19.297 11:51:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:19.297 11:51:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:19.297 11:51:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:19.297 11:51:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:19.297 11:51:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:19.297 11:51:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:19.297 11:51:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:19.297 11:51:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:19.297 11:51:39 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:19.297 11:51:39 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:19.297 11:51:39 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:19.297 11:51:39 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:19.297 11:51:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:19.297 11:51:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:19.297 11:51:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:19.297 11:51:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:19.297 11:51:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:19.297 11:51:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:19.297 11:51:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:19.297 11:51:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:19.297 11:51:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:19.297 11:51:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:19.297 11:51:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:19.297 11:51:39 -- common/autotest_common.sh@10 -- # set +x 00:27:21.198 11:51:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:21.198 11:51:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:21.198 11:51:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:21.198 11:51:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:21.198 11:51:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:21.198 11:51:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:21.198 11:51:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:21.198 11:51:41 -- nvmf/common.sh@294 -- # net_devs=() 00:27:21.198 11:51:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:21.198 11:51:41 -- nvmf/common.sh@295 -- # e810=() 00:27:21.198 11:51:41 -- nvmf/common.sh@295 -- # local -ga e810 00:27:21.198 11:51:41 -- nvmf/common.sh@296 -- # x722=() 00:27:21.198 11:51:41 -- nvmf/common.sh@296 -- # local -ga x722 00:27:21.198 11:51:41 -- nvmf/common.sh@297 -- # mlx=() 00:27:21.198 11:51:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:21.198 11:51:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:21.198 11:51:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:21.198 11:51:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:21.198 11:51:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:21.198 11:51:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:21.198 11:51:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:21.198 11:51:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:21.198 11:51:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:21.198 11:51:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:21.198 11:51:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:21.198 11:51:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:21.198 11:51:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:21.198 11:51:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:21.198 11:51:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:21.198 11:51:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:21.198 11:51:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:21.198 11:51:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:21.198 11:51:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:21.198 11:51:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:21.198 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:21.198 11:51:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:21.198 11:51:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:21.198 11:51:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:21.198 11:51:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:21.198 11:51:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:21.198 11:51:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:21.198 11:51:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:21.198 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:21.198 11:51:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:21.199 11:51:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:21.199 11:51:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:21.199 11:51:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:21.199 11:51:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:21.199 11:51:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:21.199 11:51:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:21.199 11:51:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:21.199 11:51:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:21.199 11:51:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:21.199 11:51:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:21.199 11:51:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:21.199 11:51:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:21.199 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:21.199 11:51:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:21.199 11:51:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:21.199 11:51:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:21.199 11:51:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:21.199 11:51:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:21.199 11:51:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:21.199 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:21.199 11:51:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:21.199 11:51:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:21.199 11:51:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:21.199 11:51:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:21.199 11:51:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:21.199 11:51:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:21.199 11:51:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:21.199 11:51:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:21.199 11:51:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:21.199 11:51:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:21.199 11:51:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:21.199 11:51:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:21.199 11:51:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:21.199 11:51:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:21.199 11:51:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:21.199 11:51:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:21.199 11:51:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:21.199 11:51:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:21.199 11:51:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:21.458 11:51:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:21.458 11:51:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:21.458 11:51:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:21.458 11:51:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:21.458 11:51:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:21.458 11:51:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:21.458 11:51:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:21.458 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:21.458 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:27:21.458 00:27:21.458 --- 10.0.0.2 ping statistics --- 00:27:21.458 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:21.458 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:27:21.458 11:51:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:21.458 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:21.458 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.128 ms 00:27:21.458 00:27:21.458 --- 10.0.0.1 ping statistics --- 00:27:21.458 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:21.458 rtt min/avg/max/mdev = 0.128/0.128/0.128/0.000 ms 00:27:21.458 11:51:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:21.458 11:51:41 -- nvmf/common.sh@410 -- # return 0 00:27:21.458 11:51:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:21.458 11:51:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:21.458 11:51:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:21.458 11:51:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:21.458 11:51:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:21.458 11:51:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:21.458 11:51:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:21.458 11:51:41 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:21.458 11:51:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:21.458 11:51:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:21.458 11:51:41 -- common/autotest_common.sh@10 -- # set +x 00:27:21.458 ************************************ 00:27:21.458 START TEST nvmf_target_disconnect_tc1 00:27:21.458 ************************************ 00:27:21.458 11:51:41 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:21.458 11:51:41 -- host/target_disconnect.sh@32 -- # set +e 00:27:21.458 11:51:41 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:21.458 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.458 [2024-11-28 11:51:41.442730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.458 [2024-11-28 11:51:41.442877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.458 [2024-11-28 11:51:41.442905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa79b40 with addr=10.0.0.2, port=4420 00:27:21.458 [2024-11-28 11:51:41.442941] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:21.458 [2024-11-28 11:51:41.442962] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:21.458 [2024-11-28 11:51:41.442975] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:21.458 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:21.458 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:21.458 Initializing NVMe Controllers 00:27:21.458 11:51:41 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:21.458 11:51:41 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:21.458 11:51:41 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:21.458 11:51:41 -- common/autotest_common.sh@1142 -- # return 0 00:27:21.458 11:51:41 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:21.458 11:51:41 -- host/target_disconnect.sh@41 -- # set -e 00:27:21.458 00:27:21.458 real 0m0.087s 00:27:21.458 user 0m0.036s 00:27:21.458 sys 0m0.050s 00:27:21.458 11:51:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:21.458 11:51:41 -- common/autotest_common.sh@10 -- # set +x 00:27:21.458 ************************************ 00:27:21.458 END TEST nvmf_target_disconnect_tc1 00:27:21.458 ************************************ 00:27:21.458 11:51:41 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:21.458 11:51:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:21.458 11:51:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:21.458 11:51:41 -- common/autotest_common.sh@10 -- # set +x 00:27:21.458 ************************************ 00:27:21.458 START TEST nvmf_target_disconnect_tc2 00:27:21.458 ************************************ 00:27:21.458 11:51:41 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:21.458 11:51:41 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:21.458 11:51:41 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:21.458 11:51:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:21.458 11:51:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:21.458 11:51:41 -- common/autotest_common.sh@10 -- # set +x 00:27:21.458 11:51:41 -- nvmf/common.sh@469 -- # nvmfpid=3930110 00:27:21.458 11:51:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:21.458 11:51:41 -- nvmf/common.sh@470 -- # waitforlisten 3930110 00:27:21.458 11:51:41 -- common/autotest_common.sh@829 -- # '[' -z 3930110 ']' 00:27:21.458 11:51:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:21.458 11:51:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:21.458 11:51:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:21.458 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:21.458 11:51:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:21.458 11:51:41 -- common/autotest_common.sh@10 -- # set +x 00:27:21.717 [2024-11-28 11:51:41.525436] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:21.717 [2024-11-28 11:51:41.525508] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:21.717 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.717 [2024-11-28 11:51:41.590105] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:21.717 [2024-11-28 11:51:41.697977] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:21.717 [2024-11-28 11:51:41.698129] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:21.717 [2024-11-28 11:51:41.698145] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:21.717 [2024-11-28 11:51:41.698158] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:21.717 [2024-11-28 11:51:41.698319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:21.717 [2024-11-28 11:51:41.698438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:21.717 [2024-11-28 11:51:41.698552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:21.717 [2024-11-28 11:51:41.698605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:22.651 11:51:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:22.651 11:51:42 -- common/autotest_common.sh@862 -- # return 0 00:27:22.651 11:51:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:22.651 11:51:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:22.651 11:51:42 -- common/autotest_common.sh@10 -- # set +x 00:27:22.651 11:51:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:22.651 11:51:42 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:22.651 11:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:22.651 11:51:42 -- common/autotest_common.sh@10 -- # set +x 00:27:22.651 Malloc0 00:27:22.651 11:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:22.651 11:51:42 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:22.651 11:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:22.651 11:51:42 -- common/autotest_common.sh@10 -- # set +x 00:27:22.651 [2024-11-28 11:51:42.610481] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:22.651 11:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:22.651 11:51:42 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:22.651 11:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:22.651 11:51:42 -- common/autotest_common.sh@10 -- # set +x 00:27:22.651 11:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:22.651 11:51:42 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:22.651 11:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:22.651 11:51:42 -- common/autotest_common.sh@10 -- # set +x 00:27:22.651 11:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:22.651 11:51:42 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:22.651 11:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:22.651 11:51:42 -- common/autotest_common.sh@10 -- # set +x 00:27:22.651 [2024-11-28 11:51:42.638767] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:22.651 11:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:22.651 11:51:42 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:22.651 11:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:22.651 11:51:42 -- common/autotest_common.sh@10 -- # set +x 00:27:22.651 11:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:22.651 11:51:42 -- host/target_disconnect.sh@50 -- # reconnectpid=3930265 00:27:22.651 11:51:42 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:22.651 11:51:42 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:22.651 EAL: No free 2048 kB hugepages reported on node 1 00:27:25.220 11:51:44 -- host/target_disconnect.sh@53 -- # kill -9 3930110 00:27:25.220 11:51:44 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 [2024-11-28 11:51:44.662968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 [2024-11-28 11:51:44.663357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Read completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 Write completed with error (sct=0, sc=8) 00:27:25.220 starting I/O failed 00:27:25.220 [2024-11-28 11:51:44.663673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:25.220 [2024-11-28 11:51:44.663864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.220 [2024-11-28 11:51:44.663997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.664025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.664181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.664342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.664371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.664512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.664632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.664658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.664765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.664879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.664905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.665038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.665176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.665202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.665309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.665411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.665437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.665540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.665664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.665691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.665833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.665959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.665984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.666127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.666287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.666313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.666452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.666560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.666587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.666697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.666863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.666890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.667035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.667169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.667196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.667392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.667521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.667553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.667668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.667780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.667805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.667963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.668093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.668119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.668228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.668371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.668396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.668557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.668668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.668694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.668809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.668945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.668971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.669138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.669252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.669278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.669411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.669548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.669574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.669683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.669793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.669819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.669953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.670159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.670185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.670319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.670533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.670559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.670676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.670816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.670841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.670942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.671103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.671128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.671241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.671385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.671411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.671542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.671675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.671700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.671834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.671941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.671966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.672106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.672207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.672233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.672367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.672471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.672497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.672602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.672735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.672761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.672861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.673006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.673032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.673171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.673308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.221 [2024-11-28 11:51:44.673334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.221 qpair failed and we were unable to recover it. 00:27:25.221 [2024-11-28 11:51:44.673439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.673559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.673586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.673688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.673797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.673822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.673933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.674067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.674092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.674254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.674392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.674418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.674536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.674667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.674692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.674806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.674913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.674940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.675075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.675204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.675230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.675340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.675470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.675496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.675644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.675752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.675778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.675914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.676074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.676100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.676233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.676360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.676386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.676549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.676681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.676706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.676832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.676965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.676990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.677091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.677248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.677274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.677381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.677517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.677550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.677688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.677842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.677867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.677968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.678098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.678123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.678255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.678386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.678411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.678518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.678662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.678688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.678796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.678925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.678950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.679082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.679185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.679211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.679316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.679424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.679450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.679600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.679711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.679736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.679897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.680055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.680081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.680191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.680317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.680343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.680475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.680582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.680608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.680741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.680875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.680900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.681035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.681133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.681159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.681287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.681435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.681468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.681618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.681727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.681753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.681862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.681991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.682017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.682144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.682277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.682303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.682405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.682502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.682536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.682670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.682803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.682829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.222 [2024-11-28 11:51:44.682989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.683127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.222 [2024-11-28 11:51:44.683154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.222 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.683288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.683421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.683446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.683550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.683661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.683687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.683851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.683986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.684012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.684174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.684281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.684313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.684463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.684592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.684618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.684754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.684885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.684911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.685073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.685205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.685231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.685384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.685513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.685545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.685654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.685800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.685826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.685985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.686142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.686168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.686305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.686462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.686488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.686642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.686748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.686773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.686884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.687015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.687040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.687174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.687284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.687314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.687474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.687581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.687607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.687714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.687845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.687870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.688002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.688138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.688163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.688264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.688398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.688423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.688529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.688659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.688685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.688793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.688922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.688949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.689085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.689196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.689223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.689336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.689469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.689495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.689716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.689824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.689850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.689954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.690115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.690144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.690283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.690441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.690466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.690574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.690716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.690742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.690875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.691009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.691035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.691172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.691308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.691334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.691466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.691625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.691651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.691748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.691846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.691873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.692031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.692241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.692266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.692477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.692614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.692640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.692770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.692875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.692900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.693009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.693167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.693193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.223 qpair failed and we were unable to recover it. 00:27:25.223 [2024-11-28 11:51:44.693331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.223 [2024-11-28 11:51:44.693433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.693459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.693590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.693728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.693754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.693885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.693977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.694003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.694134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.694269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.694295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.694430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.694563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.694589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.694754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.694884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.694909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.695042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.695143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.695169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.695296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.695423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.695448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.695564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.695695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.695721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.695857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.695993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.696018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.696182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.696287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.696313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.696443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.696580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.696607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.696715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.696846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.696871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.697005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.697105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.697130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.697343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.697449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.697475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.697620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.697736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.697761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.697891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.698004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.698029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.698164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.698332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.698357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.698515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.698654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.698679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.698836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.698939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.698965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.699102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.699259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.699285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.699418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.699519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.699554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.699710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.699816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.699843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.224 [2024-11-28 11:51:44.699942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.700077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.224 [2024-11-28 11:51:44.700103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.224 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.700314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.700443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.700469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.700583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.700716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.700741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.700844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.701007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.701032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.701163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.701270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.701296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.701408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.701620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.701648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.701785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.701894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.701921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.702081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.702215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.702241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.702410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.702544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.702570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.702674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.702885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.702911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.703043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.703169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.703195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.703357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.703516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.703548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.703680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.703807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.703832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.703938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.704068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.704093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.704254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.704387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.704414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.704549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.704721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.704747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.704851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.704955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.704982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.705150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.705254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.705280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.705394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.705535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.705561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.705702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.705806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.705832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.705990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.706123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.706148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.706313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.706446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.706472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.706638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.706801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.706828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.706987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.707142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.707167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.707264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.707370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.707396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.707499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.707669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.707696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.707802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.707934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.707960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.708072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.708198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.708224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.708357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.708533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.708559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.708670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.708772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.708797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.708924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.709025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.709051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.709215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.709347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.709373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.709549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.709657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.709683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.709841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.710004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.710030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.710138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.710273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.710299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.710435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.710600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.710627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.225 qpair failed and we were unable to recover it. 00:27:25.225 [2024-11-28 11:51:44.710766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.225 [2024-11-28 11:51:44.710906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.710932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.711071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.711185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.711211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.711342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.711554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.711581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.711716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.711857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.711883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.711983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.712118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.712144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.712276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.712407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.712433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.712536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.712697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.712723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.712849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.712957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.712982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.713120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.713277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.713302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.713433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.713548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.713574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.713678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.713809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.713835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.714011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.714149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.714178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.714287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.714395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.714421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.714595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.714731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.714756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.714859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.714972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.714999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.715134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.715238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.715264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.715403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.715536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.715563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.715668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.715882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.715908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.716020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.716155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.716180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.716342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.716447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.716474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.716588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.716698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.716725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.226 qpair failed and we were unable to recover it. 00:27:25.226 [2024-11-28 11:51:44.716854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.716987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.226 [2024-11-28 11:51:44.717013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.717144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.717279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.717305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.717409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.717544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.717570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.717706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.717815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.717841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.718052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.718210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.718237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.718366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.718496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.718521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.718637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.718769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.718794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.718929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.719062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.719088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.719195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.719327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.719352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.719460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.719595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.719622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.719763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.719877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.719902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.720034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.720139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.720164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.720264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.720423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.720448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.720585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.720690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.720716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.720817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.720923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.720948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.721113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.721216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.721241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.721373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.721477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.721503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.721607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.721737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.721762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.721872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.721980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.722005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.722134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.722240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.722265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.722428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.722555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.722582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.722714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.722846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.722873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.723007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.723219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.723244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.723375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.723521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.723571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.723698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.723843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.723871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.724074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.724249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.724275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.724415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.724547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.724574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.724737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.724910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.724954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.725152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.725292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.725317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.725478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.725612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.725656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.725870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.726047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.726072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.726168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.726267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.726291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.726438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.726568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.726594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.227 qpair failed and we were unable to recover it. 00:27:25.227 [2024-11-28 11:51:44.726727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.726857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.227 [2024-11-28 11:51:44.726882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.727006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.727147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.727173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.727280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.727403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.727429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.727538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.727645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.727671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.727807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.727936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.727962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.728124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.728233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.728260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.728359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.728491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.728516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.728649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.728781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.728811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.728945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.729053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.729078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.729234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.729335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.729361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.729533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.729636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.729662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.729797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.729902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.729928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.730138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.730266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.730306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.730444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.730609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.730635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.730771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.730877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.730902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.731008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.731140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.731165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.731266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.731395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.731435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.731586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.731720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.731749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.731853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.731980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.732005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.732146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.732379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.732405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.732553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.732716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.732741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.732881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.733068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.733111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.733218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.733376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.733401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.733535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.733685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.733728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.733893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.734029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.734054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.734271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.734403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.734429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.734559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.734684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.734727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.734874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.734994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.735025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.735162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.735286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.735312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.735442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.735602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.735629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.735732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.735891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.735917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.736046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.736180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.736206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.736365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.736492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.736518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.736707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.736857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.736883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.737026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.737175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.737201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.737308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.737431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.737457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.737583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.737720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.737746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.737880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.738021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.738051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.738157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.738297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.738322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.738480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.738621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.738647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.738858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.739066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.739091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.739189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.739345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.739371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.739501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.739644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.739670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.739804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.739927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.739952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.740061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.740195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.740221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.740329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.740442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.740467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.740617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.740822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.740865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.741061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.741163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.741189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.741302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.741427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.741453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.741588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.741724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.741750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.741869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.742019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.742044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.742255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.742391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.742416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.742554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.742743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.742786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.742932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.743125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.743151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.743310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.743444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.743469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.743608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.743778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.743824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.743943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.744137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.744181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.744283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.744429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.744454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.744591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.744741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.744784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.228 qpair failed and we were unable to recover it. 00:27:25.228 [2024-11-28 11:51:44.744993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.228 [2024-11-28 11:51:44.745125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.745151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.745258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.745466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.745491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.745645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.745793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.745820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.745962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.746173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.746199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.746328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.746463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.746488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.746655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.746855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.746898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.747048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.747179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.747204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.747331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.747466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.747492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.747628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.747736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.747762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.747899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.748039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.748064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.748224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.748382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.748408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.748543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.748650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.748676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.748811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.748969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.748996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.749098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.749232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.749259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.749392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.749497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.749523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.749743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.749894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.749919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.750016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.750116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.750142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.750314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.750443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.750469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.750597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.750731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.750757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.750895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.750996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.751022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.751157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.751289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.751314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.751446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.751580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.751605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.751741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.751870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.751897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.752061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.752272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.752298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.752404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.752580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.752609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.752779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.752921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.752962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.753098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.753233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.753260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.753399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.753534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.753561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.753670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.753791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.753820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.753978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.754110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.754135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.754270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.754402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.754427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.754550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.754681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.754706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.754839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.755022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.755048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.755148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.755280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.755306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.755408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.755569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.755595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.755756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.755886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.755911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.756035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.756137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.756162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.756294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.756430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.756455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.756606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.756782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.756807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.756918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.757053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.757079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.757240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.757397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.757422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.757549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.757672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.757699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.757847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.757980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.758005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.758139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.758299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.758324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.758431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.758595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.758622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.758757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.758889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.758914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.759073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.759175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.759201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.759304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.759431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.759457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.759590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.759801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.759826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.759989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.760117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.760144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.760320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.760451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.760476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.760625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.760768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.760811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.760964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.761113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.761138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.761269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.761396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.761422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.761550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.761671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.761714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.761842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.761985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.762011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.762147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.762259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.762286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.762420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.762577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.762603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 [2024-11-28 11:51:44.762728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.762887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.229 [2024-11-28 11:51:44.762912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.229 qpair failed and we were unable to recover it. 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Write completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Write completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Write completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Write completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Write completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Write completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Write completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.229 Read completed with error (sct=0, sc=8) 00:27:25.229 starting I/O failed 00:27:25.230 [2024-11-28 11:51:44.763209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.230 [2024-11-28 11:51:44.763365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.763486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.763514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.763694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.763795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.763822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.763935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.764073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.764098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.764231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.764363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.764389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.764497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.764643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.764669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.764779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.764885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.764912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.765017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.765149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.765175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.765342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.765501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.765534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.765669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.765773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.765799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.765900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.766033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.766059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.766198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.766309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.766334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.766462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.766592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.766618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.766778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.766905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.766934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.767062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.767167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.767193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.767351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.767487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.767512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.767671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.767817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.767860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.767997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.768159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.768184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.768292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.768393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.768418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.768553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.768663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.768688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.768815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.768943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.768969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.769103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.769230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.769255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.769385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.769520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.769551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.769667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.769815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.769859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.769988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.770118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.770143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.770251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.770359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.770384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.770518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.770668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.770696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.770909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.771064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.771090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.771195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.771329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.771355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.771484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.771623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.771649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.771783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.771947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.771972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.772071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.772233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.772258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.772392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.772490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.772515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.772658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.772761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.772786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.772884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.772992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.773016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.773176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.773278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.773304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.773463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.773605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.773632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.773811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.773975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.774020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.774155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.774284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.774309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.774441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.774552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.774579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.774782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.774942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.774967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.775119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.775248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.775274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.775435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.775587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.775630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.775845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.775989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.776015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.776121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.776227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.776251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.776463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.776599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.776625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.776737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.776851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.776876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.777010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.777113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.777139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.777280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.777448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.777473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.777584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.777694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.777720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.777877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.778040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.778086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.778245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.778404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.778429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.778588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.778797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.778823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.778931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.779066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.779093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.779249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.779386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.779412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.779511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.779651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.779695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.779825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.779950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.779980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.780116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.780258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.780283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.780413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.780516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.780548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.780719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.780882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.780908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.781030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.781208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.781233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.781344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.781473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.781498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.781641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.781756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.781782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.230 qpair failed and we were unable to recover it. 00:27:25.230 [2024-11-28 11:51:44.781890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.230 [2024-11-28 11:51:44.782020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.782047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.782175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.782275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.782300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.782464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.782621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.782669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.782830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.782967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.783016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.783146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.783279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.783304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.783434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.783592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.783619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.783751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.783855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.783881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.783991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.784091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.784117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.784251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.784385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.784411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.784517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.784680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.784705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.784839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.784973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.784999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.785161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.785297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.785322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.785462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.785579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.785605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.785733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.785858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.785905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.786072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.786195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.786221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.786335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.786437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.786463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.786596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.786728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.786754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.786863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.786964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.786990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.787089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.787200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.787227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.787358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.787520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.787551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.787730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.787898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.787942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.788114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.788271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.788297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.788460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.788627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.788653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.788811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.788980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.789028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.789181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.789306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.789332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.789471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.789594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.789638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.789758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.789940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.789966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.790123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.790279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.790305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.790415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.790518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.790558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.790689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.790848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.790873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.791007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.791139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.791165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.791266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.791412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.791437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.791586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.791714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.791740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.791846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.791990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.792015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.792133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.792231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.792256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.792417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.792513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.792544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.792642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.792775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.792800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.792944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.793073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.793099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.793258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.793426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.793451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.793563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.793669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.793696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.793825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.793996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.794039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.794165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.794271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.794298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.794429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.794575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.794601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.794759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.794907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.794950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.795060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.795174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.795201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.795363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.795466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.795491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.795675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.795843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.795885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.796009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.796158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.796183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.796343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.796479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.796505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.796668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.796831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.796874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.797030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.797207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.797232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.797393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.797504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.797536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.797698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.797885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.797911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.798042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.798162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.798190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.798345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.798448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.798473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.798593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.798714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.798741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.798863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.799007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.799032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.799167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.799277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.799302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.799438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.799541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.799567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.799742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.799937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.799979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.800104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.800227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.800252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.800362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.800494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.800519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.800644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.800814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.800859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.800980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.801133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.801159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.801268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.801432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.801457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.801568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.801676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.801703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.231 [2024-11-28 11:51:44.801896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.802058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.231 [2024-11-28 11:51:44.802084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.231 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.802221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.802352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.802378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.802483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.802631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.802675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.802832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.802975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.803019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.803150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.803286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.803311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.803413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.803551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.803578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.803706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.803839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.803866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.803971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.804104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.804130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.804297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.804405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.804430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.804563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.804691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.804716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.804826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.804990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.805015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.805116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.805226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.805252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.805411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.805543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.805569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.805670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.805782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.805808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.805961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.806098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.806125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.806251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.806357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.806382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.806488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.806674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.806701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.806849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.807027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.807052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.807193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.807300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.807325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.807471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.807638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.807685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.807814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.807981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.808023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.808134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.808292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.808317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.808414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.808588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.808617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.808788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.808941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.808966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.809075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.809217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.809242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.809374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.809504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.809534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.809711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.809888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.809917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.810113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.810278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.810303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.810444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.810589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.810615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.810745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.810852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.810877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.811037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.811165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.811192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.811325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.811457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.811482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.811662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.811793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.811822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.812006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.812141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.812168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.812269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.812401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.812428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.812615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.812765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.812790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.812950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.813088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.813113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.813242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.813367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.813392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.813513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.813650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.813693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.813880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.813997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.814023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.814151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.814294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.814320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.814477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.814621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.814647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.814769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.814915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.814957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.815087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.815241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.815266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.815370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.815544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.815571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.815720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.815899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.815926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.816084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.816207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.816232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.816344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.816479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.816505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.816687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.816874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.816905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.817033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.817196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.817222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.817363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.817521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.817554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.817678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.817825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.817853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.817969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.818088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.818118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.818237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.818381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.818409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.818576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.818706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.818732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.818897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.819018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.819046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.819221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.819367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.819396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.819521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.819691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.819717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.819834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.819996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.820021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.820158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.820309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.820338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.820466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.820605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.232 [2024-11-28 11:51:44.820632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.232 qpair failed and we were unable to recover it. 00:27:25.232 [2024-11-28 11:51:44.820766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.820878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.820903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.821080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.821187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.821214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.821336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.821522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.821574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.821707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.821839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.821864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.821962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.822096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.822123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.822294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.822451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.822476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.822582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.822720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.822745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.822888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.823063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.823092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.823263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.823395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.823422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.823536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.823663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.823688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.823807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.823950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.823979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.824147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.824329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.824357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.824492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.824609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.824635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.824737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.824890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.824919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.825053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.825213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.825241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.825393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.825544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.825587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.825750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.825870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.825898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.826072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.826250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.826279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.826465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.826610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.826636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.826772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.826936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.826962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.827076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.827192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.827221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.827378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.827508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.827544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.827676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.827779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.827804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.827907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.828059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.828087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.828257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.828398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.828427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.828583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.828742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.828767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.828870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.829002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.829028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.829164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.829283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.829318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.829462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.829621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.829647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.829803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.829948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.829976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.830145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.830286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.830315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.830457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.830642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.830668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.830804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.830933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.830973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.831120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.831265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.831294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.831414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.831532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.831574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.831675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.831830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.831855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.832043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.832203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.832228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.832375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.832478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.832509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.832615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.832750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.832775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.832897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.833045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.833073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.833185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.833357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.833385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.833540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.833697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.833722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.833881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.833997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.834026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.834165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.834339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.834367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.834590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.834693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.834718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.834841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.834986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.835014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.835199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.835369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.835394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.835555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.835657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.835687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.835818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.836005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.836031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.836186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.836362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.836390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.836513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.836618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.836644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.836748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.836896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.836924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.837102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.837235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.837262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.837361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.837522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.837555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.837732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.837871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.837897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.838032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.838200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.838225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.838387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.838487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.838513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.838627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.838781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.838811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.838945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.839079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.839104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.839256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.839358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.839384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.839518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.839656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.839684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.839858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.840010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.840036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.840167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.840269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.840296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.840429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.840571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.840600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.840719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.840890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.840918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.841068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.841227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.841252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.841439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.841568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.841595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.233 qpair failed and we were unable to recover it. 00:27:25.233 [2024-11-28 11:51:44.841695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.233 [2024-11-28 11:51:44.841853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.841879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.841996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.842124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.842150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.842259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.842362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.842389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.842548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.842705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.842733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.842886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.843014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.843040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.843149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.843339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.843367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.843491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.843629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.843656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.843764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.843890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.843916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.844039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.844188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.844217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.844363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.844497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.844533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.844691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.844846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.844872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.845032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.845171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.845199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.845343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.845481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.845509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.845647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.845807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.845832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.845987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.846099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.846140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.846269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.846402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.846427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.846594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.846728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.846753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.846896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.847049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.847091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.847195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.847352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.847377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.847511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.847632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.847658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.847798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.847897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.847923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.848087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.848273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.848298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.848432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.848567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.848593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.848724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.848852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.848877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.849013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.849174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.849203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.849336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.849440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.849465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.849600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.849754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.849782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.849897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.850034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.850062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.850216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.850343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.850369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.850497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.850662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.850691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.850810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.850930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.850958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.851119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.851277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.851302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.851428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.851581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.851607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.851755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.851936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.851961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.852089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.852227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.852253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.852418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.852544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.852573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.852711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.852885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.852912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.853069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.853170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.853195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.853301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.853459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.853484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.853648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.853788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.853816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.853992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.854127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.854169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.854338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.854470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.854495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.854631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.854778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.854806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.854932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.855043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.855067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.855195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.855360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.855386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.855557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.855755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.855781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.855914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.856074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.856116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.856294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.856433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.856461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.856580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.856696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.856725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.856846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.857002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.857027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.857186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.857376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.857402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.857538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.857715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.857743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.857877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.858006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.858032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.858165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.858287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.858317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.858495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.858614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.858643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.858770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.858901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.858926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.859037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.859178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.859203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.859359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.859537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.859566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.859708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.859841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.859866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.860003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.860185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.860214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.860351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.860491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.860519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.860672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.860832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.860857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.234 qpair failed and we were unable to recover it. 00:27:25.234 [2024-11-28 11:51:44.860986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.234 [2024-11-28 11:51:44.861137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.861166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.861291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.861392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.861417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.861585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.861712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.861755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.861944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.862076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.862102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.862235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.862387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.862415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.862591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.862699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.862724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.862890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.863017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.863047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.863193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.863327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.863355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.863501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.863639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.863665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.863831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.863996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.864024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.864134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.864288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.864313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.864469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.864578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.864604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.864710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.864894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.864922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.865067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.865210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.865238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.865370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.865533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.865559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.865724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.865861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.865889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.866029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.866165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.866193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.866321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.866480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.866505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.866668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.866782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.866825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.866972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.867140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.867168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.867322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.867443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.867469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.867606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.867773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.867801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.867981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.868122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.868150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.868319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.868452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.868479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.868623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.868747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.868776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.868953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.869084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.869109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.869218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.869345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.869371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.869536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.869677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.869703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.869860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.870044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.870070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.870169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.870282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.870307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.870419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.870575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.870605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.870777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.870948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.870976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.871129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.871266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.871292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.871478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.871659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.871688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.871797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.871955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.871980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.872088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.872235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.872260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.872438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.872606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.872636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.872809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.872928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.872956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.873101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.873233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.873259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.873429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.873543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.873570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.873674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.873834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.873859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.873991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.874136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.874161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.874347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.874510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.874541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.874701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.874855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.874883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.875038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.875170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.875195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.875327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.875481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.875509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.875708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.875875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.875903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.876051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.876187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.876212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.876344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.876480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.876505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.876653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.876767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.876792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.876900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.877011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.877036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.877186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.877308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.877336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.877508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.877657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.877687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.877812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.877972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.877998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.878123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.878263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.878292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.878455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.878566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.878592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.878751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.878854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.878879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.879038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.879183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.879212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.879369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.879496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.879521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.879661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.879761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.879792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.879905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.880057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.880085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.880241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.880372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.880397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.880501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.880616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.880643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.880797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.880949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.880974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.881102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.881202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.881227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.881352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.881510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.881558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.881709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.881848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.881876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.235 qpair failed and we were unable to recover it. 00:27:25.235 [2024-11-28 11:51:44.882020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.882163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.235 [2024-11-28 11:51:44.882191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.882370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.882549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.882578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.882741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.882849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.882878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.883026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.883187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.883212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.883321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.883438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.883467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.883621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.883779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.883820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.883933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.884077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.884107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.884289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.884419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.884445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.884550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.884647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.884672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.884801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.884902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.884928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.885094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.885217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.885245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.885361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.885498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.885531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.885674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.885855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.885884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.886020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.886157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.886182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.886346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.886493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.886521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.886680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.886826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.886855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.887001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.887118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.887147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.887301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.887428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.887453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.887599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.887738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.887766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.887949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.888056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.888082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.888180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.888303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.888329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.888476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.888640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.888666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.888760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.888894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.888919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.889119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.889264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.889289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.889436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.889593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.889619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.889748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.889903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.889944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.890070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.890246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.890275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.890446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.890627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.890653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.890787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.890949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.890977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.891131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.891237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.891263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.891423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.891583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.891609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.891740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.891896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.891921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.892020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.892202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.892230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.892426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.892541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.892567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.892697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.892814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.892843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.892993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.893166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.893194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.893308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.893456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.893485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.893672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.893821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.893849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.893965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.894084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.894112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.894281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.894423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.894453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.894611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.894724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.894750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.894887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.895017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.895042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.895203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.895359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.895387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.895561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.895718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.895744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.895910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.896089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.896115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.896272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.896404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.896446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.896554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.896704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.896730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.896828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.896935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.896961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.897151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.897318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.897347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.897530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.897638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.897664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.897827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.897959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.897987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.898132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.898265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.898291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.898420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.898574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.898603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.898767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.898889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.898914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.899069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.899173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.899198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.899355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.899507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.899543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.899765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.899877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.899905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.900060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.900184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.900210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.900365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.900479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.900508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.900671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.900832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.900857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.900977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.901121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.901150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.901298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.901438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.901463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.901623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.901763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.901791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.236 qpair failed and we were unable to recover it. 00:27:25.236 [2024-11-28 11:51:44.901936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.236 [2024-11-28 11:51:44.902079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.902108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.902251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.902423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.902451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.902579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.902681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.902707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.902839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.903021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.903049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.903159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.903279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.903307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.903494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.903641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.903667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.903775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.903875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.903901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.904076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.904224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.904252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.904428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.904572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.904598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.904787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.904931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.904959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.905123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.905257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.905284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.905435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.905650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.905676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.905785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.905974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.906003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.906148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.906266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.906294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.906423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.906530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.906557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.906687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.906794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.906819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.906968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.907137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.907165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.907307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.907424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.907452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.907605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.907735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.907760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.907885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.908025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.908053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.908167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.908315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.908343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.908461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.908610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.908639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.908796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.908959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.908984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.909091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.909196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.909222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.909323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.909476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.909506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.909657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.909842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.909867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.909976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.910112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.910138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.910291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.910434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.910463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.910612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.910752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.910793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.910931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.911050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.911080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.911239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.911397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.911422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.911549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.911694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.911723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.911839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.912012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.912037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.912159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.912297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.912325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.912478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.912580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.912606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.912738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.912885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.912914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.913095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.913230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.913255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.913416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.913537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.913566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.913722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.913834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.913859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.913988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.914113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.914142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.914306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.914457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.914483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.914660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.914768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.914795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.914920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.915052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.915077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.915233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.915380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.915408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.915559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.915719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.915744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.915882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.916012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.916041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.916194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.916329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.916355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.916486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.916648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.916676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.916786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.916899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.916928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.917070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.917184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.917213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.917345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.917510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.917542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.917679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.917805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.917835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.917965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.918129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.918155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.918320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.918456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.918482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.918618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.918726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.918753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.918853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.918971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.919000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.919172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.919341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.919369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.919507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.919633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.919675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.919806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.919935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.919960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.920091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.920205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.920234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.920454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.920601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.920631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.920784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.920917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.920943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.921048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.921183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.921208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.921361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.921535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.921564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.921706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.921822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.921850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.921996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.922136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.922164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.237 [2024-11-28 11:51:44.922321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.922455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.237 [2024-11-28 11:51:44.922482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.237 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.922686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.922819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.922844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.922978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.923135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.923161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.923272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.923390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.923419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.923572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.923710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.923737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.923922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.924045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.924073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.924192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.924363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.924392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.924506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.924657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.924685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.924844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.924977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.925004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.925189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.925302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.925332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.925455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.925571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.925600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.925749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.925970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.925999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.926147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.926279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.926304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.926441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.926623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.926652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.926771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.926913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.926947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.927058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.927178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.927206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.927368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.927478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.927504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.927620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.927730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.927755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.927909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.928078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.928107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.928255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.928371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.928400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.928582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.928726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.928767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.928880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.929041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.929067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.929217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.929360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.929388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.929569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.929704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.929729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.929863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.929971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.930001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.930101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.930221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.930249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.930358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.930470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.930499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.930619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.930731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.930760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.930908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.931017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.931042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.931154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.931285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.931311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.931455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.931585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.931611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.931739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.931858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.931886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.932047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.932154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.932180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.932297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.932441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.932471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.932585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.932759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.932792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.932905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.933046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.933074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.933217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.933321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.933347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.933507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.933683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.933709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.933834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.933962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.933987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.934117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.934284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.934309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.934476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.934611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.934638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.934793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.934908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.934938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.935081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.935194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.935222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.935370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.935490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.935519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.935692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.935824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.935854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.936004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.936133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.936159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.936290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.936392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.936418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.936577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.936766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.936792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.936927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.937056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.937081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.937240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.937397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.937426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.937574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.937684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.937712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.937833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.937948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.937976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.938099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.938198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.938224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.938332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.938439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.938466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.938606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.938708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.938735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.938885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.939003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.939032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.939158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.939272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.939298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.939460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.939587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.939616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.939730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.939901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.939929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.940070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.940197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.940226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.940407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.940517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.940549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.940681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.940865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.940891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.940999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.941161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.941189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.238 [2024-11-28 11:51:44.941311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.941479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.238 [2024-11-28 11:51:44.941507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.238 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.941664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.941789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.941815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.941958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.942110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.942139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.942279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.942455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.942480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.942591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.942749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.942774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.942903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.943038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.943063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.943226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.943366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.943395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.943581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.943680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.943706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.943808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.943971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.943997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.944104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.944259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.944284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.944439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.944581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.944609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.944726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.944865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.944895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.945048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.945194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.945222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.945379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.945514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.945563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.945688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.945826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.945855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.945973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.946123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.946153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.946309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.946430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.946457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.946588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.946689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.946715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.946819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.947012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.947041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.947216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.947386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.947415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.947556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.947670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.947698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.947855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.947989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.948014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.948150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.948297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.948323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.948428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.948535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.948561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.948708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.948825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.948868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.948998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.949135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.949160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.949263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.949390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.949418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.949536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.949683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.949711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.949854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.949993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.950022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.950150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.950289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.950315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.950449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.950589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.950619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.950749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.950930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.950956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.951101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.951225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.951253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.951413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.951536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.951562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.951746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.951853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.951881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.952022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.952163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.952192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.952296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.952409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.952438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.952591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.952706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.952732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.952847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.952957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.952999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.953150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.953305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.953331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.953483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.953622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.953649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.953749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.953882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.953908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.954022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.954153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.954182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.954306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.954454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.954482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.954665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.954774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.954802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.954962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.955094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.955121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.955240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.955348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.955377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.955489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.955680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.955706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.955862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.956046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.956072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.956209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.956341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.956367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.956498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.956626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.956654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.956812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.956913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.956939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.957100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.957239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.957268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.957391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.957521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.957574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.957735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.957861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.957890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.958044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.958150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.958175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.958273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.958377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.958405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.958508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.958645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.958672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.958800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.958972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.959001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.959144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.959301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.959327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.959451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.959607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.959636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.959766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.959892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.959918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.960052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.960201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.960230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.960337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.960497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.960522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.960664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.960790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.960819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.960943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.961057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.961084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.239 qpair failed and we were unable to recover it. 00:27:25.239 [2024-11-28 11:51:44.961195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.961320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.239 [2024-11-28 11:51:44.961349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.961493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.961669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.961699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.961855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.961994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.962019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.962122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.962229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.962254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.962372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.962490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.962518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.962688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.962805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.962830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.962996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.963132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.963158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.963291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.963392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.963418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.963553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.963737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.963763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.963896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.964049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.964077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.964199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.964315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.964357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.964467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.964582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.964608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.964755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.964905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.964931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.965067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.965221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.965263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.965371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.965508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.965549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.965686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.965784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.965809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.965958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.966120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.966145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.966252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.966369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.966398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.966571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.966692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.966720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.966869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.967000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.967025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.967176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.967302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.967330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.967471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.967588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.967617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.967777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.967888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.967915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.968015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.968114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.968140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.968250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.968417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.968446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.968631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.968765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.968790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.968919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.969041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.969083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.969188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.969315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.969340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.969496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.969651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.969680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.969823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.969972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.970002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.970158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.970294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.970319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.970424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.970530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.970564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.970712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.970862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.970890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.971023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.971171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.971200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.971346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.971461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.971489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.971649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.971808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.971852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.972040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.972175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.972201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.972354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.972510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.972542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.972681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.972809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.972837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.973000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.973099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.973125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.973275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.973407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.973433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.973579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.973689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.973718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.973832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.974016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.974041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.974155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.974297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.974323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.974456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.974586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.974616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.974772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.974934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.974960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.975098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.975213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.975246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.975369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.975539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.975566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.975761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.975889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.975915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.976020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.976124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.976165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.976310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.976431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.976475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.976611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.976771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.976814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.976929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.977068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.977097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.977219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.977330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.977358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.977480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.977630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.977660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.977791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.977929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.977955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.978071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.978247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.978277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.978411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.978540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.978582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.978699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.978829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.978858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.978997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.979104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.979131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.979263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.979411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.979436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.979592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.979737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.979766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.979886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.980005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.980033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.240 qpair failed and we were unable to recover it. 00:27:25.240 [2024-11-28 11:51:44.980184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.240 [2024-11-28 11:51:44.980338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.980380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.980556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.980702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.980730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.980887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.981043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.981075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.981240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.981341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.981376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.981510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.981658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.981684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.981788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.981892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.981918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.982039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.982186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.982214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.982369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.982478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.982505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.982652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.982788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.982813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.982918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.983028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.983069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.983180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.983328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.983357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.983494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.983627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.983652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.983785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.983917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.983945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.984072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.984221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.984250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.984409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.984533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.984562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.984694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.984794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.984819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.984960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.985089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.985114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.985233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.985367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.985394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.985556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.985715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.985740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.985869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.986042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.986071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.986201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.986367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.986392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.986545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.986670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.986695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.986843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.986953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.986981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.987099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.987210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.987237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.987374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.987504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.987535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.987667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.987769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.987794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.987957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.988093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.988118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.988227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.988383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.988411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.988565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.988702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.988727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.988853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.988963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.988987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.989139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.989253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.989295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.989427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.989537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.989563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.989675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.989804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.989830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.989997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.990132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.990159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.990305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.990497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.990538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.990695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.990840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.990869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.991000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.991127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.991153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.991295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.991396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.991422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.991523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.991692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.991717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.991845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.991963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.991992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.992119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.992253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.992280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.992455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.992616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.992643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.992783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.992911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.992939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.993094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.993227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.993254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.993365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.993477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.993504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.993617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.993717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.993746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.993907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.994036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.994078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.994242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.994367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.994395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.994554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.994691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.994717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.994876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.995004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.995030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.995133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.995273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.995301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.995445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.995608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.995635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.995748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.995877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.995904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.996034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.996180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.996208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.996364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.996479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.996505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.996626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.996736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.996763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.996881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.996985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.997010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.997118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.997238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.997267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.997418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.997595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.997621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.997731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.997831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.997857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.997962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.998065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.998091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.998234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.998347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.998377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.998489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.998648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.998675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.998781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.998919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.998947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.999072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.999175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.999200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.999313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.999414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.999440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.241 [2024-11-28 11:51:44.999587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.999731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.241 [2024-11-28 11:51:44.999758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.241 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:44.999939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.000094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.000123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.000256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.000365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.000391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.000570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.000697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.000723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.000881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.000979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.001024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.001173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.001313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.001342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.001487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.001594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.001620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.001719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.001880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.001908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.002044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.002197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.002228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.002344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.002494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.002532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.002692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.002802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.002828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.002966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.003125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.003154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.003329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.003469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.003500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.003642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.003768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.003793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.003888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.003993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.004020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.004143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.004300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.004326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.004486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.004671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.004697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.004797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.004964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.004992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.005114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.005274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.005304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.005429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.005593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.005619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.005735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.005860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.005888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.006032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.006158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.006184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.006313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.006445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.006471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.006585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.006716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.006742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.006894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.007067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.007093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.007200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.007331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.007356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.007513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.007660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.007686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.007788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.007902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.007929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.008091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.008214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.008248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.008366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.008511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.008551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.008681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.008788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.008813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.008962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.009107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.009135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.009260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.009374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.009403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.009567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.009710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.009738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.009897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.010002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.010027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.010151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.010246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.010272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.010384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.010487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.010512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.010658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.010779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.010807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.010975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.011104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.011133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.011275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.011423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.011451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.011579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.011713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.011739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.011854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.012031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.012060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.012189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.012294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.012320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.012450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.012603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.012631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.012805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.012921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.012950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.013139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.013308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.013337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.013532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.013640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.013666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.013781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.013878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.013903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.014060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.014183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.014231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.014373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.014538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.014567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.014689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.014859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.014884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.015055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.015188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.015215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.015390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.015552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.015582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.015759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.015878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.015904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.016035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.016138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.016163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.016324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.016469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.016498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.016622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.016757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.016783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.016966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.017134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.017162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.017281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.017379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.017404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.017586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.017741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.017769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.017890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.018011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.018049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.018171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.018313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.018342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.018478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.018643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.018668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.242 qpair failed and we were unable to recover it. 00:27:25.242 [2024-11-28 11:51:45.018806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.018974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.242 [2024-11-28 11:51:45.019001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.019124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.019268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.019296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.019419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.019564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.019594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.019722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.019858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.019883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.020035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.020189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.020213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.020372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.020547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.020576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.020738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.020855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.020880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.021039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.021153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.021178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.021339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.021459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.021486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.021604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.021750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.021777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.021904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.022014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.022041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.022193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.022302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.022328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.022436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.022578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.022607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.022753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.022894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.022921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.023087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.023205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.023247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.023372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.023480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.023505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.023646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.023825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.023854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.023966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.024093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.024118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.024287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.024422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.024448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.024615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.024743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.024769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.024901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.025016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.025046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.025190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.025306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.025348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.025448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.025576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.025603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.025710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.025856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.025881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.026023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.026124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.026149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.026259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.026418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.026442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.026610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.026721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.026750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.026888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.027023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.027048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.027201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.027353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.027382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.027501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.027669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.027694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.027796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.027898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.027924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.028086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.028187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.028212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.028320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.028424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.028468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.028628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.028764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.028789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.028922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.029028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.029053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.029212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.029345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.029389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.029571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.029715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.029744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.029902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.030057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.030083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.030212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.030373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.030401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.030532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.030638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.030664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.030775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.030899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.030924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.031082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.031211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.031240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.031355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.031498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.031532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.031684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.031796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.031822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.031967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.032081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.032109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.032258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.032386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.032414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.032584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x184c600 is same with the state(5) to be set 00:27:25.243 [2024-11-28 11:51:45.032756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.032914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.032943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.033072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.033217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.033261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.033423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.033557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.033584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.033714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.033843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.033869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.034014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.034212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.034255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.034356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.034461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.034487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.034631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.034773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.034801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.034955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.035060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.035085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.035185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.035331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.035356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.035463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.035568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.035595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.035742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.035869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.035895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.036055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.036198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.036223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.036324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.036435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.036461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.036601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.036728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.036754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.036859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.036995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.037022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.037154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.037260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.037287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.037385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.037492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.037518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.037636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.037769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.037795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.037901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.038000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.038025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.038121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.038221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.038249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.243 [2024-11-28 11:51:45.038412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.038520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.243 [2024-11-28 11:51:45.038563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.243 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.038700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.038836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.038861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.038970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.039063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.039088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.039195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.039299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.039326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.039458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.039569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.039596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.039736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.039872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.039898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.040013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.040141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.040166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.040297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.040430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.040456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.040600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.040750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.040776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.040881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.041007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.041032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.041186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.041315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.041341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.041457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.041610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.041654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.041779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.041983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.042026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.042176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.042321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.042347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.042477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.042609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.042654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.042782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.042932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.042958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.043064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.043164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.043191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.043327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.043428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.043455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.043586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.043725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.043751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.043859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.043967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.043992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.044128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.044263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.044290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.044401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.044495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.044520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.044627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.044741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.044766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.044911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.045050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.045076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.045182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.045278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.045304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.045417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.045562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.045589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.045691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.045827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.045851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.045951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.046061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.046086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.046217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.046320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.046346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.046480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.046616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.046643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.046783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.046922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.046947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.047110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.047224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.047252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.047413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.047545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.047572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.047689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.047836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.047864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.047995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.048120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.048148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.048322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.048435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.048463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.048598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.048736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.048761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.048901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.049034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.049076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.049217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.049370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.049411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.049592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.049693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.049721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.049886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.050034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.050062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.050180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.050286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.244 [2024-11-28 11:51:45.050314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.244 qpair failed and we were unable to recover it. 00:27:25.244 [2024-11-28 11:51:45.050447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.050580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.050606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.050724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.050864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.050898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.051044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.051214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.051242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.051394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.051587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.051613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.051746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.051871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.051898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.052047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.052191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.052220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.052330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.052495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.052537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.052665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.052812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.052837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.052942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.053078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.053107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.053229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.053375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.053403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.053575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.053675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.053703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.053862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.054008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.054037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.054166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.054345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.054370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.054501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.054610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.054636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.054783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.054922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.054951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.055090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.055258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.055286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.055439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.055607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.055634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.055765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.055906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.055932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.056082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.056203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.056233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.056448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.056588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.056617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.056718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.056844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.056874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.057077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.057208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.057234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.057367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.057475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.057502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.057654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.057764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.057793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.057913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.058069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.058096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.058230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.058368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.058395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.058536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.058709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.058738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.058889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.059036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.059065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.059222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.059360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.059386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.059549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.059694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.059720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.059853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.059974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.245 [2024-11-28 11:51:45.060017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.245 qpair failed and we were unable to recover it. 00:27:25.245 [2024-11-28 11:51:45.060127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.060269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.060296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.060422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.060587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.060613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.060723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.060841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.060870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.060998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.061131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.061157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.061310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.061455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.061484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.061638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.061750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.061779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.061896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.062010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.062035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.062162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.062316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.062345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.062462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.062627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.062655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.062764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.062891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.062919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.063039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.063170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.063212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.063371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.063495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.063521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.063664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.063769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.063794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.063920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.064040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.064070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.064213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.064367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.064393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.064530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.064637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.064664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.064803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.064954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.064983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.065187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.065285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.065315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.065456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.065614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.065640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.065798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.065961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.065998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.066151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.066299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.066327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.066539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.066677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.066702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.066884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.067017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.067043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.067199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.067365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.067390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.067518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.067647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.067673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.067800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.067949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.067977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.068157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.068315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.068343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.068552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.068713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.068738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.068875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.069027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.069055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.069164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.069279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.069308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.069498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.069625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.069652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.069789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.069905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.069930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.070057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.070207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.070235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.246 qpair failed and we were unable to recover it. 00:27:25.246 [2024-11-28 11:51:45.070349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.246 [2024-11-28 11:51:45.070465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.070493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.070625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.070724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.070749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.070863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.071014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.071042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.071174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.071307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.071332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.071463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.071574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.071600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.071773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.071906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.071935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.072065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.072226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.072251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.072375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.072516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.072550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.072727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.072844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.072872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.073037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.073191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.073222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.073371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.073480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.073509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.073659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.073793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.073836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.073993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.074137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.074163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.074295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.074421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.074446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.074559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.074702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.074728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.074867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.075021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.075046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.075205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.075318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.075347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.075496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.075642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.075667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.075767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.075905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.075930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.076111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.076253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.076281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.076397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.076582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.076620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.076733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.076833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.076859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.076984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.077114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.077140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.077256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.077367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.077393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.077496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.077598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.077624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.077781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.077910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.077939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.078056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.078184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.078210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.078343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.078447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.078473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.078582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.078713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.078739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.247 qpair failed and we were unable to recover it. 00:27:25.247 [2024-11-28 11:51:45.078848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.078971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.247 [2024-11-28 11:51:45.078997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.079100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.079209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.079237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.079394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.079609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.079635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.079746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.079906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.079932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.080045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.080173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.080199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.080336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.080471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.080497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.080638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.080760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.080790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.080966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.081065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.081091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.081199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.081300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.081326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.081466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.081636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.081662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.081766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.081887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.081913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.082071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.082228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.082253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.082383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.082562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.082604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.082739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.082873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.082899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.083072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.083206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.083231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.083365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.083492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.083521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.083657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.083791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.083816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.083934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.084100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.084125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.084259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.084381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.084411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.084596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.084701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.084726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.084866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.085011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.085038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.085190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.085300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.085342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.085444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.085569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.085595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.085704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.085824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.085849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.085996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.086139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.086166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.086298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.086429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.086456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.086594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.086693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.086725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.086854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.086974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.087004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.087132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.087265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.087291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.087453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.087645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.087671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.087783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.087949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.087974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.088136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.088243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.088270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.088433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.088561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.088605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.088712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.088817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.088863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.089046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.089148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.089173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.089356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.089473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.089501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.089673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.089774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.089806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.089984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.090120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.090161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.090341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.090475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.090501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.090677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.090779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.090803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.090929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.091066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.091092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.091220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.091374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.091401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-28 11:51:45.091602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.091736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.248 [2024-11-28 11:51:45.091762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.091897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.092003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.092029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.092147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.092307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.092333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.092462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.092580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.092606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.092746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.092856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.092886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.093015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.093171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.093213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.093316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.093499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.093534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.093656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.093760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.093785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.093923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.094043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.094068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.094204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.094338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.094366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.094499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.094612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.094638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.094772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.094935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.094963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.095104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.095246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.095275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.095423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.095538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.095565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.095694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.095794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.095825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.095927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.096038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.096076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.096185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.096285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.096311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.096419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.096558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.096584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.096690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.096794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.096840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.096996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.097125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.097151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.097292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.097422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.097447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.097603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.097747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.097773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.097915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.098051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.098093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.098238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.098357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.098387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.098502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.098656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.098682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.098794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.098948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.098974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.099120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.099271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.099296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.099419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.099555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.099582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.099739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.099841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.099866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.099999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.100110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.100138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.100246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.100368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.100395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.100518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.100633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.100658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.100789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.100940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.100968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.101107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.101258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.101286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.101436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.101574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.101600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.101771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.101959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.101984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.102092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.102248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.102273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.102406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.102509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.102552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.102679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.102803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.102831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.102939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.103046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.103074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.103209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.103307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.103333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.103439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.103586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.103612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.103713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.103847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.103872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-28 11:51:45.104031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.249 [2024-11-28 11:51:45.104139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.104164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.104274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.104417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.104444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.104621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.104738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.104767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.104920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.105027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.105052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.105192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.105374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.105403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.105545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.105689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.105718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.105848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.105978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.106003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.106155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.106273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.106316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.106419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.106559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.106586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.106696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.106814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.106839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.106984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.107141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.107166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.107295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.107445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.107473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.107615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.107744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.107770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.107921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.108079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.108105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.108212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.108319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.108345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.108481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.108646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.108672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.108799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.108912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.108941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.109082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.109215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.109239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.109350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.109505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.109584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.109756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.109927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.109952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.110112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.110228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.110255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.110411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.110515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.110548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.110714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.110915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.110964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.111084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.111202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.111227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.111331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.111464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.111489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.111634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.111761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.111786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.111922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.112044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.112072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.112213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.112370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.112395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.112531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.112677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.112705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.112897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.113037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.113063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.113172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.113275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.113300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.113431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.113559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.113589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.113708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.113855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.113883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.114007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.114145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.114170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.114344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.114480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.114508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.114704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.114815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.114843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.114971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.115083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.115109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.115262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.115409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.115437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.115565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.115684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.115713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.115903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.116037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.116078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.116202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.116389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.116414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-28 11:51:45.116557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.116656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.250 [2024-11-28 11:51:45.116681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.116822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.116952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.116978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.117105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.117250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.117292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.117405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.117564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.117594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.117728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.117829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.117856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.118014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.118195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.118223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.118333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.118485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.118513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.118649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.118754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.118779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.118882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.118994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.119019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.119124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.119258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.119283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.119425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.119539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.119567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.119733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.119895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.119927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.120052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.120198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.120225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.120340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.120473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.120498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.120611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.120746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.120773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.120922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.121084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.121110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.121204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.121360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.121386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.121537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.121690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.121716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.121877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.122035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.122063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.122186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.122316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.122341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.122489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.122626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.122652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.122764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.122912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.122941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.123074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.123175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.123202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.123329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.123495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.123522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.123647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.123774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.123799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.123963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.124063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.124088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.124218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.124338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.124367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.124474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.124615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.124641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.124778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.124949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.124974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.125175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.125283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.125307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.125455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.125601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.125627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.125736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.125927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.125962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.126081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.126227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.126256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.126378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.126519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.126553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.126677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.126806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.126842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.126969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.127153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.127178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.127290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.127415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.127458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.127631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.127763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.127787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.127885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.128016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.128064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.128213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.128370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.128395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.128558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.128662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.128688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.251 qpair failed and we were unable to recover it. 00:27:25.251 [2024-11-28 11:51:45.128820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.251 [2024-11-28 11:51:45.128984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.129013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.129175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.129315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.129341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.129452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.129595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.129621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.129752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.129893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.129920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.130032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.130141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.130169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.130292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.130395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.130420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.130572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.130691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.130716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.130895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.131040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.131069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.131203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.131362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.131386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.131486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.131623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.131649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.131752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.131884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.131913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.132082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.132210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.132235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.132385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.132488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.132514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.132634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.132746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.132772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.132945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.133073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.133116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.133226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.133367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.133394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.133508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.133643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.133668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.133827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.133986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.134013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.134173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.134312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.134341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.134451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.134614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.134640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.134741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.134860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.134885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.135001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.135132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.135157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.135264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.135382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.135410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.135564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.135676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.135701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.135801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.135934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.135959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.136075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.136234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.136260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.136369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.136475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.136500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.136643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.136776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.136802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.136910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.137060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.137088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.137213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.137341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.137366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.137499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.137632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.137658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.137767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.137909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.137935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.138038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.138148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.138173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.138298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.138470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.138495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.138663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.138771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.138797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.138918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.139072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.139098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.139267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.139395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.139420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.139520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.139708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.139736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.139873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.139975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.140001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.140132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.140262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.140286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.140411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.140572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.140600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.140741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.140875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.140904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.141060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.141204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.252 [2024-11-28 11:51:45.141232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.252 qpair failed and we were unable to recover it. 00:27:25.252 [2024-11-28 11:51:45.141404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.141546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.141575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.141706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.141873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.141898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.142035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.142187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.142213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.142349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.142504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.142537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.142665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.142761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.142786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.142900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.143053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.143078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.143235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.143375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.143403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.143593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.143731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.143773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.143889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.144004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.144038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.144192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.144322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.144348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.144451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.144551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.144577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.144673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.144799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.144827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.144959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.145083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.145111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.145233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.145339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.145363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.145486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.145640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.145668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.145811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.145965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.145990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.146145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.146245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.146270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.146418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.146577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.146606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.146713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.146840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.146866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.147007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.147136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.147161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.147297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.147412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.147441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.147606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.147744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.147770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.147898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.148007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.148033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.148131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.148260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.148303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.148426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.148580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.148610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.148742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.148851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.148877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.149017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.149162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.149190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.149299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.149406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.149448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.149618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.149724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.149749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.149860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.149980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.150007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.150148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.150322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.150347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.150479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.150583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.150609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.150716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.150823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.150848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.150983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.151163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.151191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.151314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.151470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.151495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.151658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.151755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.151780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.151928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.152077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.152105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.152261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.152389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.152429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.152582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.152740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.152765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.152871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.152981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.153007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.153141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.153279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.153304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.153406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.153520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.153568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.153725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.153885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.153911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.253 qpair failed and we were unable to recover it. 00:27:25.253 [2024-11-28 11:51:45.154052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.253 [2024-11-28 11:51:45.154178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.154203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.154365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.154537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.154566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.154685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.154832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.154860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.154995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.155152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.155177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.155287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.155400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.155425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.155554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.155676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.155705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.155833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.155959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.155985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.156090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.156199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.156224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.156326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.156423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.156448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.156554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.156661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.156686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.156834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.156943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.156970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.157108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.157245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.157273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.157408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.157515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.157546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.157681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.157846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.157873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.158016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.158158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.158186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.158317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.158456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.158481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.158591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.158728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.158758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.158891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.159045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.159070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.159202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.159332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.159357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.159516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.159704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.159730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.159887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.160001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.160029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.160178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.160287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.160312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.160474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.160629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.160657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.160803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.160948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.160976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.161125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.161263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.161287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.161408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.161520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.161554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.161670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.161850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.161876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.162013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.162107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.162132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.162266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.162416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.162444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.162601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.162705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.162730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.162833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.162929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.162954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.163106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.163279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.163304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.163434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.163534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.163559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.163691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.163824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.163848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.164042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.164150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.164175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.164288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.164385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.164410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.164562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.164691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.164716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.164841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.164997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.165022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.165121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.165219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.165244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.165374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.165508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.254 [2024-11-28 11:51:45.165538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.254 qpair failed and we were unable to recover it. 00:27:25.254 [2024-11-28 11:51:45.165687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.165800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.165827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.165976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.166079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.166105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.166231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.166361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.166386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.166522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.166703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.166732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.166911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.167048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.167077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.167194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.167302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.167327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.167453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.167573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.167601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.167765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.167898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.167923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.168029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.168186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.168211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.168349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.168518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.168554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.168674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.168786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.168814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.168950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.169060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.169086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.169223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.169366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.169394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.169509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.169658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.169687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.169805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.169943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.169968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.170104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.170232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.170259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.170395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.170493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.170518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.170628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.170765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.170791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.170937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.171116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.171144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.171268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.171382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.171424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.171598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.171711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.171752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.171905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.172021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.172045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.172198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.172344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.172371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.172537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.172675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.172701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.172808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.172934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.172959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.173119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.173266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.173294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.173444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.173557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.173583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.173708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.173861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.173893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.174006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.174174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.174200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.174329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.174437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.174461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.174592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.174715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.174744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.174909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.175040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.175065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.175177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.175309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.175334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.175467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.175582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.175611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.175759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.175911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.175939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.176095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.176232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.176259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.176391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.176555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.176585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.176701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.176872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.176900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.177028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.177128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.177152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.177259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.177358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.177383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.177536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.177657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.177685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.177840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.177974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.177999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.178100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.178229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.178255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.255 qpair failed and we were unable to recover it. 00:27:25.255 [2024-11-28 11:51:45.178362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.255 [2024-11-28 11:51:45.178512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.178546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.178698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.178829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.178854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.179025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.179129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.179157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.179327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.179493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.179521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.179682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.179781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.179806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.179919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.180023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.180048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.180148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.180296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.180324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.180475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.180591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.180617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.180731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.180836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.180861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.180967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.181092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.181120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.181272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.181406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.181433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.181568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.181692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.181721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.181839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.182007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.182036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.182186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.182294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.182319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.182422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.182529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.182555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.182726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.182848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.182876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.183030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.183163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.183189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.183322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.183464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.183491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.183632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.183764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.183791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.183926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.184053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.184078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.184260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.184369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.184393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.184495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.184600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.184626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.184773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.184908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.184934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.185102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.185233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.185258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.185385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.185492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.185542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.185653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.185788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.185814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.185957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.186073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.186101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.186222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.186395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.186422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.186584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.186727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.186752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.186911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.187050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.187077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.187220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.187353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.187382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.187536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.187669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.187694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.187797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.187944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.187972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.188091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.188211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.188240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.188389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.188495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.188520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.188700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.188806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.188836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.188966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.189067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.189094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.189255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.189358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.189383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.189574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.189679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.189704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.189830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.190000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.190028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.190149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.190264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.190289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.190433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.190545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.190571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.190675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.190805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.256 [2024-11-28 11:51:45.190831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.256 qpair failed and we were unable to recover it. 00:27:25.256 [2024-11-28 11:51:45.190963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.191096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.191121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.191252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.191430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.191455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.191568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.191673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.191698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.191810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.191911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.191936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.192060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.192216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.192241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.192405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.192535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.192564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.192692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.192792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.192816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.192949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.193074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.193101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.193271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.193385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.193413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.193547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.193703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.193728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.193855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.193978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.194004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.194160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.194284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.194327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.194459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.194556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.194582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.194747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.194902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.194930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.195076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.195193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.195221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.195345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.195443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.195468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.195593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.195738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.195765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.195879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.196023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.196051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.196175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.196330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.196355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.196504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.196676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.196702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.196810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.196931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.196959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.197081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.197184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.197209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.197344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.197449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.197474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.197614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.197718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.197744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.197879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.197983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.198008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.198114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.198234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.198264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.198406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.198548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.198577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.198736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.198869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.198894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.199025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.199134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.199159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.199286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.199415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.199440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.199569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.199674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.199699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.199827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.199952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.199977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.200109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.200226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.200254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.200430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.200572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.200598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.200725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.200880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.200908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.201073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.201172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.201197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.201325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.201458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.201482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.201615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.201747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.201771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.257 qpair failed and we were unable to recover it. 00:27:25.257 [2024-11-28 11:51:45.201927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.202037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.257 [2024-11-28 11:51:45.202065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.202248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.202349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.202373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.202500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.202658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.202688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.202824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.202934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.202977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.203113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.203275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.203318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.203461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.203588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.203622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.203767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.203952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.203977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.204074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.204206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.204231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.204404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.204551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.204580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.204728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.204836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.204878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.204986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.205113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.205138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.205243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.205376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.205404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.205530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.205697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.205725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.205844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.205973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.205998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.206149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.206291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.206319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.206433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.206614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.206646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.207804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.207985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.208014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.208167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.208276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.208302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.208411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.208542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.208569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.208677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.208797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.208832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.208983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.209121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.209149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.209295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.209413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.209441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.209576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.209710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.209735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.209897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.210057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.210082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.210262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.210429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.210457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.210595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.210703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.210728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.210872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.211024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.211049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.211187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.211342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.211367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.211471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.211603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.211628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.211732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.211863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.211888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.212045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.212157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.212185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.212345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.212472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.212497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.212638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.212745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.212770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.212906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.213083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.213109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.213247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.213379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.213405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.213533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.213649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.213681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.213830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.213967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.213995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.214151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.214250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.214275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.214407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.214560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.214588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.214732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.214878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.214906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.215060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.215195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.215220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.215382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.215536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.215562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.215723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.215846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.215875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.258 [2024-11-28 11:51:45.216030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.216162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.258 [2024-11-28 11:51:45.216188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.258 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.216291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.216412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.216437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.216580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.216717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.216746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.216882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.217021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.217046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.217180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.217349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.217374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.217554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.217688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.217714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.217846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.217982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.218007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.218144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.218654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.218687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.218813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.218956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.218993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.219130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.219243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.219268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.219419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.219576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.219604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.219725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.219854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.219882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.220015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.220184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.220212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.220360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.220480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.220509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.220638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.220761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.220789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.220983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.221117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.221144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.221278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.221391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.221415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.221549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.221706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.221731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.221842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.221971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.221996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.222152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.222284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.222327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.222470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.222598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.222624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.222782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.222917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.222959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.223117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.223224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.223249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.223375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.223531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.223565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.223692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.223832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.223857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.223955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.224095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.224120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.224288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.224397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.224424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.224565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.224720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.224745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.224918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.225052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.225077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.225175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.225281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.225307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.225404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.225535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.225562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.225700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.225834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.225874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.226030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.226163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.226188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.226292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.226421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.226447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.226560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.226696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.226721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.226879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.226986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.227027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.227156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.227311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.227340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.227497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.227610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.227635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.227769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.227945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.227973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.228150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.228248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.228273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.228405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.228548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.228574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.228727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.228873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.228901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.229014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.229157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.229182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.229352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.229450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.259 [2024-11-28 11:51:45.229475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.259 qpair failed and we were unable to recover it. 00:27:25.259 [2024-11-28 11:51:45.229670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.229803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.229829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.229956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.230073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.230103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.230256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.230389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.230414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.230573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.230702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.230727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.230839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.230940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.230981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.231102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.231232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.231256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.231357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.231490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.231515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.231655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.231758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.231784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.231966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.232090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.232116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.232321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.232488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.232545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.232717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.232870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.232899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.233122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.233287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.233313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.233539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.233647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.233674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.233808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.233924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.233949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.234084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.234219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.234245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.234360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.234541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.234568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.234681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.234816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.234849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.235063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.235219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.235244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.235381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.235493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.235519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.235665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.235771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.235797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.235932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.236069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.236095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.236230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.236385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.236411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.236532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.236671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.236698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.236826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.236984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.237010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.237122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.237255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.237281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.237434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.237573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.260 [2024-11-28 11:51:45.237599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.260 qpair failed and we were unable to recover it. 00:27:25.260 [2024-11-28 11:51:45.237706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.237917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.237943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.538 qpair failed and we were unable to recover it. 00:27:25.538 [2024-11-28 11:51:45.238102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.238234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.238260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.538 qpair failed and we were unable to recover it. 00:27:25.538 [2024-11-28 11:51:45.238400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.238508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.238543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.538 qpair failed and we were unable to recover it. 00:27:25.538 [2024-11-28 11:51:45.238651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.238755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.238782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.538 qpair failed and we were unable to recover it. 00:27:25.538 [2024-11-28 11:51:45.238903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.239065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.239091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.538 qpair failed and we were unable to recover it. 00:27:25.538 [2024-11-28 11:51:45.239197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.239326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.239353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.538 qpair failed and we were unable to recover it. 00:27:25.538 [2024-11-28 11:51:45.239459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.239566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.239592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.538 qpair failed and we were unable to recover it. 00:27:25.538 [2024-11-28 11:51:45.239692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.239797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.239824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.538 qpair failed and we were unable to recover it. 00:27:25.538 [2024-11-28 11:51:45.239943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.240074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.240102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.538 qpair failed and we were unable to recover it. 00:27:25.538 [2024-11-28 11:51:45.240234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.240350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.240375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.538 qpair failed and we were unable to recover it. 00:27:25.538 [2024-11-28 11:51:45.240483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.538 [2024-11-28 11:51:45.240595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.240623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.240755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.240867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.240893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.240992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.241131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.241156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.241265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.241402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.241428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.241531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.241664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.241690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.241820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.241951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.241977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.242077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.242286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.242312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.242439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.242558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.242584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.242701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.242810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.242836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.242979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.243107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.243133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.243236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.243348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.243374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.243508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.243620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.243646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.243754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.243863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.243888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.244030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.244131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.244157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.244317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.244444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.244470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.244612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.244740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.244765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.244900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.245068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.245093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.245228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.245384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.245409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.245541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.245676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.245702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.245922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.246131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.246156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.246297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.246429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.246454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.246590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.246698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.246723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.246828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.246938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.246964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.247067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.247202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.247232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.247365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.247470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.247500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.247680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.247815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.247847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.248045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.248148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.248174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.248321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.248427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.248453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.539 qpair failed and we were unable to recover it. 00:27:25.539 [2024-11-28 11:51:45.248567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.539 [2024-11-28 11:51:45.248666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.248691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.248819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.248947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.248971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.249097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.249296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.249323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.249423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.249554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.249580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.249728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.249872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.249907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.250117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.250252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.250292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.250421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.250588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.250620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.250753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.250880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.250906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.251042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.251143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.251178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.251348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.251494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.251520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.251642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.251778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.251804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.251941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.252047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.252073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.252182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.252316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.252342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.252552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.252687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.252713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.252881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.252986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.253012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.253181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.253348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.253374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.253587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.253689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.253733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.253852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.254045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.254071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.254235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.254372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.254398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.254542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.254658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.254684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.254815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.254952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.254977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.255160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.255319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.255345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.255556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.255663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.255688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.255830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.255946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.255972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.256101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.256209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.256234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.256341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.256474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.256501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.256634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.256746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.256776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.256874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.257005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.257043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.257149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.257284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.257310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.540 qpair failed and we were unable to recover it. 00:27:25.540 [2024-11-28 11:51:45.257442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.540 [2024-11-28 11:51:45.257610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.257637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.257743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.257842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.257869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.257981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.258118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.258143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.258287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.258417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.258444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.258561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.258667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.258693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.258827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.258956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.258982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.259128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.259262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.259288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.259386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.259487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.259513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.259620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.259754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.259780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.259882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.260010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.260036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.260174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.260330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.260356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.260569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.260705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.260731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.260828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.260932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.260957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.261068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.261226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.261251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.261383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.261489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.261515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.261655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.261792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.261825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.261958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.262090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.262116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.262250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.262354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.262380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.262596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.262733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.262760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.262922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.263027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.263053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.263186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.263295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.263321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.263457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.263628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.263655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.263761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.263895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.263922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.264081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.264179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.264204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.264321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.264454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.264481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.264618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.264723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.264749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.264880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.265019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.265052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.265160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.265292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.265319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.265536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.265669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.541 [2024-11-28 11:51:45.265694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.541 qpair failed and we were unable to recover it. 00:27:25.541 [2024-11-28 11:51:45.265838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.266006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.266032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.266172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.266327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.266353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.266482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.266635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.266663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.266793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.266932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.266958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.267092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.267230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.267255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.267420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.267585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.267612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.267744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.267954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.267980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.268148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.268248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.268274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.268406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.268507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.268538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.268642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.268759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.268786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.268898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.269029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.269055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.269166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.269275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.269301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.269402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.269552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.269578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.269714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.269854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.269879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.270039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.270183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.270208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.270355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.270488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.270514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.270731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.270864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.270891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.271102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.271209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.271235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.271370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.271536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.271563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.271725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.271868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.271895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.272040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.272172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.272198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.272358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.272458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.272483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.272665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.272799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.272824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.272935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.273045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.273071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.273212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.273428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.273454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.273595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.273723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.273749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.273891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.274051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.274077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.274206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.274338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.274363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.542 [2024-11-28 11:51:45.274507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.274658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.542 [2024-11-28 11:51:45.274685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.542 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.274791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.274926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.274953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.275166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.275296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.275322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.275459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.275574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.275600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.275714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.275852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.275877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.276009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.276111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.276136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.276273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.276431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.276457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.276572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.276705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.276730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.276857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.277028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.277054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.277186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.277410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.277436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.277566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.277696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.277723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.277839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.277997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.278025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.278165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.278293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.278319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.278450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.278563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.278591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.278701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.278797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.278832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.278938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.279068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.279094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.279227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.279333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.279360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.279550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.279710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.279735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.279876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.280009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.280037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.280191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.280310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.280335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.280467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.280580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.280606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.280716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.280873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.280904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.281083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.281257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.281285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.281445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.281566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.281591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.281722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.281902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.281929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.543 qpair failed and we were unable to recover it. 00:27:25.543 [2024-11-28 11:51:45.282090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.543 [2024-11-28 11:51:45.282208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.282234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.282344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.282537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.282577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.282702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.282820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.282849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.283003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.283143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.283167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.283296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.283479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.283504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.283661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.283773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.283801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.283957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.284120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.284145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.284304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.284459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.284484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.284612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.284721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.284747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.284878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.285038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.285078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.285276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.285425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.285450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.285619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.285748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.285773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.285922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.286078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.286103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.286276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.286441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.286470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.286633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.286739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.286764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.286870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.287002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.287026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.287183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.287301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.287334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.287475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.287638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.287664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.287769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.287908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.287934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.288068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.288200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.288225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.288350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.288470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.288498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.288640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.288750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.288776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.288874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.289026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.289053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.289230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.289387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.289418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.289579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.289685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.289710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.289825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.289946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.289986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.290102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.290248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.290281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.290429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.290574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.290600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.290731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.290863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.290888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.544 qpair failed and we were unable to recover it. 00:27:25.544 [2024-11-28 11:51:45.290992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.544 [2024-11-28 11:51:45.291127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.291152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.291276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.291380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.291404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.291540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.291646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.291671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.291767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.291924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.291952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.292095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.292219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.292244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.292411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.292544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.292569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.292678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.292782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.292807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.292942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.293083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.293108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.293278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.293387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.293415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.293571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.293700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.293725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.293861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.293991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.294016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.294177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.294284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.294327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.294491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.294630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.294655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.294789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.294975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.295003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.295152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.295300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.295328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.295461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.295600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.295626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.295756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.295883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.295908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.296166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.296304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.296332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.296504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.296664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.296689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.296787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.296916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.296942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.297070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.297239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.297267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.297383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.297497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.297531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.297687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.297778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.297803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.297992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.298115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.298140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.298276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.298439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.298464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.298593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.298747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.298773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.298934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.299100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.299128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.299270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.299382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.299411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.299535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.299669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.299695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.545 qpair failed and we were unable to recover it. 00:27:25.545 [2024-11-28 11:51:45.299790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.545 [2024-11-28 11:51:45.299952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.299979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.300149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.300292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.300320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.300476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.300621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.300656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.300782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.300910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.300938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.301079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.301222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.301247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.301428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.301534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.301559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.301664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.301762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.301787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.301943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.302098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.302122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.302261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.302358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.302384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.302513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.302693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.302719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.302867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.303024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.303049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.303183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.303338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.303381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.303538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.303690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.303715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.303852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.304013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.304041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.304176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.304308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.304333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.304459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.304603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.304629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.304734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.304885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.304912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.305063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.305218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.305243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.305434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.305577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.305605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.305738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.305846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.305876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.305991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.306151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.306176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.306327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.306484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.306509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.306669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.306826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.306854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.307000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.307135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.307168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.307322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.307491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.307518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.307674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.307829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.307856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.308012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.308146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.308173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.308336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.308495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.308531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.308697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.308827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.546 [2024-11-28 11:51:45.308852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.546 qpair failed and we were unable to recover it. 00:27:25.546 [2024-11-28 11:51:45.308977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.309109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.309134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.309310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.309423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.309448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.309603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.309732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.309757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.309890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.310020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.310045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.310204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.310359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.310388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.310559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.310703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.310731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.310877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.311016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.311041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.311174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.311322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.311350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.311535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.311678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.311703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.311869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.311976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.312001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.312110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.312278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.312305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.312452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.312573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.312603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.312732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.312893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.312919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.313085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.313215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.313240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.313338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.313545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.313571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.313706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.313863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.313905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.314079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.314226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.314254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.314410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.314584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.314609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.314776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.314943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.314968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.315141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.315249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.315273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.315383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.315514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.315543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.315688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.315834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.315875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.316052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.316188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.316215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.316362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.316503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.316544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.316697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.316842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.316870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.317001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.317192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.547 [2024-11-28 11:51:45.317219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.547 qpair failed and we were unable to recover it. 00:27:25.547 [2024-11-28 11:51:45.317345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.317479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.317546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.317675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.317792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.317819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.317928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.318031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.318056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.318175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.318317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.318344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.318502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.318617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.318643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.318744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.318913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.318941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.319093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.319251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.319276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.319381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.319511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.319549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.319691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.319837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.319864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.320037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.320156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.320184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.320340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.320472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.320497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.320631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.320746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.320786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.320951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.321131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.321169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.321324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.321445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.321470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.321633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.321784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.321809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.321991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.322131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.322168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.322324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.322483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.322508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.322636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.322784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.322812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.322954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.323089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.323117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.323273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.323430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.323472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.323605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.323758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.323783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.323922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.324079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.324106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.324265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.324370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.324395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.324549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.324689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.324717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.324860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.325007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.325035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.325215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.325349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.325391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.325508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.325651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.325679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.325848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.325994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.326021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.548 [2024-11-28 11:51:45.326166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.326272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.548 [2024-11-28 11:51:45.326297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.548 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.326446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.326589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.326619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.326761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.326908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.326936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.327062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.327197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.327223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.327347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.327488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.327516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.327686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.327814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.327839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.327998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.328123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.328163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.328307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.328454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.328481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.328648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.328806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.328847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.329002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.329158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.329183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.329332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.329474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.329502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.329641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.329772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.329799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.329993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.330094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.330119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.330252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.330426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.330454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.330587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.330767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.330793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.330899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.331007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.331032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.331138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.331281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.331309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.331481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.331604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.331632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.331770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.331911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.331936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.332086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.332206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.332234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.332413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.332522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.332553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.332681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.332837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.332878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.333054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.333221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.333248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.333361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.333487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.333512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.333678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.333812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.333856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.334004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.334156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.334181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.334332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.334466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.334494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.334642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.334780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.334805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.334913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.335069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.335096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.549 [2024-11-28 11:51:45.335265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.335445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.549 [2024-11-28 11:51:45.335469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.549 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.335581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.335713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.335738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.335879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.335993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.336020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.336137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.336314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.336342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.336496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.336660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.336701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.336821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.336960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.336988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.337137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.337247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.337275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.337402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.337537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.337563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.337709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.337857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.337884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.338027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.338137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.338169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.338328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.338432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.338458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.338594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.338731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.338756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.338941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.339088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.339116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.339296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.339434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.339458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.339619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.339749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.339777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.339887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.340082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.340107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.340241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.340352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.340378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.340510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.340685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.340710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.340881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.341044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.341071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.341222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.341356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.341403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.341577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.341723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.341750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.341891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.342006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.342048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.342156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.342314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.342339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.342503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.342695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.342723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.342873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.342996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.343024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.343177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.343316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.343341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.343445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.343605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.343630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.343757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.343895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.343920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.344019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.344184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.344209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.550 qpair failed and we were unable to recover it. 00:27:25.550 [2024-11-28 11:51:45.344362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.550 [2024-11-28 11:51:45.344496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.344529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.344653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.344793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.344821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.344971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.345101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.345125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.345260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.345408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.345435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.345613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.345745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.345770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.345884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.346014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.346040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.346194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.346333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.346362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.346500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.346650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.346678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.346802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.346937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.346962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.347105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.347249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.347277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.347447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.347618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.347646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.347779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.347910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.347936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.348068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.348189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.348216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.348357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.348535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.348561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.348687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.348819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.348844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.349006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.349161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.349186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.349318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.349450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.349478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.349661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.349795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.349820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.349993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.350111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.350139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.350275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.350391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.350418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.350601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.350731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.350772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.350913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.351058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.351087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.351234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.351403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.351430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.351611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.351786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.351813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.351956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.352070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.352097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.352263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.352407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.352435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.352612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.352759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.352787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.352902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.353010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.353050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.353151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.353249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.353274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.551 qpair failed and we were unable to recover it. 00:27:25.551 [2024-11-28 11:51:45.353470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.551 [2024-11-28 11:51:45.353570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.353595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.353733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.353900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.353927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.354064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.354181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.354209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.354358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.354492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.354517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.354654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.354844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.354869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.354999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.355128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.355153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.355261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.355399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.355424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.355533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.355669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.355693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.355825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.355982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.356008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.356146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.356282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.356307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.356441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.356562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.356590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.356732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.356893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.356917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.357049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.357179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.357209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.357408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.357535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.357561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.357694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.357795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.357820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.357952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.358074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.358099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.358268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.358422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.358447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.358625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.358754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.358779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.358888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.359008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.359033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.359177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.359347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.359375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.359558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.359702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.359742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.359850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.359976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.360000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.360169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.360298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.360323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.360429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.360573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.360599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.360706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.360816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.360840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.360998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.361139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.552 [2024-11-28 11:51:45.361167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.552 qpair failed and we were unable to recover it. 00:27:25.552 [2024-11-28 11:51:45.361286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.361403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.361444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.361580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.361708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.361734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.361896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.362033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.362060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.362173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.362277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.362305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.362450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.362583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.362608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.362712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.362835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.362859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.363005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.363161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.363187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.363294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.363452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.363477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.363658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.363844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.363869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.363962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.364060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.364086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.364247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.364349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.364374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.364546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.364679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.364705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.364817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.364940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.364970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.365130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.365237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.365262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.365393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.365520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.365552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.365683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.365811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.365836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.365940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.366107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.366131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.366256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.366404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.366431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.366575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.366737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.366762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.366900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.367029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.367054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.367174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.367342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.367369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.367540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.367658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.367686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.367876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.367981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.368006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.368164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.368323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.368348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.368507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.368655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.368680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.368851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.368958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.368998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.369183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.369289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.369314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.369446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.369600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.369628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.369751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.369892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.553 [2024-11-28 11:51:45.369917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.553 qpair failed and we were unable to recover it. 00:27:25.553 [2024-11-28 11:51:45.370042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.370190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.370218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.370333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.370473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.370501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.370667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.370798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.370824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.370974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.371106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.371130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.371238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.371420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.371447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.371578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.371703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.371729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.371883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.371995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.372023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.372185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.372291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.372316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.372429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.372562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.372592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.372756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.372883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.372923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.373030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.373130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.373154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.373312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.373422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.373447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.373577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.373686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.373710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.373888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.374003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.374030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.374207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.374343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.374368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.374566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.374688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.374717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.374865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.374976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.375004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.375155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.375312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.375354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.375506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.375685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.375714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.375884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.375990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.376015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.376151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.376282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.376307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.376427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.376572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.376602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.376750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.376857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.376885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.377070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.377243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.377271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.377417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.377589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.377617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.377763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.377908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.377936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.378117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.378274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.378317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.378471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.378618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.378644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.554 [2024-11-28 11:51:45.378742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.378875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.554 [2024-11-28 11:51:45.378900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.554 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.379039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.379146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.379170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.379337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.379468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.379492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.379631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.379735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.379760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.379895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.380023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.380048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.380179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.380358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.380386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.380504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.380692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.380717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.380850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.380981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.381005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.381188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.381327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.381353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.381498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.381641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.381667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.381777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.381916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.381941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.382143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.382276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.382300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.382421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.382602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.382627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.382783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.382910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.382953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.383123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.383263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.383289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.383437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.383579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.383606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.383758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.383914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.383938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.384124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.384240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.384267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.384390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.384571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.384596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.384729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.384831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.384854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.384966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.385073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.385113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.385225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.385356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.385380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.385486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.385626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.385651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.385799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.385953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.385981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.386128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.386272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.386299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.386430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.386569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.386604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.386728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.386858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.386883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.387046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.387201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.387225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.387332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.387487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.387511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.387641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.387782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.555 [2024-11-28 11:51:45.387810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.555 qpair failed and we were unable to recover it. 00:27:25.555 [2024-11-28 11:51:45.387983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.388096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.388123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.388274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.388410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.388439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.388575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.388695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.388721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.388880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.389016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.389043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.389189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.389320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.389344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.389504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.389655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.389684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.389829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.389946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.389973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.390157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.390264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.390289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.390413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.390511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.390554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.390656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.390759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.390800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.390950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.391112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.391153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.391270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.391413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.391445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.391587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.391727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.391754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.391913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.392043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.392068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.392179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.392311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.392336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.392490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.392668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.392696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.392852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.392956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.392982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.393102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.393218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.393246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.393362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.393496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.393530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.393660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.393793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.393817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.393964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.394105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.394133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.394267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.394409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.394437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.394573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.394710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.394734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.394882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.394986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.395011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.395141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.395261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.395289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.556 qpair failed and we were unable to recover it. 00:27:25.556 [2024-11-28 11:51:45.395448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.395581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.556 [2024-11-28 11:51:45.395605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.395715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.395816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.395840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.395945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.396074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.396098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.396236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.396340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.396364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.396543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.396661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.396688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.396844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.396986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.397013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.397131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.397231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.397255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.397401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.397514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.397543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.397704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.397835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.397860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.397991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.398117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.398142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.398293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.398450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.398474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.398608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.398734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.398758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.398889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.399051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.399076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.399229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.399368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.399395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.399540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.399670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.399695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.399855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.399963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.399988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.400121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.400222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.400247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.400401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.400560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.400602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.400756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.400860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.400884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.401017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.401181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.401208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.401353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.401503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.401533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.401668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.401804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.401843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.401985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.402149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.402176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.402297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.402438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.402467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.402630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.402764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.402789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.402958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.403094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.403118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.403262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.403405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.403431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.403564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.403668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.403697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.403799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.403930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.403954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.557 qpair failed and we were unable to recover it. 00:27:25.557 [2024-11-28 11:51:45.404079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.557 [2024-11-28 11:51:45.404186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.404213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.404419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.404579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.404606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.404739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.404908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.404934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.405084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.405240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.405265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.405370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.405497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.405522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.405633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.405742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.405766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.405934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.406118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.406145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.406300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.406427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.406452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.406635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.406771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.406802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.406973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.407179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.407227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.407405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.407511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.407541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.407649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.407782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.407806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.407925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.408045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.408071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.408252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.408350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.408374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.408582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.408688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.408712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.408824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.408987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.409015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.409174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.409297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.409322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.409451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.409542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.409566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.409698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.409849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.409876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.410000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.410139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.410163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.410307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.410449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.410475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.410597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.410731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.410757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.410916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.411044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.411069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.411209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.411382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.411407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.411515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.411708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.411735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.411864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.412023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.412047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.412204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.412309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.412333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.412451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.412600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.412629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.412753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.412871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.412896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.558 qpair failed and we were unable to recover it. 00:27:25.558 [2024-11-28 11:51:45.413058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.413199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.558 [2024-11-28 11:51:45.413226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.413349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.413467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.413497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.413669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.413779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.413803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.413937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.414086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.414114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.414251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.414391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.414419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.414591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.414749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.414792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.414957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.415088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.415113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.415260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.415374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.415402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.415560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.415669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.415693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.415868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.416001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.416025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.416182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.416332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.416377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.416522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.416661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.416703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.416823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.416945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.416973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.417126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.417300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.417326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.417518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.417653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.417678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.417788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.417977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.418005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.418124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.418269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.418297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.418469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.418615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.418640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.418768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.418932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.418969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.419067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.419178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.419220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.419345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.419456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.419482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.419647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.419776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.419805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.419967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.420095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.420121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.420244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.420412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.420437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.420624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.420762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.420788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.420961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.421083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.421111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.421266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.421395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.421421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.421601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.421711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.421735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.421855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.421982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.422008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.559 qpair failed and we were unable to recover it. 00:27:25.559 [2024-11-28 11:51:45.422149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.422255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.559 [2024-11-28 11:51:45.422279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.422412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.422536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.422572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.422725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.422880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.422907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.423040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.423172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.423197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.423329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.423440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.423467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.423645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.423749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.423773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.423905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.424059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.424084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.424255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.424408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.424432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.424589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.424703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.424732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.424882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.425021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.425046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.425179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.425284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.425311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.425462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.425586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.425614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.425773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.425908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.425932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.426120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.426239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.426267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.426410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.426601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.426627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.426731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.426834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.426858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.426999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.427127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.427151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.427281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.427430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.427457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.427619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.427751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.427775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.427922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.428015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.428040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.428164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.428256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.428280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.428410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.428519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.428550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.428674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.428797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.428831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.428989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.429134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.429161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.429307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.429412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.429437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.429577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.429713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.429737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.429856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.429965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.429992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.430156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.430290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.430314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.430511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.430630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.560 [2024-11-28 11:51:45.430658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.560 qpair failed and we were unable to recover it. 00:27:25.560 [2024-11-28 11:51:45.430795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.430919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.430946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.431072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.431214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.431239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.431348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.431450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.431475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.431598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.431722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.431747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.431866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.432008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.432033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.432223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.432346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.432373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.432495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.432627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.432651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.432792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.432901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.432925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.433033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.433137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.433161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.433272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.433400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.433425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.433552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.433690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.433714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.433867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.433987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.434014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.434144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.434278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.434302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.434433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.434564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.434590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.434746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.434899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.434924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.435060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.435200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.435229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.435378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.435484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.435508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.435691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.435819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.435843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.435946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.436090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.436114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.436261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.436394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.436419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.436560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.436716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.436740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.436856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.436985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.437009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.437143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.437247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.437271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.437427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.437555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.437585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.437687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.437812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.437848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.561 [2024-11-28 11:51:45.438029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.438158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.561 [2024-11-28 11:51:45.438182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.561 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.438315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.438471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.438498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.438674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.438807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.438831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.438947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.439085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.439109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.439281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.439413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.439438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.439610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.439730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.439757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.439936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.440096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.440120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.440280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.440458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.440482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.440615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.440744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.440772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.440953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.441065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.441091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.441261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.441397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.441425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.441620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.441719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.441744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.441878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.442018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.442042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.442199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.442313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.442340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.442481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.442625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.442655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.442815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.442925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.442951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.443083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.443197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.443224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.443345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.443520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.443550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.443679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.443788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.443812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.443929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.444033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.444057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.444169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.444294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.444318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.444451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.444581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.444606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.444763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.444914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.444940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.445099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.445256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.445280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.445408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.445519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.445554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.445730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.445851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.445877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.446028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.446170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.446200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.446338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.446492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.446517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.446702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.446811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.446838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.562 [2024-11-28 11:51:45.446993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.447167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.562 [2024-11-28 11:51:45.447195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.562 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.447354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.447498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.447538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.447711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.447853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.447878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.448040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.448192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.448219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.448376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.448503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.448534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.448672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.448797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.448824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.448981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.449116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.449141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.449248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.449358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.449383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.449560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.449678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.449706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.449865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.450011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.450039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.450194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.450328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.450370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.450564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.450669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.450693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.450806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.450965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.450992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.451152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.451312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.451353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.451501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.451659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.451686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.451818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.451950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.451974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.452124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.452265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.452293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.452439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.452568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.452610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.452714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.452824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.452848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.452993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.453121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.453148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.453274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.453414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.453446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.453571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.453713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.453738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.453904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.454012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.454054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.454209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.454319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.454345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.454499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.454668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.454694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.454833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.454944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.454969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.455121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.455268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.455296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.455414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.455552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.455579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.455735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.455832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.455856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.563 [2024-11-28 11:51:45.456012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.456131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.563 [2024-11-28 11:51:45.456158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.563 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.456274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.456382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.456427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.456564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.456697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.456722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.456821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.456928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.456952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.457137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.457256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.457284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.457416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.457553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.457591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.457724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.457873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.457897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.457996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.458118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.458143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.458274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.458404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.458428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.458589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.458760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.458785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.458907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.459022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.459064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.459175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.459280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.459304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.459428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.459579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.459605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.459739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.459862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.459891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.460017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.460173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.460197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.460357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.460477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.460503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.460673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.460780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.460804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.460947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.461064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.461088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.461209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.461357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.461384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.461500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.461707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.461735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.461904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.462009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.462034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.462168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.462323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.462348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.462504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.462650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.462677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.462829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.462938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.462962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.463115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.463232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.463260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.463375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.463490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.463543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.463680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.463806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.463832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.463969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.464076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.464117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.464224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.464376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.464404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.564 [2024-11-28 11:51:45.464538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.464675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.564 [2024-11-28 11:51:45.464700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.564 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.464832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.464961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.464989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.465138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.465281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.465307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.465447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.465553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.465578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.465708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.465822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.465848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.465973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.466070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.466095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.466226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.466329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.466354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.466483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.466637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.466666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.466785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.466915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.466940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.467068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.467169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.467193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.467324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.467426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.467469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.467603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.467737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.467762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.467876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.467977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.468001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.468106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.468224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.468249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.468382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.468532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.468557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.468718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.468822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.468846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.468971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.469144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.469170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.469327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.469457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.469482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.469628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.469759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.469784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.469915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.470065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.470093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.470218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.470338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.470365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.470502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.470671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.470715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.470907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.471033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.471058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.471222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.471340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.471376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.471507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.471650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.471675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.471889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.471996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.472020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.472206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.472340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.565 [2024-11-28 11:51:45.472365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.565 qpair failed and we were unable to recover it. 00:27:25.565 [2024-11-28 11:51:45.472500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.472642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.472667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.472795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.472944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.472971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.473090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.473211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.473238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.473371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.473532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.473558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.473713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.473834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.473860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.473979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.474086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.474114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.474290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.474410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.474433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.474621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.474779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.474804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.474974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.475081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.475105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.475209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.475338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.475363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.475464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.475572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.475597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.475751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.475869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.475896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.476051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.476181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.476206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.476355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.476458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.476482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.476602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.476734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.476758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.476894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.477057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.477080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.477214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.477356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.477384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.477506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.477656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.477685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.477823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.477935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.477959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.478074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.478226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.478253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.478399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.478559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.478584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.478719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.478875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.478916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.479062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.479173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.479216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.479315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.479416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.479440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.479569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.479674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.479699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.479835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.479965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.479992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.480151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.480285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.480310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.480417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.480532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.480557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.480687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.480812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.566 [2024-11-28 11:51:45.480839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.566 qpair failed and we were unable to recover it. 00:27:25.566 [2024-11-28 11:51:45.480981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.481098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.481125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.481314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.481418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.481442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.481552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.481654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.481679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.481811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.481920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.481945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.482050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.482184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.482208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.482337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.482454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.482498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.482653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.482782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.482807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.482912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.483016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.483042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.483150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.483305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.483334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.483455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.483578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.483606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.483733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.483836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.483861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.483987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.484087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.484112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.484256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.484404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.484431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.484587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.484695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.484719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.484846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.484991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.485019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.485164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.485336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.485362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.485500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.485668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.485694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.485848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.485966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.485993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.486170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.486305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.486334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.486474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.486604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.486629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.486782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.486929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.486956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.487090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.487218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.487242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.487377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.487507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.487541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.487676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.487782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.487810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.487977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.488084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.488108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.488208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.488309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.488334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.488441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.488545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.488571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.567 [2024-11-28 11:51:45.488702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.488808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.567 [2024-11-28 11:51:45.488833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.567 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.488939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.489045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.489070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.489215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.489371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.489396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.489494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.489649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.489674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.489781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.489911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.489935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.490046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.490149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.490174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.490294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.490410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.490436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.490565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.490704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.490729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.490847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.490999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.491026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.491180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.491276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.491300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.491431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.491540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.491565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.491698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.491807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.491831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.491999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.492177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.492205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.492334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.492460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.492485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.492623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.492800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.492824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.492944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.493102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.493126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.493258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.493367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.493391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.493514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.493640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.493668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.493786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.493888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.493914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.494060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.494167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.494194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.494395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.494531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.494557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.494689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.494844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.494871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.495007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.495163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.495188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.495315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.495427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.495454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.495605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.495776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.495804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.495961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.496069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.496095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.496199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.496359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.496387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.496548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.496649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.496674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.496801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.496925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.496951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.568 [2024-11-28 11:51:45.497106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.497237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.568 [2024-11-28 11:51:45.497261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.568 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.497370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.497491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.497518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.497694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.497829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.497853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.498025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.498129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.498155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.498262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.498410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.498438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.498575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.498734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.498759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.498937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.499055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.499082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.499245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.499345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.499369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.499537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.499642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.499666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.499831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.499967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.499994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.500111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.500227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.500255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.500406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.500512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.500546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.500674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.500820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.500846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.500957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.501095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.501127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.501279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.501410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.501434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.501544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.501655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.501682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.501830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.501971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.501998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.502125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.502281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.502306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.502473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.502581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.502607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.502758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.502896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.502923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.503052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.503158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.503182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.503296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.503444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.503471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.503588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.503710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.503735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.503871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.503979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.504008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.504162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.504280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.504308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.504448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.504637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.504663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.504795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.504898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.504923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.505050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.505212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.505237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.505456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.505610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.505637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.569 [2024-11-28 11:51:45.505771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.505930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.569 [2024-11-28 11:51:45.505973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.569 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.506099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.506218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.506260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.506422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.506559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.506587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.506716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.506825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.506850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.507034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.507178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.507205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.507355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.507510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.507542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.507645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.507756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.507781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.507893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.508011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.508037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.508207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.508358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.508385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.508514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.508669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.508693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.508811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.508964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.508989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.509146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.509293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.509321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.509500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.509626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.509651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.509812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.509981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.510008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.510149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.510283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.510308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.510446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.510554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.510579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.510716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.510845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.510870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.511028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.511205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.511233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.511356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.511515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.511547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.511708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.511871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.511895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.512033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.512228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.512252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.512404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.512522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.512558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.512682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.512839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.512866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.512991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.513143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.513167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.513324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.513430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.513455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.570 qpair failed and we were unable to recover it. 00:27:25.570 [2024-11-28 11:51:45.513583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.570 [2024-11-28 11:51:45.513729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.513757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.513871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.513983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.514011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.514146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.514281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.514307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.514486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.514615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.514642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.514808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.514916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.514943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.515101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.515236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.515260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.515403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.515543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.515571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.515684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.515865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.515890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.516050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.516154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.516177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.516282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.516404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.516430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.516538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.516688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.516714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.516853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.516957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.516982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.517097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.517211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.517237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.517390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.517516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.517548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.517662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.517765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.517790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.517924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.518074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.518100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.518220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.518363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.518404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.518502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.518650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.518676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.518813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.518984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.519010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.519150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.519294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.519319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.519496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.519639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.519669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.519802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.519927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.519953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.520075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.520241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.520268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.520391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.520590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.520615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.520721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.520827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.520869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.521024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.521126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.521152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.521270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.521399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.521424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.521558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.521667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.521693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.521794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.521929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.521954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.571 qpair failed and we were unable to recover it. 00:27:25.571 [2024-11-28 11:51:45.522054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.571 [2024-11-28 11:51:45.522182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.522208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.522338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.522467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.522495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.522674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.522805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.522847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.523010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.523167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.523192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.523374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.523516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.523552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.523739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.523857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.523886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.524037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.524141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.524166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.524265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.524376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.524400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.524542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.524688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.524715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.524844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.524973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.524997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.525098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.525237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.525261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.525381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.525520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.525555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.525718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.525829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.525854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.526034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.526144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.526169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.526326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.526482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.526510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.526694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.526847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.526876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.527006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.527113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.527138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.527244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.527373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.527416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.527572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.527671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.527696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.527827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.527941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.527969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.528078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.528258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.528282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.528415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.528521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.528555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.528687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.528860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.528888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.529008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.529155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.529182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.529365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.529494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.529543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.529698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.529829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.529853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.529979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.530126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.530153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.530308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.530440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.530465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.530600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.530723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.530749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.572 qpair failed and we were unable to recover it. 00:27:25.572 [2024-11-28 11:51:45.530859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.572 [2024-11-28 11:51:45.531004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.531031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.531219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.531355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.531397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.531554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.531682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.531707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.531821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.531950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.531978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.532127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.532286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.532310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.532437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.532565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.532593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.532700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.532817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.532845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.532995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.533127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.533152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.533307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.533450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.533478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.533646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.533752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.533776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.533915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.534021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.534045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.534199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.534371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.534397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.534585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.534695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.534722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.534853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.534983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.535012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.535169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.535282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.535310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.535437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.535554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.535582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.535728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.535856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.535880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.536036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.536177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.536205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.536327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.536447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.536471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.536588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.536725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.536749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.536892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.537063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.537090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.537210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.537359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.537386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.537540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.537653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.537679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.537810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.537961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.537988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.538145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.538289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.538316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.538462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.538591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.538616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.538771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.538899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.538923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.539030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.539213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.539241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.539371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.539478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.539502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.573 qpair failed and we were unable to recover it. 00:27:25.573 [2024-11-28 11:51:45.539626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.539759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.573 [2024-11-28 11:51:45.539784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.539932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.540047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.540074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.540196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.540331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.540354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.540488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.540621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.540648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.540764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.540922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.540946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.541085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.541190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.541214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.541313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.541436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.541463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.541616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.541721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.541748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.541857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.541959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.541984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.542085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.542230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.542257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.542419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.542568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.542594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.542703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.542805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.542831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.542959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.543065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.543091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.543225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.543364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.543390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.543517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.543630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.543654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.543837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.543946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.543972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.544082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.544216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.544242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.544398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.544568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.544595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.544744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.544849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.544874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.545005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.545126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.545152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.545279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.545384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.545408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.545540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.545711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.545735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.545895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.545995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.546019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.546131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.546287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.546311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.546452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.546562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.546588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.546713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.546865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.546891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.547026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.547157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.547181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.547301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.547507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.547539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.547697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.547830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.574 [2024-11-28 11:51:45.547855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.574 qpair failed and we were unable to recover it. 00:27:25.574 [2024-11-28 11:51:45.547978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.548108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.548132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.548227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.548365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.548390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.548532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.548670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.548695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.548793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.548921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.548946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.549069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.549170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.549195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.549320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.549454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.549480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.549630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.549735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.549764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.549915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.550025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.550050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.550206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.550307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.550332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.550461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.550596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.550620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.550816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.550950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.550975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.551102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.551210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.551237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.551359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.551513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.551545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.551684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.551816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.551841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.551963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.552102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.552128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.552300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.552459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.552484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.552594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.552702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.552727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.552839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.552960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.552986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.553104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.553203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.553228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.553333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.553492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.553518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.553674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.553806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.553830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.553940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.554074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.554099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.554211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.554315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.554357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.554469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.554626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.554657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.554769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.554874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.554899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.575 [2024-11-28 11:51:45.555019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.555133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.575 [2024-11-28 11:51:45.555159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.575 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.555263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.555435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.555460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.555603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.555706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.555732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.555885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.556032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.556057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.556220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.556354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.556380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.556535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.556674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.556700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.556838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.556957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.556983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.557082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.557188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.557213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.557388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.557529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.557554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.557692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.557813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.557840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.557976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.558073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.558099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.558270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.558401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.558441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.558593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.558711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.558737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.558865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.559007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.559033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.559157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.559314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.559339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.559511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.559623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.559649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.559754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.559889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.559913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.560039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.560168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.560193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.560325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.560462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.560487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.560624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.560754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.560779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.560964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.561065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.561090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.561274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.561370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.561395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.561537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.561668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.561693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.561839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.561975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.562000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.562101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.562238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.562263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.562370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.562503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.562553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.562663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.562774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.562799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.562929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.563082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.563108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.563256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.563389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.563414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.563536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.563639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.576 [2024-11-28 11:51:45.563665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.576 qpair failed and we were unable to recover it. 00:27:25.576 [2024-11-28 11:51:45.563802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.563975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.564000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.564111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.564220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.564245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.564387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.564480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.564509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.564643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.564779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.564804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.564919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.565071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.565095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.565209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.565320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.565344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.565455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.565588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.565612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.565770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.565945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.565970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.566101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.566206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.566233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.566363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.566475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.566500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.566636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.566766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.566790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.566895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.566994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.567018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.567157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.567264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.567292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.567427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.567556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.567581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.567710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.567841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.567865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.568003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.568129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.568154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.568289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.568419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.568446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.568580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.568689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.568714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.568827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.568955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.568979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.569126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.569264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.569288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.569424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.569575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.569614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.569728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.569840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.569865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.569979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.570113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.570138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.570272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.570420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.570445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.570608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.570715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.570740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.570839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.570947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.570979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.571139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.571239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.571273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.571404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.571558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.571585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.577 qpair failed and we were unable to recover it. 00:27:25.577 [2024-11-28 11:51:45.571691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.571826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.577 [2024-11-28 11:51:45.571851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.578 qpair failed and we were unable to recover it. 00:27:25.578 [2024-11-28 11:51:45.572007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.578 [2024-11-28 11:51:45.572141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.578 [2024-11-28 11:51:45.572165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.578 qpair failed and we were unable to recover it. 00:27:25.578 [2024-11-28 11:51:45.572264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.578 [2024-11-28 11:51:45.572394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.578 [2024-11-28 11:51:45.572419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.578 qpair failed and we were unable to recover it. 00:27:25.578 [2024-11-28 11:51:45.572522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.578 [2024-11-28 11:51:45.572635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.578 [2024-11-28 11:51:45.572659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.578 qpair failed and we were unable to recover it. 00:27:25.578 [2024-11-28 11:51:45.572800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.578 [2024-11-28 11:51:45.572904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.578 [2024-11-28 11:51:45.572931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.578 qpair failed and we were unable to recover it. 00:27:25.578 [2024-11-28 11:51:45.573054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.578 [2024-11-28 11:51:45.573230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.578 [2024-11-28 11:51:45.573259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.573370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.573480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.573505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.573624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.573736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.573761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.573863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.573962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.573988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.574087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.574185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.574209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.574313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.574442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.574466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.574629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.574734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.574759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.574919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.575021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.575046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.575155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.575289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.575314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.575419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.575553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.575579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.575696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.575806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.575831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.575938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.576098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.576123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.576229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.576380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.576405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.576504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.576643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.576668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.576804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.576933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.576957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.577068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.577174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.577199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.577328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.577481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.577505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.577616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.577720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.577744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.577884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.577984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.578008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.578142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.578274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.578298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.578429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.578556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.578581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.578690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.578792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.578816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.578951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.579057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.579081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.579195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.579325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.579348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.579456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.579569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.579594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.579704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.579842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.579866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.579971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.580105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.580129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.856 qpair failed and we were unable to recover it. 00:27:25.856 [2024-11-28 11:51:45.580239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.580350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.856 [2024-11-28 11:51:45.580374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.580474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.580630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.580655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.580783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.580913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.580937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.581046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.581173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.581201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.581310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.581408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.581432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.581544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.581652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.581676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.581783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.581941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.581965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.582075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.582181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.582205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.582327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.582429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.582454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.582589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.582693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.582718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.582853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.582986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.583010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.583113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.583218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.583242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.583347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.583448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.583473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.583579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.583722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.583747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.583856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.584011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.584036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.584139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.584263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.584288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.584390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.584551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.584576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.584685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.584787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.584811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.584946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.585053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.585082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.585212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.585303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.585326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.585455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.585579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.585605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.585710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.585839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.585863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.585969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.586067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.586092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.586223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.586329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.586353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.586535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.586671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.586695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.586855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.586959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.586984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.587117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.587272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.587297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.587458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.587565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.587592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.587697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.587831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.587856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.857 qpair failed and we were unable to recover it. 00:27:25.857 [2024-11-28 11:51:45.587987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.857 [2024-11-28 11:51:45.588120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.588144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.588300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.588405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.588430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.588558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.588659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.588683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.588847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.588958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.588982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.589084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.589182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.589206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.589311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.589413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.589438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.589572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.589732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.589757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.589909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.590051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.590080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.590252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.590401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.590427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.590558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.590688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.590713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.590838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.591023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.591049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.591184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.591345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.591372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.591499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.591608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.591635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.591787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.591964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.591989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.592122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.592250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.592278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.592460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.592588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.592615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.592725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.592835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.592860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.592993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.593098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.593123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.593231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.593390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.593415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.593532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.593633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.593657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.593787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.593891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.593915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.594016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.594123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.594148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.594245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.594342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.594365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.594471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.594593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.594618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.594760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.594893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.594918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.595022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.595175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.595208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.595331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.595543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.595572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.595700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.595833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.595858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.596032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.596178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.596206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.858 qpair failed and we were unable to recover it. 00:27:25.858 [2024-11-28 11:51:45.596380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.858 [2024-11-28 11:51:45.596551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.596580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.596734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.596871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.596897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.597049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.597166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.597194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.597310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.597483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.597508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.597644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.597775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.597800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.597904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.598038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.598065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.598175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.598301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.598326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.598441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.598549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.598575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.598680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.598785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.598810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.598946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.599074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.599099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.599262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.599360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.599385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.599518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.599621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.599646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.599751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.599877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.599902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.600009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.600127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.600151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.600258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.600415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.600440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.600570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.600671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.600697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.600829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.600964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.600989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.601095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.601226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.601251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.601356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.601483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.601508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.601626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.601738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.601763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.601896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.602025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.602051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.602151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.602274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.602299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.602429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.602537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.602563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.602669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.602775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.602800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.602959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.603081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.603106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.603214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.603317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.603341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.603442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.603573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.603598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.603705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.603813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.603837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.603970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.604124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.604148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.859 qpair failed and we were unable to recover it. 00:27:25.859 [2024-11-28 11:51:45.604249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.604382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.859 [2024-11-28 11:51:45.604407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.604544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.604661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.604684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.604816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.604923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.604947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.605054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.605180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.605204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.605336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.605464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.605488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.605614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.605714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.605738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.605864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.605966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.605990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.606121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.606244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.606268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.606383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.606513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.606543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.606654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.606764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.606789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.606929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.607063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.607087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.607252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.607411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.607436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.607575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.607682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.607706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.607829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.607959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.607985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.608083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.608185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.608210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.608345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.608475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.608500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.608612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.608714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.608739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.608839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.608972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.608997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.609133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.609238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.609267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.609374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.609507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.609540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.609653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.609768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.609792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.609906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.610008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.610032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.610167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.610291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.610316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.610443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.610552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.610578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.860 [2024-11-28 11:51:45.610688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.610789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.860 [2024-11-28 11:51:45.610814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.860 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.610925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.611024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.611048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.611158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.611265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.611290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.611404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.611537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.611562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.611671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.611803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.611832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.611964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.612071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.612095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.612201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.612310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.612334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.612440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.612550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.612576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.612707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.612811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.612834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.612937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.613070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.613094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.613228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.613384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.613409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.613542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.613672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.613694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.613833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.613937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.613960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.614089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.614194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.614217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.614354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.614454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.614477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.614621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.614734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.614758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.614870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.615004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.615030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.615162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.615264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.615288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.615425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.615558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.615584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.615717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.615835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.615859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.615991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.616097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.616122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.616262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.616396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.616420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.616580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.616691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.616715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.616824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.616949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.616973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.617083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.617208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.617233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.617329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.617457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.617481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.617615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.617749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.617774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.617882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.618014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.618038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.618177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.618311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.618335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.861 qpair failed and we were unable to recover it. 00:27:25.861 [2024-11-28 11:51:45.618501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.861 [2024-11-28 11:51:45.618645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.618673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.618808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.618943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.618966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.619073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.619232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.619256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.619364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.619462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.619486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.619629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.619730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.619755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.619884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.620016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.620040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.620174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.620313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.620338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.620499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.620625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.620649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.620784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.620920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.620943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.621069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.621201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.621225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.621361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.621457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.621481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.621589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.621746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.621770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.621900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.622026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.622050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.622180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.622278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.622302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.622469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.622594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.622618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.622724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.622858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.622883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.622984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.623114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.623139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.623270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.623401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.623425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.623559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.623696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.623721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.623826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.623960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.623984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.624122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.624231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.624255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.624357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.624492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.624516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.624635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.624744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.624768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.624896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.625001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.625025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.625165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.625293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.625317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.625472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.625603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.625628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.625742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.625846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.625874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.625972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.626094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.626118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.626228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.626329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.626354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.862 qpair failed and we were unable to recover it. 00:27:25.862 [2024-11-28 11:51:45.626484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.862 [2024-11-28 11:51:45.626605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.626631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.626758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.626888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.626913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.627038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.627167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.627192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.627303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.627439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.627464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.627593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.627727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.627751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.627881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.628001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.628025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.628176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.628285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.628308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.628439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.628537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.628562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.628677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.628784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.628808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.628940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.629069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.629092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.629250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.629347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.629372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.629533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.629692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.629717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.629823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.629924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.629949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.630088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.630222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.630247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.630377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.630483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.630507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.630623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.630724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.630748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.630883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.631015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.631039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.631140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.631264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.631288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.631398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.631554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.631579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.631715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.631846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.631870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.631978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.632083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.632108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.632268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.632416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.632440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.632600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.632708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.632734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.632838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.632966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.632991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.633103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.633236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.633261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.633386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.633511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.633543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.633679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.633787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.633811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.633941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.634049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.634074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.634234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.634374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.634400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.863 qpair failed and we were unable to recover it. 00:27:25.863 [2024-11-28 11:51:45.634510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.863 [2024-11-28 11:51:45.634628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.634653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.634755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.634892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.634916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.635021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.635127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.635158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.635301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.635411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.635436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.635604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.635731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.635758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.635895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.635995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.636019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.636154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.636312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.636336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.636493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.636657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.636683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.636783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.636919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.636944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.637048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.637159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.637184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.637292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.637401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.637426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.637564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.637669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.637694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.637806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.637935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.637959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.638067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.638176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.638201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.638329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.638459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.638483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.638594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.638703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.638728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.638826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.638928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.638953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.639064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.639201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.639225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.639360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.639488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.639513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.639653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.639791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.639819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.639953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.640079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.640104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.640241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.640346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.640370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.640515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.640667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.640692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.640825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.640959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.640984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.641118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.641290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.641316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.641447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.641550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.641575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.641680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.641784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.641808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.641914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.642043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.642067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.642169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.642283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.864 [2024-11-28 11:51:45.642307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.864 qpair failed and we were unable to recover it. 00:27:25.864 [2024-11-28 11:51:45.642415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.642516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.642545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.642664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.642773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.642797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.642907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.643017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.643042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.643155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.643253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.643277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.643379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.643473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.643497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.643644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.643748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.643773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.643909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.644007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.644032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.644136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.644271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.644295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.644401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.644506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.644538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.644667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.644767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.644793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.644926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.645064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.645088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.645200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.645304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.645328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.645435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.645570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.645596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.645735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.645833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.645858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.645971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.646101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.646126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.646257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.646392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.646416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.646577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.646682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.646708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.646812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.646916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.646941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.647047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.647205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.647231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.647339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.647452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.647477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.647616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.647726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.647751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.647897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.648023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.648047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.648149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.648256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.648280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.648416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.648521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.648550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.648691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.648798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.648823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.865 qpair failed and we were unable to recover it. 00:27:25.865 [2024-11-28 11:51:45.648922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.865 [2024-11-28 11:51:45.649056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.649079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.649185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.649287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.649312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.649412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.649511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.649545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.649685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.649823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.649848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.649948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.650084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.650108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.650241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.650345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.650369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.650479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.650614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.650640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.650745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.650877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.650901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.651032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.651163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.651187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.651315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.651447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.651471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.651609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.651716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.651741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.651853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.651976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.652000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.652116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.652251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.652275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.652408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.652507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.652539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.652658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.652762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.652786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.652893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.653007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.653031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.653146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.653275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.653303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.653407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.653507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.653538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.653676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.653785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.653809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.653911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.654043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.654068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.654230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.654327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.654351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.654487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.654613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.654638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.654775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.654881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.654907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.655034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.655194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.655219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.655355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.655489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.655514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.655625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.655783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.655807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.655938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.656042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.656067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.656203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.656307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.656332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.656464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.656575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.866 [2024-11-28 11:51:45.656601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.866 qpair failed and we were unable to recover it. 00:27:25.866 [2024-11-28 11:51:45.656708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.656809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.656834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.656964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.657067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.657092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.657224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.657335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.657360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.657467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.657597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.657623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.657755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.657886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.657912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.658044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.658146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.658171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.658282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.658437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.658461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.658600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.658705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.658729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.658845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.658970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.658994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.659152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.659254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.659278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.659411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.659507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.659555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.659663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.659829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.659854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.659982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.660095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.660120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.660252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.660408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.660433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.660561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.660689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.660713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.660843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.660939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.660963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.661098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.661253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.661277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.661452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.661555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.661579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.661696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.661807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.661832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.661962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.662069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.662093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.662224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.662359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.662384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.662490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.662654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.662680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.662789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.662923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.662947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.663083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.663193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.663217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.663349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.663456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.663480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.663665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.663775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.663799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.663909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.664021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.664045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.664172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.664298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.664322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.664460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.664604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.867 [2024-11-28 11:51:45.664631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.867 qpair failed and we were unable to recover it. 00:27:25.867 [2024-11-28 11:51:45.664736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.664867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.664893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.665007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.665113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.665139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.665251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.665410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.665435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.665593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.665696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.665720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.665857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.665961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.665985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.666120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.666226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.666251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.666356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.666466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.666490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.666607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.666738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.666762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.666898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.667005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.667029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.667159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.667267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.667297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.667407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.667561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.667587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.667688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.667830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.667855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.667985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.668093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.668117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.668217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.668344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.668369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.668505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.668617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.668642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.668746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.668852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.668879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.669019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.669148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.669172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.669287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.669400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.669425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.669533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.669631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.669656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.669812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.669914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.669943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.670081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.670215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.670240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.670347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.670474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.670499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.670606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.670713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.670738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.670865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.670973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.670997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.671102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.671234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.671259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.671391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.671520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.671570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.671678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.671782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.671807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.671937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.672103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.672128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.672263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.672399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.868 [2024-11-28 11:51:45.672425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.868 qpair failed and we were unable to recover it. 00:27:25.868 [2024-11-28 11:51:45.672571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.672676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.672701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.672810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.672910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.672935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.673040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.673154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.673178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.673310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.673469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.673494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.673619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.673746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.673771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.673899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.674030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.674054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.674161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.674263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.674287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.674419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.674554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.674579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.674686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.674812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.674837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.674989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.675086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.675111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.675213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.675315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.675339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.675458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.675567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.675593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.675701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.675806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.675833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.675965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.676130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.676155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.676289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.676414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.676439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.676546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.676692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.676717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.676819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.676977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.677001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.677140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.677235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.677259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.677358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.677464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.677488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.677603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.677731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.677756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.677853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.678015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.678039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.678178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.678285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.678309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.678437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.678538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.678563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.678700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.678809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.678834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.678945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.679060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.679084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.869 qpair failed and we were unable to recover it. 00:27:25.869 [2024-11-28 11:51:45.679190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.869 [2024-11-28 11:51:45.679320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.679344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.679480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.679590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.679615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.679718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.679814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.679840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.679975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.680116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.680142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.680244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.680348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.680373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.680537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.680700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.680725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.680825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.680929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.680953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.681114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.681212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.681236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.681375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.681479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.681503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.681638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.681766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.681790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.681920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.682025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.682049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.682187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.682318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.682342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.682511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.682630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.682655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.682760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.682889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.682913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.683013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.683140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.683164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.683299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.683459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.683482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.683628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.683761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.683792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.683896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.684014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.684038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.684133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.684229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.684254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.684353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.684481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.684505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.684621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.684747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.684772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.684911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.685058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.685085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.685262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.685423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.685450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.685607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.685713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.685738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.685887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.685997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.686024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.686144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.686245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.686269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.686424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.686537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.686564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.686716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.686861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.686888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.687045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.687179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.687203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.870 qpair failed and we were unable to recover it. 00:27:25.870 [2024-11-28 11:51:45.687330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.870 [2024-11-28 11:51:45.687476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.687503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.687670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.687804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.687831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.687986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.688114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.688138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.688272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.688428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.688451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.688586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.688761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.688788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.688944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.689074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.689098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.689249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.689388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.689415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.689539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.689688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.689713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.689851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.689981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.690005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.690138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.690278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.690306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.690459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.690596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.690621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.690752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.690907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.690931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.691089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.691241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.691267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.691420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.691556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.691582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.691691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.691823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.691847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.691974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.692121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.692147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.692292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.692480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.692504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.692648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.692807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.692850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.692966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.693113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.693140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.693313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.693464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.693492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.693625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.693789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.693814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.693983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.694135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.694160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.694281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.694426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.694451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.694607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.694762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.694787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.694942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.695064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.695093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.695208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.695388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.695413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.695518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.695669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.695694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.695863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.695993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.696017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.696174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.696325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.696353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.871 qpair failed and we were unable to recover it. 00:27:25.871 [2024-11-28 11:51:45.696504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.871 [2024-11-28 11:51:45.696647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.696672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.696853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.696995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.697022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.697135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.697284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.697309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.697441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.697548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.697573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.697698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.697820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.697849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.697994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.698168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.698196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.698356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.698515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.698576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.698747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.698884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.698912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.699039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.699165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.699190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.699326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.699489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.699518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.699699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.699825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.699850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.699989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.700122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.700146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.700283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.700388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.700413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.700573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.700699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.700724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.700872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.701017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.701045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.701222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.701364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.701388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.701521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.701670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.701698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.701879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.702037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.702061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.702197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.702293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.702318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.702462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.702637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.702662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.702766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.702900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.702926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.703082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.703256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.703283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.703402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.703549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.703576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.703727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.703916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.703978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.704109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.704236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.704261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.704372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.704501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.704533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.704665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.704771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.704796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.704927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.705083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.705108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.705260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.705404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.705430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.872 qpair failed and we were unable to recover it. 00:27:25.872 [2024-11-28 11:51:45.705592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.872 [2024-11-28 11:51:45.705749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.705773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.705878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.706036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.706061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.706179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.706326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.706353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.706504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.706617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.706641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.706780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.706920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.706961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.707077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.707242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.707268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.707378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.707512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.707560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.707713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.707844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.707869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.708029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.708220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.708244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.708379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.708532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.708572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.708705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.708806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.708831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.708964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.709071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.709098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.709240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.709381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.709408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.709558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.709667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.709691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.709824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.709948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.709975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.710118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.710272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.710297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.710457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.710562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.710586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.710744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.710899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.710925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.711036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.711192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.711220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.711337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.711475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.711500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.711654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.711765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.711792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.711933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.712090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.712116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.712252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.712375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.712399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.712544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.712712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.712739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.712918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.713059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.713083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.713263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.713366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.713390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.713548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.713666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.713695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.713852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.713974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.713997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.714123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.714256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.714280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.873 qpair failed and we were unable to recover it. 00:27:25.873 [2024-11-28 11:51:45.714383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.873 [2024-11-28 11:51:45.714542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.714567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.714673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.714769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.714793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.714897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.715053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.715081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.715240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.715346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.715371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.715569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.715702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.715727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.715857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.715994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.716018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.716172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.716302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.716327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.716487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.716647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.716676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.716854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.717036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.717063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.717211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.717348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.717375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.717530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.717644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.717670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.717850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.717956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.717981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.718105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.718236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.718265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.718420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.718566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.718593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.718771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.718876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.718900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.719051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.719193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.719219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.719382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.719484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.719508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.719624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.719755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.719779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.719925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.720063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.720090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.720247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.720354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.720378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.720480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.720608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.720633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.720760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.720933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.720960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.721131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.721270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.721296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.721429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.721556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.721582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.721689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.721835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.721863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.722009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.722154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.874 [2024-11-28 11:51:45.722182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.874 qpair failed and we were unable to recover it. 00:27:25.874 [2024-11-28 11:51:45.722339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.722509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.722543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.722660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.722808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.722834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.723021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.723182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.723207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.723333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.723485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.723511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.723687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.723843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.723869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.724016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.724165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.724191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.724344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.724518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.724554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.724670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.724838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.724865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.725016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.725168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.725196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.725319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.725446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.725470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.725602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.725721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.725749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.725904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.726015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.726040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.726168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.726325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.726349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.726508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.726657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.726684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.726802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.726948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.726975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.727154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.727257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.727282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.727445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.727589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.727618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.727775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.727891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.727915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.728050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.728146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.728170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.728343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.728483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.728512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.728696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.728821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.728848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.728966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.729117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.729141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.729296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.729422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.729446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.729580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.729706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.729748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.729910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.730044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.730086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.730206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.730354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.730382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.730500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.730688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.730712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.730878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.731016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.731058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.875 qpair failed and we were unable to recover it. 00:27:25.875 [2024-11-28 11:51:45.731230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.731411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.875 [2024-11-28 11:51:45.731435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.731551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.731661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.731703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.731853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.731986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.732010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.732166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.732333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.732358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.732489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.732595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.732619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.732725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.732855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.732880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.733049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.733217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.733244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.733427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.733586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.733611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.733740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.733878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.733903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.734009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.734140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.734170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.734315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.734428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.734469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.734602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.734713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.734738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.734868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.735024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.735048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.735210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.735362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.735386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.735520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.735660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.735685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.735820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.735976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.736003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.736106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.736256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.736282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.736455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.736610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.736639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.736789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.736920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.736944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.737100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.737293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.737318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.737468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.737597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.737623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.737753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.737875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.737902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.738048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.738189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.738216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.738371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.738509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.738555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.738680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.738824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.738851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.739033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.739157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.739182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.739317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.739421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.739446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.739556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.739663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.739688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.739790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.739918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.739944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.876 qpair failed and we were unable to recover it. 00:27:25.876 [2024-11-28 11:51:45.740047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.740202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.876 [2024-11-28 11:51:45.740226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.740363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.740510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.740545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.740661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.740832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.740856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.741017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.741129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.741153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.741287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.741388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.741412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.741519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.741636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.741678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.741834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.741977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.742002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.742140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.742306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.742333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.742471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.742611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.742638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.742769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.742938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.742962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.743114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.743227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.743254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.743400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.743542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.743571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.743724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.743873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.743898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.744070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.744224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.744249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.744377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.744538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.744562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.744668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.744798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.744822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.744950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.745129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.745156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.745271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.745383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.745412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.745563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.745670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.745695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.745829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.745935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.745958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.746066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.746160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.746184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.746314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.746449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.746473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.746607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.746744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.746768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.746915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.747034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.747061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.747219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.747345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.747370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.747476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.747678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.747706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.747852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.747982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.748006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.877 [2024-11-28 11:51:45.748142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.748274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.877 [2024-11-28 11:51:45.748298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.877 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.748464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.748599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.748625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.748728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.748832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.748857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.748960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.749090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.749114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.749278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.749430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.749462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.749629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.749775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.749802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.749951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.750061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.750085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.750243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.750401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.750426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.750562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.750740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.750769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.750929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.751086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.751111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.751268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.751436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.751461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.751595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.751770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.751798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.751930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.752056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.752081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.752263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.752412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.752441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.752564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.752688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.752713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.752871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.753070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.753124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.753237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.753394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.753419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.753558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.753725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.753750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.753860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.754027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.754051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.754211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.754325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.754352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.754501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.754683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.754709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.754847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.755007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.755048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.755198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.755343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.755370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.755511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.755655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.755683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.755848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.755977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.756002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.756138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.756294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.878 [2024-11-28 11:51:45.756318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.878 qpair failed and we were unable to recover it. 00:27:25.878 [2024-11-28 11:51:45.756481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.756651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.756679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.756874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.757007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.757032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.757194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.757349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.757376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.757612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.757721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.757762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.757895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.758062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.758105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.758230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.758386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.758411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.758520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.758634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.758659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.758789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.758888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.758913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.759027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.759171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.759199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.759342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.759452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.759493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.759639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.759777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.759818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.759964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.760111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.760139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.760292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.760392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.760417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.760550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.760678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.760702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.760810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.760989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.761017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.761157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.761325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.761352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.761518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.761676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.761702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.761834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.761977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.762004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.762160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.762316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.762341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.762480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.762598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.762623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.762746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.762886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.762913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.763064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.763223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.763247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.763376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.763505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.763536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.763721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.763843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.763871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.764018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.764201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.764225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.764326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.764484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.764508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.764686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.764825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.764852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.764985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.765142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.765167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.765263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.765403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.879 [2024-11-28 11:51:45.765428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.879 qpair failed and we were unable to recover it. 00:27:25.879 [2024-11-28 11:51:45.765587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.765711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.765744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.765919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.766090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.766118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.766267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.766425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.766467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.766638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.766786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.766814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.766931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.767101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.767128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.767283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.767409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.767432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.767567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.767696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.767722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.767884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.767985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.768009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.768181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.768361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.768389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.768521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.768631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.768655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.768792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.768892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.768933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.769096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.769228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.769252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.769416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.769580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.769606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.769738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.769890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.769917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.770074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.770235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.770260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.770418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.770564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.770592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.770740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.770853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.770880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.771033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.771133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.771157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.771306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.771446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.771486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.771629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.771779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.771806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.771985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.772095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.772119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.772221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.772356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.772380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.772536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.772712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.772740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.772867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.773029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.773053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.773180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.773320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.773347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.773488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.773666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.773694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.773825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.773953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.773978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.774129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.774299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.774327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.774495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.774662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.880 [2024-11-28 11:51:45.774704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.880 qpair failed and we were unable to recover it. 00:27:25.880 [2024-11-28 11:51:45.774858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.775014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.775038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.775233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.775363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.775387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.775539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.775677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.775704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.775861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.776052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.776120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.776266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.776407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.776434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.776583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.776728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.776754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.776937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.777068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.777092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.777251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.777408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.777432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.777580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.777696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.777722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.777880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.778015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.778040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.778172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.778345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.778372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.778517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.778681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.778706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.778836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.778946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.778971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.779155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.779283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.779307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.779482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.779655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.779680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.779788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.779923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.779947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.780132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.780281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.780308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.780461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.780564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.780589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.780733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.780889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.780932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.781072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.781225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.781248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.781378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.781480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.781504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.781645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.781768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.781793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.781925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.782062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.782090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.782199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.782365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.782389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.782589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.782721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.782746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.782861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.783034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.783062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.783213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.783351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.783377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.783534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.783637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.783662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.783840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.783978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.881 [2024-11-28 11:51:45.784005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.881 qpair failed and we were unable to recover it. 00:27:25.881 [2024-11-28 11:51:45.784149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.784284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.784312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.784487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.784642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.784667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.784804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.784964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.784988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.785149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.785312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.785341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.785502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.785641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.785683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.785809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.785988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.786011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.786141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.786317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.786345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.786491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.786610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.786636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.786762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.786928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.786955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.787071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.787211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.787238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.787419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.787574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.787617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.787731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.787875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.787903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.788076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.788186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.788214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.788369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.788474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.788500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.788712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.788845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.788869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.789053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.789202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.789227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.789361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.789496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.789520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.789688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.789802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.789830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.789997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.790156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.790181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.790344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.790473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.790498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.790648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.790760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.790784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.790891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.791019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.791043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.791203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.791335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.791378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.791507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.791669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.791694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.791877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.792036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.792060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.792200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.792326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.792351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.792459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.792611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.792639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.792753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.792861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.792888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.793016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.793119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.793145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.882 qpair failed and we were unable to recover it. 00:27:25.882 [2024-11-28 11:51:45.793306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.882 [2024-11-28 11:51:45.793459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.793489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.793635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.793767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.793792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.793951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.794049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.794073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.794303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.794428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.794468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.794624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.794733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.794760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.794936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.795044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.795071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.795206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.795385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.795412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.795576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.795702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.795727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.795869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.796000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.796040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.796182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.796363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.796389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.796522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.796687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.796712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.796876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.797007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.797032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.797146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.797274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.797299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.797512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.797666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.797691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.797824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.797978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.798021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.798184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.798348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.798374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.798553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.798657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.798682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.798818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.799026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.799050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.799181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.799308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.799333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.799465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.799578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.799604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.799734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.799867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.799892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.799998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.800121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.800148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.800294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.800486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.800511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.800651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.800809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.800851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.801067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.801239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.801264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.801398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.801547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.883 [2024-11-28 11:51:45.801579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.883 qpair failed and we were unable to recover it. 00:27:25.883 [2024-11-28 11:51:45.801766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.801897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.801921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.802029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.802178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.802206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.802352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.802498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.802531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.802698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.802831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.802854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.803053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.803207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.803232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.803420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.803570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.803596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.803730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.803836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.803861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.804024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.804179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.804204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.804343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.804493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.804521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.804708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.804803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.804828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.805009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.805227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.805278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.805418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.805569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.805595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.805698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.805831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.805856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.805958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.806092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.806117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.806264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.806375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.806403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.806557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.806665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.806691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.806872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.807018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.807044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.807187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.807300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.807340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.807475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.807606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.807632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.807767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.807924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.807950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.808100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.808242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.808269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.808429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.808558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.808583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.808718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.808917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.808981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.809092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.809263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.809290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.809455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.809610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.809636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.809767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.809895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.809922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.810096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.810265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.810292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.810408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.810550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.810574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.810709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.810850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.884 [2024-11-28 11:51:45.810877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.884 qpair failed and we were unable to recover it. 00:27:25.884 [2024-11-28 11:51:45.811018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.811187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.811214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.811397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.811515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.811546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.811733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.811851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.811878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.812032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.812188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.812212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.812322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.812452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.812477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.812592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.812784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.812809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.812950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.813079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.813106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.813232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.813391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.813415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.813578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.813734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.813758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.813916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.814091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.814115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.814250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.814385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.814411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.814564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.814713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.814740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.814908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.815045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.815073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.815202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.815327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.815352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.815506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.815667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.815694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.815835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.816002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.816029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.816146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.816244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.816269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.816373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.816473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.816497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.816659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.816760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.816786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.816919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.817022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.817045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.817152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.817264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.817287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.817423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.817591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.817621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.817781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.817932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.817961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.818100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.818214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.818240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.818346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.818521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.818554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.818690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.818819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.818845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.818984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.819120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.819146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.819310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.819417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.819442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.819550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.819691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.885 [2024-11-28 11:51:45.819716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.885 qpair failed and we were unable to recover it. 00:27:25.885 [2024-11-28 11:51:45.819848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.819954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.819978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.820109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.820259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.820284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.820420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.820574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.820604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.820737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.820914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.820941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.821054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.821194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.821222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.821358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.821532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.821575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.821685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.821858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.821885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.822015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.822145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.822173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.822361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.822490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.822516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.822632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.822762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.822787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.822954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.823074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.823102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.823312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.823481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.823508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.823713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.823870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.823897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.824053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.824273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.824320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.824497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.824641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.824666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.824829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.824959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.824988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.825158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.825298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.825326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.825473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.825602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.825627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.825729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.825853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.825882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.826054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.826203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.826232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.826455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.826594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.826621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.826752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.826873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.826900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.827062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.827218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.827245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.827377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.827478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.827503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.827644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.827748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.827773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.827905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.828029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.828056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.828237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.828408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.828435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.828568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.828697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.828723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.828874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.829044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.886 [2024-11-28 11:51:45.829073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.886 qpair failed and we were unable to recover it. 00:27:25.886 [2024-11-28 11:51:45.829242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.829351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.829380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.829546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.829681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.829706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.829856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.829967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.829995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.830120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.830307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.830335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.830504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.830669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.830694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.830820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.830966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.830993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.831142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.831260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.831287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.831432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.831617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.831642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.831750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.831892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.831920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.832074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.832205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.832230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.832422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.832545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.832574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.832724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.832902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.832927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.833087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.833221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.833246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.833351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.833476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.833501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.833607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.833739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.833764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.833900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.834086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.834113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.834233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.834375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.834403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.834565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.834703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.834729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.834864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.835027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.835069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.835219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.835332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.835359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.835503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.835631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.835673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.835805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.835938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.835963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.836123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.836274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.836299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.836459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.836653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.836679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.836803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.836963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.836992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.837146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.837290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.837317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.837462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.837645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.837671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.887 [2024-11-28 11:51:45.837806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.837957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.887 [2024-11-28 11:51:45.837999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.887 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.838114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.838234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.838264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.838378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.838562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.838588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.838735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.838841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.838866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.839049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.839203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.839228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.839355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.839512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.839543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.839642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.839767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.839792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.839894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.840055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.840080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.840209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.840351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.840376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.840513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.840672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.840715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.840856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.841007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.841032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.841160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.841294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.841319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.841452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.841581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.841607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.841763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.841905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.841945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.842076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.842184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.842209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.842345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.842493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.842521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.842648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.842756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.842781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.842913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.843066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.843094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.843218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.843351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.843376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.843562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.843676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.843704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.843859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.843956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.843981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.844079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.844185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.844212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.844344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.844472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.844500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.844679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.844816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.844841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.845017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.845190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.845218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.845366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.845513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.845547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.845734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.845866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.888 [2024-11-28 11:51:45.845891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.888 qpair failed and we were unable to recover it. 00:27:25.888 [2024-11-28 11:51:45.845996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.846129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.846154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.846314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.846458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.846499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.846616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.846723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.846749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.846877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.847009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.847034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.847154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.847324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.847352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.847541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.847677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.847702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.847827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.847984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.848025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.848167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.848281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.848310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.848485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.848654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.848680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.848843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.848977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.849001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.849103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.849233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.849258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.849387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.849489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.849515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.849649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.849755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.849780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.849931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.850041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.850068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.850235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.850368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.850393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.850500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.850638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.850663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.850838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.850976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.851004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.851184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.851311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.851336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.851475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.851608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.851633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.851790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.851945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.851969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.852079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.852188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.852213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.852372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.852501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.852563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.852710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.852841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.852870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.853028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.853164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.853192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.853327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.853431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.853456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.853636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.853787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.853815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.853955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.854114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.854139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.854246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.854358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.854382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.854543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.854651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.889 [2024-11-28 11:51:45.854676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.889 qpair failed and we were unable to recover it. 00:27:25.889 [2024-11-28 11:51:45.854839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.854973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.854998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.855124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.855255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.855280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.855440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.855587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.855615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.855764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.855909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.855937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.856061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.856167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.856192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.856309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.856443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.856470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.856597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.856758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.856782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.856912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.857042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.857067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.857197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.857339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.857367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.857490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.857630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.857656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.857790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.857922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.857947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.858082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.858194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.858222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.858380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.858510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.858541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.858657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.858790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.858816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.858945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.859097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.859121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.859251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.859343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.859386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.859543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.859675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.859699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.859892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.860048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.860073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.860176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.860332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.860359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.860494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.860649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.860676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.860842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.860981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.861009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.861157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.861298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.861340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.861477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.861614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.861639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.861786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.861953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.861977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.862078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.862233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.862257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.862403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.862531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.862557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.862696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.862845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.862873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.862997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.863140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.863168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.863348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.863478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.863517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.890 qpair failed and we were unable to recover it. 00:27:25.890 [2024-11-28 11:51:45.863683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.890 [2024-11-28 11:51:45.863788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.863813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.863963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.864104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.864132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.864284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.864384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.864408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.864561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.864661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.864689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.864862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.864981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.865009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.865155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.865265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.865290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.865453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.865578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.865606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.865753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.865867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.865894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.866022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.866175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.866200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.866336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.866436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.866461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.866562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.866741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.866769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.866953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.867050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.867075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.867201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.867351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.867379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.867534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.867673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.867698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.867832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.867989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.868018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.868122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.868257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.868281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.868437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.868570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.868596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.868760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.868944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.868971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.869127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.869292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.869318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.869466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.869581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.869608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.869765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.869869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.869895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.870062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.870192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.870217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.870342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.870497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.870522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.870660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.870756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.870781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.870944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.871047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.871075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.871215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.871317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.871341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.871473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.871603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.871627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.871768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.871875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.871898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.872000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.872119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.872146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.891 qpair failed and we were unable to recover it. 00:27:25.891 [2024-11-28 11:51:45.872265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.891 [2024-11-28 11:51:45.872397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.872421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.872589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.872698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.872722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.872829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.872987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.873014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.873193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.873325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.873349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.873511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.873662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.873689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.873830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.873968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.873995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.874158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.874318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.874359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.874478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.874680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.874705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.874840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.874968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.874995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.875126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.875253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.875278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.875455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.875611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.875636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.875736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.875926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.875950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.876058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.876215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.876239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.876388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.876544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.876573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.876730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.876889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.876913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.877047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.877146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.877170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.877351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.877469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.877496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.877658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.877786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.877810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.877915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.878046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.878070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.878245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.878342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.878365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.878498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.878663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.878688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.878857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.878983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.879008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.879163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.879268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.879294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.879439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.879595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.879620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.879748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.879910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.879934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.880092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.880192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.880217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.892 qpair failed and we were unable to recover it. 00:27:25.892 [2024-11-28 11:51:45.880318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.892 [2024-11-28 11:51:45.880452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.880478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.880633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.880764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.880789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.880946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.881102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.881129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.881260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.881367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.881391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.881502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.881635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.881659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.881808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.881944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.881970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.882127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.882237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.882262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.882396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.882532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.882558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.882699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.882852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.882884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.883029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.883174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.883200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.883360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.883491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.883516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.883685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.883825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.883853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.883999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.884117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.884143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.884297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.884454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.884478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.884642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.884787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.884812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.884913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.885071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.885095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.885204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.885346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.885372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.885518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.885677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.885703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.885835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.885931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.885956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.886089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.886248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.886289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.886421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.886523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.886559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.886703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.886854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.886879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.887017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.887175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.887200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.887352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.887515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.887580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.887721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.887915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.887941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.888101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.888237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.888278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.888398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.888566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.888593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.888729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.888847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.888874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.889032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.889184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.893 [2024-11-28 11:51:45.889234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.893 qpair failed and we were unable to recover it. 00:27:25.893 [2024-11-28 11:51:45.889413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.894 [2024-11-28 11:51:45.889604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.894 [2024-11-28 11:51:45.889632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.894 qpair failed and we were unable to recover it. 00:27:25.894 [2024-11-28 11:51:45.889744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.894 [2024-11-28 11:51:45.889899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.894 [2024-11-28 11:51:45.889926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.894 qpair failed and we were unable to recover it. 00:27:25.894 [2024-11-28 11:51:45.890058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.894 [2024-11-28 11:51:45.890169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.894 [2024-11-28 11:51:45.890193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.894 qpair failed and we were unable to recover it. 00:27:25.894 [2024-11-28 11:51:45.890340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.894 [2024-11-28 11:51:45.890491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.894 [2024-11-28 11:51:45.890515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.894 qpair failed and we were unable to recover it. 00:27:25.894 [2024-11-28 11:51:45.890645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.894 [2024-11-28 11:51:45.890775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.894 [2024-11-28 11:51:45.890800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.894 qpair failed and we were unable to recover it. 00:27:25.894 [2024-11-28 11:51:45.890951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.894 [2024-11-28 11:51:45.891066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.894 [2024-11-28 11:51:45.891103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:25.894 qpair failed and we were unable to recover it. 00:27:25.894 [2024-11-28 11:51:45.891318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.891466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.891494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.891630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.891764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.891789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.891901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.891998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.892022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.892132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.892253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.892280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.892403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.892558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.892586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.892717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.892818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.892842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.893031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.893176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.893203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.893315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.893487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.893514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.893703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.893804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.893844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.894011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.894114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.894138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.894294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.894406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.894434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.894561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.894720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.894745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.894881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.894998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.895040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.895201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.895366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.895393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.895561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.895671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.895697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.895831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.895925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.895950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.896112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.896248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.896277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.896451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.896569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.896610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.896747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.896920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.896947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.897104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.897238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.897263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.897452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.897608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.897633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.897763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.897926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.897950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.898107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.898212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.898241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.898408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.898592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.898618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.898728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.898878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.898904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.172 qpair failed and we were unable to recover it. 00:27:26.172 [2024-11-28 11:51:45.899041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.172 [2024-11-28 11:51:45.899145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.899172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.899339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.899486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.899514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.899684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.899819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.899844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.899954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.900111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.900135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.900271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.900372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.900397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.900538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.900691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.900718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.900838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.900963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.900990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.901141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.901250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.901275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.901382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.901514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.901545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.901726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.901872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.901901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.902030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.902155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.902179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.902363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.902508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.902558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.902708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.902878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.902905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.903038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.903147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.903173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.903321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.903463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.903492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.903617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.903778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.903803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.903958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.904088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.904129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.904319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.904450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.904474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.904607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.904734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.904759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.904924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.905054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.905097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.905258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.905417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.905441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.905621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.905764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.905792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.905952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.906110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.906152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.906308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.906462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.906486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.906670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.906808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.906832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.906943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.907071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.907096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.907245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.907393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.907421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.907536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.907688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.907713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.907843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.907943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.907967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.173 qpair failed and we were unable to recover it. 00:27:26.173 [2024-11-28 11:51:45.908090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.173 [2024-11-28 11:51:45.908204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.908230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.908379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.908518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.908553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.908713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.908817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.908841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.909007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.909136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.909160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.909286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.909399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.909427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.909592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.909725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.909750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.909885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.910066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.910091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.910225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.910330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.910354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.910478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.910575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.910600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.910760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.910915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.910941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.911086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.911243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.911267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.911411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.911546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.911587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.911772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.911899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.911923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.912056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.912207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.912233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.912387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.912485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.912509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.912670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.912814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.912842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.912990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.913120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.913146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.913276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.913432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.913457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.913641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.913817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.913841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.913973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.914124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.914153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.914314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.914446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.914471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.914606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.914761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.914788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.914929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.915077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.915101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.915197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.915358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.915382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.915536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.915687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.915715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.915825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.915966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.915990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.916125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.916241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.916266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.916397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.916538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.916564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.916670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.916803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.916828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.174 qpair failed and we were unable to recover it. 00:27:26.174 [2024-11-28 11:51:45.916935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.174 [2024-11-28 11:51:45.917063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.917088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.917274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.917441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.917468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.917621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.917750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.917775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.917971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.918095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.918135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.918276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.918434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.918463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.918598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.918727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.918752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.918880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.919035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.919060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.919213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.919357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.919385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.919538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.919672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.919696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.919797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.919930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.919955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.920095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.920196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.920221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.920320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.920451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.920475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.920609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.920742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.920767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.920954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.921063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.921093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.921246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.921382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.921410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.921558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.921654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.921679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.921833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.922007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.922036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.922181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.922285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.922313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.922470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.922601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.922628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.922787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.922896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.922938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.923098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.923243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.923271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.923406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.923536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.923562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.923686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.923839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.923864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.923994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.924151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.924178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.924333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.924465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.924490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.924650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.924773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.924798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.924903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.925045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.925073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.925257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.925427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.925455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.175 [2024-11-28 11:51:45.925604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.925745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.175 [2024-11-28 11:51:45.925772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.175 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.925923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.926033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.926057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.926213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.926310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.926334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.926470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.926620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.926647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.926769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.926905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.926932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.927081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.927235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.927259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.927410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.927531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.927560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.927705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.927903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.927961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.928079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.928205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.928229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.928383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.928496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.928523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.928691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.928819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.928844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.928976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.929097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.929123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.929293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.929466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.929493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.929651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.929780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.929804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.929960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.930092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.930134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.930299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.930469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.930497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.930645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.930777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.930801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.930939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.931068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.931092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.931264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.931367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.931391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.931492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.931631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.931656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.931789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.931920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.931946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.932071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.932251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.932277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.932441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.932569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.932594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.932727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.932831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.932855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.932977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.933082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.933109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.176 qpair failed and we were unable to recover it. 00:27:26.176 [2024-11-28 11:51:45.933268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.933396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.176 [2024-11-28 11:51:45.933421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.933530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.933635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.933660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.933789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.933906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.933950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.934086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.934241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.934269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.934449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.934622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.934649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.934808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.934965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.934990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.935136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.935244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.935285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.935420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.935521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.935551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.935689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.935823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.935847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.935960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.936111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.936138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.936284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.936418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.936442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.936545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.936650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.936675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.936779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.936887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.936915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.937014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.937141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.937164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.937315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.937434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.937461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.937609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.937782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.937809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.937965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.938089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.938115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.938216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.938342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.938367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.938545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.938712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.938736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.938868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.938998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.939022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.939153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.939283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.939307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.939411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.939573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.939597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.939732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.939838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.939862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.940018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.940161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.940189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.940313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.940428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.940469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.940573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.940708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.940733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.940895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.941025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.941049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.941233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.941378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.941406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.941557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.941719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.941761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.177 qpair failed and we were unable to recover it. 00:27:26.177 [2024-11-28 11:51:45.941902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.177 [2024-11-28 11:51:45.942014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.942040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.942184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.942357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.942384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.942513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.942690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.942716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.942856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.943001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.943031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.943187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.943343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.943367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.943479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.943586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.943611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.943742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.943843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.943867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.943996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.944125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.944149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.944255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.944369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.944393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.944565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.944695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.944719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.944823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.944986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.945010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.945150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.945276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.945301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.945447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.945602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.945628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.945794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.945926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.945950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.946110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.946242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.946287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.946433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.946572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.946600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.946724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.946898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.946923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.947032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.947163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.947188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.947328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.947497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.947531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.947653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.947800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.947827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.947975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.948086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.948111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.948222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.948346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.948387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.948508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.948684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.948712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.948865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.949003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.949028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.949189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.949309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.949337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.949493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.949604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.949629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.949766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.949867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.949893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.950018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.950122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.950149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.950271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.950421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.178 [2024-11-28 11:51:45.950451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.178 qpair failed and we were unable to recover it. 00:27:26.178 [2024-11-28 11:51:45.950587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.950742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.950766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.950891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.951008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.951040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.951192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.951349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.951384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.951586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.951731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.951757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.951917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.952095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.952120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.952223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.952389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.952419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.952554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.952658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.952684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.952789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.952916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.952940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.953044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.953174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.953202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.953322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.953456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.953480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.953670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.953773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.953801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.953938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.954091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.954119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.954244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.954381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.954405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.954564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.954699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.954726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.954896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.955010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.955037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.955194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.955298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.955322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.955491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.955680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.955707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.955853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.956020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.956047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.956204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.956408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.956436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.956612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.956783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.956810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.956970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.957126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.957150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.957274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.957399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.957423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.957545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.957689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.957714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.957869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.958008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.958036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.958186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.958316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.958340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.958462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.958608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.958633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.958770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.958909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.958933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.959034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.959136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.959162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.959295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.959453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.179 [2024-11-28 11:51:45.959478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.179 qpair failed and we were unable to recover it. 00:27:26.179 [2024-11-28 11:51:45.959609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.959741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.959765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.959923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.960062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.960086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.960270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.960412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.960439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.960601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.960709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.960736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.960895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.961001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.961027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.961151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.961294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.961322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.961476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.961599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.961624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.961760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.961889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.961913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.962047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.962196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.962223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.962364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.962509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.962563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.962721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.962880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.962904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.963103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.963245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.963270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.963423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.963584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.963611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.963769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.963903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.963928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.964060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.964241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.964268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.964446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.964576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.964600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.964710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.964842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.964866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.965046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.965196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.965224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.965367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.965520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.965554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.965681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.965788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.965813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.965985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.966144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.966168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.966304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.966435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.966460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.966564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.966700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.966724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.966824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.966921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.966945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.967047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.967152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.967177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.967315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.967440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.967466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.967621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.967752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.967777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.967925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.968051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.968083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.180 qpair failed and we were unable to recover it. 00:27:26.180 [2024-11-28 11:51:45.968241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.968344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.180 [2024-11-28 11:51:45.968368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.968478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.968630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.968657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.968800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.968914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.968943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.969061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.969219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.969244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.969358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.969510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.969542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.969650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.969774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.969798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.969952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.970049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.970072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.970229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.970370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.970396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.970511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.970669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.970693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.970854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.970984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.971008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.971199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.971344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.971370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.971489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.971613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.971640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.971794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.971930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.971954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.972119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.972223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.972250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.972410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.972588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.972616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.972762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.972898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.972922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.973065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.973211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.973239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.973351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.973492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.973519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.973682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.973787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.973811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.973915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.974016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.974058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.974234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.974361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.974386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.974543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.974715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.974744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.974897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.975069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.975096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.975211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.975358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.975386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.975548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.975645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.975671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.975818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.975952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.975980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.181 qpair failed and we were unable to recover it. 00:27:26.181 [2024-11-28 11:51:45.976124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.181 [2024-11-28 11:51:45.976309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.976333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.976461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.976596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.976621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.976750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.976900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.976925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.977050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.977227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.977254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.977408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.977541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.977567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.977745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.977850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.977875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.978006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.978186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.978214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.978368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.978539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.978581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.978723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.978869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.978896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.979039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.979179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.979207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.979336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.979467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.979491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.979615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.979776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.979803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.979962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.980071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.980095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.980222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.980350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.980375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.980475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.980641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.980670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.980816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.980950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.980975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.981135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.981243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.981269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.981434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.981580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.981608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.981719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.981892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.981920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.982079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.982207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.982232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.982382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.982539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.982564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.982695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.982887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.982912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.983015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.983146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.983170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.983278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.983409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.983433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.983535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.983662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.983691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.983834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.983961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.983985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.984156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.984288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.984314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.984463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.984607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.984636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.984788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.984948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.984987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.182 qpair failed and we were unable to recover it. 00:27:26.182 [2024-11-28 11:51:45.985113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.182 [2024-11-28 11:51:45.985280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.985307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.985482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.985674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.985702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.985827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.985962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.985987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.986155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.986312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.986336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.986469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.986641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.986669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.986797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.986902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.986931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.987068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.987215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.987243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.987429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.987560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.987585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.987691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.987845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.987869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.987978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.988118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.988142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.988268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.988391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.988418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.988586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.988746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.988789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.988936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.989060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.989084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.989246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.989400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.989427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.989614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.989745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.989769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.989931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.990102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.990128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.990301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.990468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.990494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.990633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.990735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.990759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.990889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.991049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.991074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.991204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.991320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.991350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.991489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.991625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.991651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.991763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.991886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.991913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.992059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.992208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.992235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.992367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.992496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.992520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.992720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.992841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.992869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.993028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.993159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.993183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.993317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.993421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.993446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.993582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.993738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.993767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.993926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.994061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.994085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.183 qpair failed and we were unable to recover it. 00:27:26.183 [2024-11-28 11:51:45.994215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.183 [2024-11-28 11:51:45.994345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.994369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.994551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.994686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.994715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.994853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.995007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.995035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.995192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.995305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.995329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.995457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.995588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.995613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.995740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.995892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.995919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.996075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.996208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.996232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.996368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.996533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.996560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.996749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.996910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.996936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.997092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.997262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.997290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.997442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.997558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.997585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.997736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.997847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.997873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.998001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.998098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.998121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.998256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.998416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.998441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.998590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.998762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.998790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.998948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.999105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.999129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.999297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.999442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.999471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.999607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.999716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.999741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:45.999840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:45.999997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.000022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:46.000155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.000325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.000350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:46.000502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.000649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.000677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:46.000811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.000940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.000965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:46.001090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.001198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.001225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:46.001368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.001483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.001511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:46.001648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.001783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.001808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:46.001943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.002093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.002121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:46.002275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.002384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.002408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:46.002552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.002678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.002707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:46.002840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.002990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.003017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.184 qpair failed and we were unable to recover it. 00:27:26.184 [2024-11-28 11:51:46.003191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-28 11:51:46.003340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.003368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.003491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.003626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.003651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.003785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.003892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.003916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.004012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.004108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.004133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.004300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.004473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.004500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.004625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.004782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.004807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.004940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.005121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.005149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.005301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.005455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.005499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.005636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.005756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.005783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.005932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.006102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.006129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.006303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.006424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.006466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.006609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.006730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.006757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.006898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.007040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.007067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.007245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.007376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.007400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.007558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.007697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.007722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.007868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.008002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.008029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.008191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.008321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.008362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.008486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.008641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.008668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.008851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.009017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.009045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.009244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.009374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.009399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.009547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.009705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.009729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.009833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.009955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.009982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.010114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.010242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.010265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.010393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.010562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.010601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.010746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.010917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.010944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.011123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.011233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.011257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.185 qpair failed and we were unable to recover it. 00:27:26.185 [2024-11-28 11:51:46.011356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-28 11:51:46.011514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.011545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.011705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.011879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.011907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.012058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.012190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.012214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.012376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.012516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.012548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.012669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.012814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.012841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.013002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.013109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.013134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.013267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.013387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.013415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.013569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.013724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.013750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.013879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.014044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.014069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.014168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.014316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.014342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.014588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.014743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.014768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.014926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.015054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.015098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.015269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.015439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.015467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.015612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.015789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.015817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.015944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.016080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.016105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.016287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.016457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.016485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.016600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.016751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.016776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.016910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.017044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.017069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.017258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.017423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.017448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.017599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.017781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.017808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.017961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.018092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.018117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.018273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.018445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.018473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.018630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.018789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.018814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.018978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.019082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.019111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.019256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.019402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.019429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.019566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.019723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.019748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.019925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.020082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.020124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.020278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.020434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.020459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.020592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.020723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.020750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.186 qpair failed and we were unable to recover it. 00:27:26.186 [2024-11-28 11:51:46.020901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-28 11:51:46.021054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.021095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.021250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.021403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.021428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.021557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.021715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.021742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.021899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.022001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.022026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.022177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.022337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.022361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.022521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.022692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.022721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.022867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.022992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.023018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.023135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.023291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.023316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.023451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.023619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.023648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.023774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.023883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.023908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.024104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.024245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.024273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.024422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.024537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.024580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.024725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.024863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.024887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.025031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.025156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.025182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.025298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.025473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.025497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.025639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.025747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.025771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.025922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.026091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.026119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.026276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.026382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.026407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.026537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.026666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.026691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.026818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.026960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.026984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.027107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.027253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.027280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.027441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.027566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.027592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.027729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.027905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.027931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.028049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.028224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.028249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.028377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.028506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.028537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.028679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.028811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.028835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.028965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.029121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.029149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.029268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.029402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.029426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.187 qpair failed and we were unable to recover it. 00:27:26.187 [2024-11-28 11:51:46.029608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.187 [2024-11-28 11:51:46.029751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.029779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.029927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.030112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.030137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.030296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.030397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.030420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.030553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.030722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.030746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.030879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.031058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.031086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.031212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.031348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.031373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.031506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.031638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.031666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.031778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.031934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.031961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.032090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.032220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.032244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.032344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.032499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.032534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.032687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.032832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.032858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.033005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.033109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.033134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.033284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.033424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.033451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.033608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.033740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.033765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.033952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.034149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.034190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.034324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.034483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.034533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.034689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.034863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.034891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.035003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.035150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.035180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.035328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.035473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.035498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.035623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.035743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.035768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.035896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.036002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.036045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.036205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.036316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.036342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.036504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.036691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.036720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.036878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.037010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.037035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.037192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.037310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.037338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.037482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.037639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.037667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.037819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.037934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.037961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.038142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.038249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.038290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.038440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.038594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.038619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.188 qpair failed and we were unable to recover it. 00:27:26.188 [2024-11-28 11:51:46.038722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.188 [2024-11-28 11:51:46.038835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.038861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.038967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.039119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.039146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.039302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.039436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.039462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.039623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.039773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.039801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.039941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.040110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.040137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.040283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.040428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.040455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.040628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.040755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.040780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.040937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.041102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.041127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.041265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.041408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.041432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.041580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.041713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.041737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.041934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.042073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.042114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.042236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.042383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.042411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.042552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.042705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.042730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.042903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.043148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.043201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.043331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.043443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.043467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.043624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.043743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.043770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.043893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.044026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.044050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.044191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.044371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.044398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.044556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.044684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.044709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.044907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.045039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.045063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.045194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.045344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.045370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.045604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.045808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.045835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.045990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.046123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.046147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.046255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.046364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.046389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.046551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.046716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.046744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.046899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.047012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.047041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.047174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.047328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.047353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.047484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.047626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.047650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.047810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.047947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.047971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.189 qpair failed and we were unable to recover it. 00:27:26.189 [2024-11-28 11:51:46.048072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.189 [2024-11-28 11:51:46.048197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.048225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.048409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.048537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.048588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.048745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.048874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.048898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.049004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.049194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.049221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.049394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.049501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.049534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.049676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.049808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.049834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.050011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.050151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.050178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.050328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.050470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.050496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.050623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.050768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.050797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.050924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.051057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.051081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.051273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.051390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.051422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.051567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.051709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.051736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.051974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.052096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.052125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.052279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.052404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.052428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.052618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.052788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.052859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.052986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.053149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.053174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.053298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.053419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.053446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.053579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.053713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.053739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.053882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.054026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.054050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.054205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.054315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.054343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.054489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.054608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.054655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.054773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.054902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.054926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.055049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.055184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.055212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.055367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.055466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.055491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.055656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.055777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.055806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.190 [2024-11-28 11:51:46.055977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.056109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.190 [2024-11-28 11:51:46.056133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.190 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.056304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.056412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.056437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.056569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.056671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.056695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.056821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.056988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.057015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.057191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.057344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.057387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.057514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.057649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.057674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.057791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.057922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.057947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.058052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.058155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.058179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.058308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.058472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.058515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.058702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.058877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.058901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.059016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.059175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.059200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.059381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.059581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.059607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.059736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.059868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.059893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.060037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.060144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.060185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.060320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.060420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.060445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.060626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.060771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.060799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.060932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.061068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.061092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.061251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.061393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.061421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.061572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.061681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.061709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.061863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.061996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.062021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.062152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.062279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.062304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.062473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.062631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.062656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.062821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.062984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.063008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.063217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.063380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.063409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.063564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.063698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.063723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.063909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.064045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.064088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.064214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.064414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.064442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.064623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.064829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.064857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.064974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.065111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.065137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.065309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.065416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.191 [2024-11-28 11:51:46.065440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.191 qpair failed and we were unable to recover it. 00:27:26.191 [2024-11-28 11:51:46.065600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.065754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.065779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.065909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.066087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.066112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.066270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.066369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.066393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.066532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.066657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.066686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.066845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.066977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.067002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.067149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.067274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.067298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.067427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.067573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.067599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.067736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.067867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.067892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.068041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.068213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.068241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.068393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.068504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.068537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.068676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.068809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.068834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.068943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.069076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.069099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.069256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.069398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.069425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.069609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.069714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.069739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.069874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.070032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.070074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.070248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.070404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.070429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.070602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.070736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.070765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.070925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.071147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.071174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.071308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.071409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.071433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.071569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.071676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.071700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.071848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.071962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.071991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.072140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.072307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.072332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.072464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.072563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.072587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.072693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.072828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.072854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.073009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.073152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.073179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.073333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.073452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.073479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.073618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.073777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.073801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.073958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.074063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.074089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.074246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.074386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.192 [2024-11-28 11:51:46.074414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.192 qpair failed and we were unable to recover it. 00:27:26.192 [2024-11-28 11:51:46.074537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.074700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.074724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.074853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.075004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.075044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.075211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.075365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.075393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.075556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.075678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.075706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.075818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.075927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.075955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.076114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.076245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.076269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.076394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.076500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.076535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.076700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.076802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.076827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.076935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.077045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.077069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.077203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.077307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.077331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.077474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.077621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.077648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.077822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.077947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.077971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.078140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.078239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.078264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.078370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.078499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.078531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.078657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.078765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.078793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.078964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.079136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.079163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.079308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.079446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.079473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.079639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.079743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.079767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.079901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.080040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.080065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.080173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.080324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.080353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.080497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.080644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.080674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.080827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.080959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.080983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.081116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.081233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.081261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.081375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.081544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.081572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.081790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.082053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.082105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.082257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.082391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.082415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.082594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.082700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.082724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.082856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.083004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.083046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.083158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.083278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.193 [2024-11-28 11:51:46.083303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.193 qpair failed and we were unable to recover it. 00:27:26.193 [2024-11-28 11:51:46.083435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.083557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.083583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.083686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.083808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.083832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.083936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.084043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.084066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.084175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.084302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.084327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.084437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.084562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.084588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.084746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.084863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.084891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.085046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.085205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.085230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.085379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.085558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.085582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.085711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.085840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.085864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.086019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.086134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.086166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.086318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.086424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.086466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.086597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.086715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.086742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.086875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.087030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.087054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.087241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.087397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.087422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.087560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.087665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.087690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.087822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.087956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.087980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.088088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.088211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.088235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.088382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.088517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.088552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.088664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.088843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.088868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.089005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.089197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.089222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.089326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.089480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.089506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.089643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.089773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.089799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.089981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.090137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.090164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.090339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.090500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.090535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.090732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.090863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.090888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.091045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.091164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.194 [2024-11-28 11:51:46.091190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.194 qpair failed and we were unable to recover it. 00:27:26.194 [2024-11-28 11:51:46.091334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.091478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.091506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.091649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.091806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.091831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.091937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.092068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.092093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.092246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.092360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.092387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.092550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.092659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.092683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.092828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.092975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.093002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.093156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.093269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.093294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.093426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.093596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.093624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.093791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.093934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.093976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.094106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.094254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.094282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.094457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.094579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.094604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.094735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.094920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.094945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.095079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.095225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.095254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.095400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.095519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.095571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.095701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.095815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.095840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.095995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.096138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.096165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.096339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.096481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.096508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.096658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.096835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.096860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.096964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.097123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.097147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.097346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.097513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.097545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.097708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.097887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.097942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.098173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.098316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.098348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.098504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.098648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.098673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.098784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.098931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.098959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.099103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.099253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.099277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.099438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.099613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.099640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.099805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.099905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.099929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.100034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.100155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.100180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.100280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.100382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.195 [2024-11-28 11:51:46.100407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.195 qpair failed and we were unable to recover it. 00:27:26.195 [2024-11-28 11:51:46.100516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.100675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.100705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.100857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.100990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.101016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.101159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.101301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.101341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.101498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.101613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.101639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.101792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.101911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.101938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.102119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.102299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.102332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.102502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.102621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.102649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.102818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.102955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.102982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.103160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.103289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.103313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.103437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.103562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.103588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.103683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.103805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.103829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.103963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.104115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.104142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.104255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.104396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.104424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.104575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.104730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.104755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.104926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.105024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.105049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.105147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.105273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.105305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.105494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.105624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.105649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.105761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.105884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.105910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.106039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.106164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.106189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.106339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.106484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.106511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.106643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.106782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.106810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.106963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.107101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.107127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.107269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.107382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.107410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.107583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.107741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.107769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.107931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.108044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.108071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.108175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.108299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.108324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.108448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.108602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.108627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.108787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.108940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.108968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.109133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.109233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.196 [2024-11-28 11:51:46.109257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.196 qpair failed and we were unable to recover it. 00:27:26.196 [2024-11-28 11:51:46.109390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.109496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.109521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.109656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.109773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.109800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.109983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.110140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.110164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.110336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.110478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.110503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.110636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.110768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.110792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.110952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.111126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.111150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.111284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.111408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.111431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.111582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.111761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.111785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.111921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.112023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.112046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.112156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.112330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.112358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.112509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.112657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.112686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.112833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.112964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.112989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.113150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.113295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.113319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.113422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.113530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.113555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.113657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.113816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.113840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.113968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.114081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.114107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.114263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.114394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.114419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.114604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.114756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.114784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.114902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.115079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.115103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.115236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.115375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.115399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.115547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.115677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.115701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.115811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.115967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.115994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.116132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.116252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.116279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.116456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.116610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.116659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.116809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.116937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.116962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.117070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.117200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.117224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.117373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.117542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.117570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.117720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.117822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.117848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.197 qpair failed and we were unable to recover it. 00:27:26.197 [2024-11-28 11:51:46.118011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.197 [2024-11-28 11:51:46.118183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.118210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.118350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.118469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.118495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.118648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.118825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.118851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.119016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.119150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.119174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.119310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.119448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.119473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.119584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.119717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.119741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.119874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.120012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.120038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.120158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.120324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.120350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.120540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.120713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.120741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.120882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.121020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.121052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.121160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.121300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.121327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.121474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.121594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.121618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.121726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.121850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.121874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.122030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.122138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.122166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.122267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.122446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.122473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.122623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.122781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.122805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.122948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.123082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.123107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.123296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.123467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.123495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.123649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.123779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.123803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.123979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.124077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.124101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.124238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.124343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.124367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.124547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.124729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.124757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.124942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.125097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.125121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.125284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.125427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.125453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.125603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.125711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.125735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.125888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.126042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.126066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.126202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.126357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.126384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.126549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.126669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.126696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.126830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.126960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.126984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.198 qpair failed and we were unable to recover it. 00:27:26.198 [2024-11-28 11:51:46.127134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.127275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.198 [2024-11-28 11:51:46.127302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.127420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.127563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.127598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.127712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.127862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.127888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.128043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.128151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.128175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.128336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.128510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.128544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.128672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.128780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.128804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.128958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.129089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.129114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.129222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.129346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.129371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.129494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.129618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.129644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.129803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.129937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.129961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.130119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.130267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.130293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.130446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.130640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.130685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.130827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.130972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.130996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.131147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.131291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.131319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.131464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.131622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.131647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.131779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.131907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.131931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.132065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.132178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.132205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.132351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.132532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.132557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.132693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.132797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.132821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.132923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.133081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.133106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.133236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.133388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.133412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.133551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.133695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.133721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.133828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.133960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.133986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.134123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.134233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.134259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.134393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.134516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.134554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.134702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.134870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.134897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.199 qpair failed and we were unable to recover it. 00:27:26.199 [2024-11-28 11:51:46.135082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.199 [2024-11-28 11:51:46.135239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.135280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.135458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.135567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.135592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.135725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.135873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.135899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.136007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.136180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.136207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.136357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.136474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.136502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.136664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.136794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.136823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.136955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.137097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.137124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.137296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.137451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.137475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.137604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.137706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.137731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.137835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.137931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.137955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.138085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.138233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.138258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.138440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.138577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.138606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.138802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.138955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.138979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.139148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.139278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.139303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.139473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.139606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.139632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.139780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.139893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.139920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.140185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.140363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.140387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.140547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.140721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.140748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.140922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.141116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.141170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.141320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.141462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.141490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.141617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.141775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.141800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.141959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.142065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.142090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.142287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.142403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.142430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.142576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.142729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.142757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.142938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.143168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.143217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.143392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.143522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.143573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.143699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.143842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.143874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.143996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.144138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.144179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.144286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.144410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.144435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.200 qpair failed and we were unable to recover it. 00:27:26.200 [2024-11-28 11:51:46.144572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.200 [2024-11-28 11:51:46.144703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.144728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.144889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.145028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.145056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.145230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.145415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.145440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.145573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.145707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.145735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.145888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.145987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.146011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.146166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.146302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.146348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.146478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.146648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.146677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.146840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.146970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.146995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.147125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.147257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.147283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.147417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.147534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.147563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.147744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.147868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.147892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.148024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.148201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.148228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.148408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.148542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.148584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.148693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.148839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.148866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.148981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.149125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.149155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.149304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.149488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.149513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.149658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.149769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.149794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.149897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.150023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.150048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.150183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.150332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.150359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.150501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.150611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.150639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.150767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.150898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.150921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.151095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.151236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.151263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.151378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.151522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.151557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.151677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.151858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.151883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.152018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.152147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.152171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.152294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.152426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.152454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.152573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.152716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.152743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.152919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.153050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.153078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.153234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.153365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.153406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.201 qpair failed and we were unable to recover it. 00:27:26.201 [2024-11-28 11:51:46.153531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.201 [2024-11-28 11:51:46.153647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.153675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.153845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.154028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.154085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.154195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.154338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.154366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.154549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.154680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.154704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.154894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.155036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.155063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.155214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.155309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.155335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.155446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.155637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.155663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.155794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.155953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.155994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.156140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.156283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.156314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.156486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.156661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.156690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.156825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.156967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.156994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.157121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.157254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.157279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.157451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.157609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.157634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.157778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.157897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.157925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.158068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.158183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.158227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.158335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.158486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.158511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.158696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.158811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.158852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.158954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.159100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.159126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.159250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.159394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.159421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.159604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.159739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.159765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.159897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.160017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.160044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.160185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.160303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.160344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.160476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.160630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.160659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.160808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.160907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.160932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.161064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.161193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.161217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.161328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.161468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.161495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.161662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.161763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.161787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.161917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.162043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.162067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.162228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.162380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.162405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.202 qpair failed and we were unable to recover it. 00:27:26.202 [2024-11-28 11:51:46.162515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.202 [2024-11-28 11:51:46.162672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.162700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.162840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.162963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.162988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.163145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.163239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.163264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.163388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.163536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.163564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.163696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.163827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.163851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.164028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.164216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.164242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.164374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.164508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.164541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.164671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.164805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.164829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.164957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.165140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.165167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.165316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.165451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.165478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.165610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.165744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.165770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.165875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.166071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.166099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.166220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.166411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.166436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.166568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.166717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.166745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.166900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.167029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.167054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.167210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.167345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.167374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.167537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.167647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.167671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.167799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.167948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.167974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.168151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.168274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.168298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.168432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.168532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.168558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.168708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.168838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.168871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.169021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.169171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.169196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.169330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.169463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.169487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.169619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.169724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.169767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.169914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.170021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.170048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.170219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.170334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.170362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.170511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.170636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.170662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.203 qpair failed and we were unable to recover it. 00:27:26.203 [2024-11-28 11:51:46.170836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.171022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.203 [2024-11-28 11:51:46.171046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.171178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.171314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.171340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.171497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.171623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.171648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.171787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.171888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.171917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.172073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.172255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.172280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.172438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.172571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.172596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.172745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.172922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.172946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.173111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.173238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.173280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.173413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.173536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.173562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.173718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.173833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.173860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.174071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.174210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.174238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.174365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.174471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.174494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.174659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.174762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.174787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.174942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.175041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.175066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.175204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.175323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.175349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.175499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.175638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.175663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.175817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.175973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.176000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.176130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.176263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.176287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.176445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.176579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.176608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.176734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.176863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.176889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.177036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.177204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.177231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.177378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.177522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.177556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.177703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.177837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.177907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.178065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.178168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.178193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.178349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.178502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.178542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.178670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.178779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.178803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.178907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.179014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.179039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.204 [2024-11-28 11:51:46.179177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.179303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.204 [2024-11-28 11:51:46.179326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.204 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.179459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.179574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.179603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.179723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.179833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.179859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.180038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.180165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.180191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.180320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.180416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.180440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.180544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.180671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.180695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.180798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.180954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.180978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.181132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.181311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.181336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.181437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.181565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.181590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.181723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.181848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.181877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.182021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.182160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.182188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.182339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.182497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.182521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.182672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.182771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.182795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.182961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.183179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.183233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.183350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.183461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.183489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.183624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.183769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.183796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.183949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.184077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.184101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.184247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.184364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.184388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.184493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.184657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.184685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.184803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.184952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.184980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.185133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.185292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.185316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.185451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.185619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.185647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.185789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.185931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.185959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.186182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.186308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.186331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.186469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.186629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.186671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.186795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.186900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.186927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.187101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.187258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.187284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.187390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.187530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.187560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.187692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.187828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.187852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.205 qpair failed and we were unable to recover it. 00:27:26.205 [2024-11-28 11:51:46.188008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.205 [2024-11-28 11:51:46.188185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.188212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.188357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.188497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.188531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.188675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.188793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.188820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.188975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.189105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.189130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.189286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.189428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.189470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.189596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.189750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.189775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.189934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.190107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.190133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.190279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.190436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.190478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.190622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.190780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.190804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.190912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.191060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.191088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.191234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.191375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.191401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.191583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.191716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.191741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.191862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.192005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.192032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.192169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.192291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.192315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.192439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.192569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.192594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.192728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.192866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.192909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.193059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.193177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.193205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.193389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.193547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.193580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.193745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.193923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.193975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.194138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.194268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.194292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.194447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.194591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.194619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.194772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.194888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.194916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.195031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.195179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.195206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.195337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.195469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.195494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.195700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.195835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.195860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.195983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.196124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.196151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.196325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.196506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.196534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.196648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.196782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.196806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.196971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.197125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.197150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.206 qpair failed and we were unable to recover it. 00:27:26.206 [2024-11-28 11:51:46.197263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.197371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.206 [2024-11-28 11:51:46.197396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.197554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.197689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.197715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.197841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.197965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.197991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.198139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.198248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.198276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.198397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.198550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.198582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.198737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.198886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.198913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.199057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.199166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.199191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.199318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.199513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.199545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.199681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.199856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.199883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.200056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.200202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.200229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.200389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.200516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.200563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.200680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.200866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.200891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.201018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.201138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.201166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.201293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.201434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.201461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.201594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.201722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.201747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.201899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.202003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.202030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.202170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.202348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.202373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.202503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.202727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.202752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.202882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.202985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.203010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.203136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.203235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.203260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.203401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.203607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.203644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.203769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.203892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.203921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.204077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.204207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.204232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.204385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.204547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.204580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.204679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.204799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.204826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.205009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.205113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.205149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.205274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.205436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.205462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.205676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.205802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.205828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.206022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.206121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.206146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.207 qpair failed and we were unable to recover it. 00:27:26.207 [2024-11-28 11:51:46.206299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.206412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.207 [2024-11-28 11:51:46.206441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.208 qpair failed and we were unable to recover it. 00:27:26.208 [2024-11-28 11:51:46.206610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.208 [2024-11-28 11:51:46.206754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.208 [2024-11-28 11:51:46.206779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.208 qpair failed and we were unable to recover it. 00:27:26.208 [2024-11-28 11:51:46.206926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.208 [2024-11-28 11:51:46.207062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.208 [2024-11-28 11:51:46.207101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.208 qpair failed and we were unable to recover it. 00:27:26.484 [2024-11-28 11:51:46.207252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.207403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.207428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.484 qpair failed and we were unable to recover it. 00:27:26.484 [2024-11-28 11:51:46.207539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.207676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.207701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.484 qpair failed and we were unable to recover it. 00:27:26.484 [2024-11-28 11:51:46.207847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.208026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.208054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.484 qpair failed and we were unable to recover it. 00:27:26.484 [2024-11-28 11:51:46.208171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.208334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.208359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.484 qpair failed and we were unable to recover it. 00:27:26.484 [2024-11-28 11:51:46.208495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.208629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.208657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.484 qpair failed and we were unable to recover it. 00:27:26.484 [2024-11-28 11:51:46.208802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.208921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.208945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.484 qpair failed and we were unable to recover it. 00:27:26.484 [2024-11-28 11:51:46.209106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.209224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.209248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.484 qpair failed and we were unable to recover it. 00:27:26.484 [2024-11-28 11:51:46.209437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.209569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.209597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.484 qpair failed and we were unable to recover it. 00:27:26.484 [2024-11-28 11:51:46.209744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.209857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.209886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.484 qpair failed and we were unable to recover it. 00:27:26.484 [2024-11-28 11:51:46.210088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.210196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.210221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.484 qpair failed and we were unable to recover it. 00:27:26.484 [2024-11-28 11:51:46.210388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.210489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.210513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.484 qpair failed and we were unable to recover it. 00:27:26.484 [2024-11-28 11:51:46.210670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.210791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.210817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.484 qpair failed and we were unable to recover it. 00:27:26.484 [2024-11-28 11:51:46.210924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.211051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.211075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.484 qpair failed and we were unable to recover it. 00:27:26.484 [2024-11-28 11:51:46.211232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.484 [2024-11-28 11:51:46.211414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.211439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.211600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.211737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.211790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.211944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.212073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.212098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.212224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.212347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.212371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.212500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.212665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.212691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.212835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.212977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.213019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.213140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.213310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.213337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.213450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.213602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.213630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.213749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.213937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.214000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.214180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.214279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.214304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.214467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.214615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.214642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.214799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.214928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.214953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.215181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.215307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.215332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.215439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.215572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.215598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.215783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.215986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.216036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.216175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.216289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.216317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.216459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.216623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.216649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.216784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.216914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.216938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.217042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.217175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.217199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.217325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.217492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.217520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.217704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.217861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.217885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.218039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.218201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.218225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.218411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.218554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.218611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.218713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.218845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.218870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.219026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.219146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.219173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.219327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.219461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.219485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.219655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.219772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.219804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.219964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.220097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.220122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.220230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.220350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.220377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.485 qpair failed and we were unable to recover it. 00:27:26.485 [2024-11-28 11:51:46.220507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.485 [2024-11-28 11:51:46.220641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.220666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.220848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.221027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.221051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.221154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.221334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.221361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.221477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.221647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.221672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.221831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.221961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.221985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.222162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.222320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.222345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.222449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.222576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.222604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.222749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.222927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.222958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.223106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.223207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.223231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.223370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.223515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.223549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.223699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.223849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.223876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.224016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.224186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.224210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.224321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.224454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.224479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.224637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.224780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.224807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.224953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.225096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.225123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.225294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.225409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.225433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.225567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.225696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.225720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.225848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.225974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.225998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.226133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.226258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.226285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.226393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.226512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.226558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.226718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.226884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.226928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.227074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.227189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.227216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.227378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.227510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.227544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.227697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.227844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.227868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.228002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.228106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.228130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.228267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.228412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.228452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.228579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.228701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.228728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.228886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.229009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.229034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.486 [2024-11-28 11:51:46.229176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.229305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.486 [2024-11-28 11:51:46.229330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.486 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.229477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.229614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.229639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.229772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.229926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.229953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.230071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.230215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.230241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.230368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.230498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.230522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.230727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.230885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.230910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.231067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.231216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.231239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.231363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.231515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.231548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.231684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.231782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.231806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.231965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.232106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.232134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.232276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.232448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.232475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.232625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.232800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.232825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.232924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.233027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.233051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.233204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.233341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.233369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.233515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.233634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.233677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.233783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.233886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.233910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.234015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.234146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.234170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.234295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.234432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.234458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.234599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.234746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.234772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.234901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.235094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.235119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.235247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.235386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.235410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.235537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.235644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.235671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.235816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.235990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.236016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.236205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.236307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.236331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.236435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.236568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.236594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.236697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.236867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.236895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.237043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.237181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.237208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.237351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.237519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.237553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.237686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.237781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.237806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.487 [2024-11-28 11:51:46.237945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.238076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.487 [2024-11-28 11:51:46.238101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.487 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.238281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.238425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.238458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.238623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.238760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.238785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.238917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.239020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.239044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.239204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.239319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.239345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.239496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.239632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.239659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.239812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.239954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.239982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.240164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.240269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.240294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.240454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.240597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.240625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.240732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.240913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.240940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.241094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.241246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.241271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.241382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.241479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.241504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.241680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.241811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.241837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.241990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.242122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.242147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.242299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.242447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.242474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.242579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.242678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.242703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.242866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.242994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.243019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.243206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.243323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.243351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.243519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.243712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.243738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.243840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.243966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.243991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.244120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.244263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.244291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.244438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.244589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.244618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.244775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.244876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.244901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.245039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.245176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.245201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.245348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.245488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.245516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.245651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.245767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.245795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.245940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.246058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.246086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.246243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.246368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.246392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.246558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.246699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.246726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.488 qpair failed and we were unable to recover it. 00:27:26.488 [2024-11-28 11:51:46.246840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.246945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.488 [2024-11-28 11:51:46.246973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.247093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.247202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.247230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.247406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.247510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.247540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.247732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.247852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.247896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.248004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.248122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.248149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.248322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.248465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.248493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.248623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.248781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.248806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.248968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.249109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.249136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.249252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.249409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.249434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.249576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.249745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.249770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.249906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.250042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.250067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.250250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.250397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.250425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.250549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.250720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.250747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.251033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.251193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.251222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.251354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.251479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.251504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.251658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.251775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.251803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.251987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.252095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.252122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.252292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.252442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.252467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.252636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.252744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.252768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.252874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.253032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.253057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.253214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.253382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.253408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.253533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.253675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.253702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.253858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.253993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.254017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.254155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.254334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.254369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.254600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.254743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.254771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.489 qpair failed and we were unable to recover it. 00:27:26.489 [2024-11-28 11:51:46.254948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.489 [2024-11-28 11:51:46.255086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.255114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.255231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.255359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.255384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.255508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.255692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.255720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.255866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.256051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.256075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.256233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.256389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.256417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.256549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.256690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.256715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.256831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.256973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.257000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.257146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.257265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.257292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.257402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.257547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.257572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.257685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.257791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.257814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.257954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.258091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.258118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.258231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.258371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.258412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.258542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.258682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.258706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.258836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.258986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.259011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.259142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.259240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.259264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.259369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.259461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.259486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.259630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.259762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.259790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.259928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.260056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.260081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.260269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.260432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.260456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.260599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.260721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.260748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.260966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.261186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.261236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.261412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.261542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.261571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.261728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.261891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.261914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.262024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.262128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.262151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.262283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.262414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.262438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.262570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.262697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.262721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.262857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.262987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.263010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.263112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.263211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.263235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.490 [2024-11-28 11:51:46.263338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.263495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.490 [2024-11-28 11:51:46.263519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.490 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.263641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.263741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.263765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.263871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.264004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.264029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.264179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.264355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.264383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.264517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.264663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.264690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.264858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.265006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.265051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.265172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.265289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.265316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.265437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.265563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.265590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.265782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.265916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.265940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.266042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.266169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.266194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.266349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.266455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.266497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.266642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.266781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.266822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.266992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.267113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.267142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.267304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.267433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.267457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.267604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.267745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.267773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.267917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.268053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.268093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.268230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.268362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.268387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.268519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.268656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.268680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.268785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.268912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.268954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.269100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.269217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.269257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.269431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.269612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.269638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.269766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.269922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.269968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.270124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.270265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.270292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.270469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.270639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.270667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.270849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.270948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.270973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.271128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.271263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.271287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.271386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.271512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.271548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.271673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.271820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.271847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.272088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.272228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.272256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.491 [2024-11-28 11:51:46.272383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.272509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.491 [2024-11-28 11:51:46.272541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.491 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.272679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.272855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.272879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.273039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.273184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.273218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.273393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.273538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.273575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.273709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.273843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.273869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.273993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.274174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.274200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.274343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.274480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.274508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.274635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.274777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.274805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.274977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.275078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.275103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.275256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.275408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.275432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.275576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.275707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.275731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.275835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.275965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.275989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.276100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.276230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.276254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.276407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.276544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.276575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.276700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.276893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.276918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.277052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.277248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.277273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.277407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.277505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.277535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.277673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.277811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.277838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.278007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.278149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.278177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.278299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.278439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.278467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.278590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.278730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.278755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.278858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.279004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.279032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.279193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.279320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.279345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.279511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.279682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.279707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.279818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.279951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.279975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.280151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.280263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.280291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.280411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.280552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.280580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.280686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.280795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.280822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.280990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.281124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.281151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.492 qpair failed and we were unable to recover it. 00:27:26.492 [2024-11-28 11:51:46.281319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.492 [2024-11-28 11:51:46.281434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.281459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.281560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.281689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.281717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.281911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.282009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.282034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.282191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.282301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.282326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.282539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.282672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.282697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.282862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.283023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.283047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.283178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.283330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.283358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.283512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.283634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.283659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.283832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.283973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.284013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.284146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.284298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.284326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.284476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.284612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.284640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.284795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.284923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.284948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.285058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.285203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.285230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.285383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.285490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.285518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.285645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.285819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.285847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.285972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.286191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.286234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.286396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.286552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.286579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.286714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.286882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.286909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.287101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.287274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.287299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.287434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.287536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.287562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.287667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.287804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.287832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.287976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.288126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.288154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.288268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.288407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.288435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.288587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.288730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.288757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.288887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.289031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.493 [2024-11-28 11:51:46.289063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.493 qpair failed and we were unable to recover it. 00:27:26.493 [2024-11-28 11:51:46.289212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.289353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.289380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.289504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.289625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.289666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.289773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.289876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.289901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.290025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.290266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.290294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.290466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.290650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.290675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.290816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.290923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.290948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.291078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.291203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.291228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.291411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.291567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.291594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.291749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.291937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.292006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.292150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.292283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.292309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.292460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.292572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.292597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.292719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.292889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.292916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.293055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.293162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.293186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.293366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.293512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.293552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.293713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.293867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.293908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.294066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.294202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.294226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.294376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.294531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.294556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.294719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.294875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.294902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.295048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.295173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.295196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.295344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.295462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.295489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.295660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.295771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.295796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.295928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.296028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.296053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.296161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.296255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.296279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.296387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.296548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.296576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.296725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.296866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.296893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.297041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.297199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.297223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.297361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.297468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.297494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.297639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.297789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.297816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.298011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.298138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.494 [2024-11-28 11:51:46.298162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.494 qpair failed and we were unable to recover it. 00:27:26.494 [2024-11-28 11:51:46.298349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.298494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.298552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.298718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.298854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.298897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.299044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.299162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.299189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.299308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.299486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.299510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.299624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.299769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.299810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.299939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.300075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.300100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.300229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.300360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.300384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.300539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.300685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.300728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.300888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.301039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.301067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.301222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.301324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.301349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.301506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.301624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.301651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.301814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.301993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.302020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.302163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.302310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.302337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.302485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.302635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.302661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.302798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.302969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.302994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.303115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.303266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.303291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.303390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.303549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.303574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.303712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.303819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.303843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.303961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.304115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.304140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.304276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.304416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.304442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.304626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.304778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.304803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.304961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.305117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.305164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.305323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.305445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.305470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.305607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.305715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.305739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.305904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.306042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.306069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.306180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.306285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.306309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.306493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.306614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.306639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.306789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.306957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.306985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.307127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.307266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.495 [2024-11-28 11:51:46.307293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.495 qpair failed and we were unable to recover it. 00:27:26.495 [2024-11-28 11:51:46.307442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.307596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.307621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.307807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.307922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.307950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.308073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.308239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.308266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.308466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.308580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.308607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.308776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.308882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.308907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.309066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.309217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.309245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.309393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.309577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.309602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.309712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.309846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.309870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.310001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.310130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.310155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.310326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.310482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.310512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.310644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.310786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.310813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.310989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.311177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.311201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.311332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.311433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.311457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.311632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.311777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.311805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.311954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.312063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.312089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.312258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.312404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.312430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.312581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.312691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.312714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.312882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.313125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.313180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.313324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.313484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.313507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.313654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.313805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.313832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.313967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.314100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.314125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.314273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.314390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.314417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.314569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.314730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.314754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.314936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.315056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.315084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.315238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.315362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.315387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.315541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.315674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.315699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.315829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.316004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.316030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.316177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.316295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.316321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.316476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.316604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.496 [2024-11-28 11:51:46.316629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.496 qpair failed and we were unable to recover it. 00:27:26.496 [2024-11-28 11:51:46.316754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.316913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.316938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.317074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.317251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.317275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.317384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.317505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.317537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.317673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.317831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.317855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.318098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.318278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.318305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.318449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.318595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.318624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.318773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.318944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.318971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.319153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.319283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.319324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.319445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.319613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.319641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.319817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.320002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.320026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.320162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.320264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.320289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.320416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.320545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.320570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.320715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.320872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.320898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.321030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.321141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.321166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.321298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.321424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.321456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.321630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.321763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.321804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.321931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.322108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.322132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.322267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.322424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.322452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.322590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.322707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.322732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.322890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.323063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.323090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.323236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.323370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.323397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.323581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.323697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.323725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.323874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.324017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.324044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.324162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.324319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.324343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.324453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.324590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.324632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.324775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.324970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.324997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.325110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.325254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.325281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.325460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.325598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.325640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.325815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.325969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.497 [2024-11-28 11:51:46.325994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.497 qpair failed and we were unable to recover it. 00:27:26.497 [2024-11-28 11:51:46.326146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.326323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.326351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.326520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.326676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.326701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.326835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.326965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.326989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.327189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.327322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.327347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.327478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.327624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.327649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.327756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.327859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.327884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.327993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.328113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.328138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.328276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.328441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.328466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.328638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.328788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.328816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.329009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.329255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.329312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.329444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.329550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.329576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.329731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.329863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.329890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.330009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.330178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.330205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.330317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.330501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.330545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.330702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.330878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.330905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.331095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.331251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.331276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.331436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.331555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.331589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.331763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.331943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.331969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.332115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.332242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.332267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.332396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.332538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.332572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.332746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.332935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.332987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.333096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.333232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.333260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.333401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.333537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.333575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.333706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.333825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.333853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.334002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.334140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.334166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.498 qpair failed and we were unable to recover it. 00:27:26.498 [2024-11-28 11:51:46.334310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.334424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.498 [2024-11-28 11:51:46.334451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.334621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.334784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.334811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.334979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.335138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.335163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.335269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.335396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.335421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.335570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.335714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.335741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.335886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.335986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.336011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.336157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.336304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.336333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.336449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.336573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.336601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.336709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.336850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.336877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.337026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.337166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.337191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.337347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.337520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.337553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.337692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.337821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.337853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.338009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.338145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.338172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.338335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.338466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.338490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.338637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.338787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.338814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.338939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.339106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.339133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.339292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.339453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.339478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.339633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.339795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.339837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.339990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.340086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.340111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.340281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.340417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.340441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.340640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.340822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.340846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.340948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.341080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.341109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.341240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.341413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.341441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.341619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.341740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.341767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.341908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.342046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.342073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.342220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.342352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.342377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.342506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.342673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.342699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.342855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.343008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.343032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.343192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.343322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.343349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.499 qpair failed and we were unable to recover it. 00:27:26.499 [2024-11-28 11:51:46.343481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.343619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.499 [2024-11-28 11:51:46.343645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.343786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.343977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.344003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.344114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.344246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.344271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.344414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.344555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.344587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.344756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.344890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.344923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.345044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.345165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.345199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.345336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.345463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.345496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.345977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.346109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.346140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.346267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.346375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.346403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.346562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.346683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.346711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.346888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.347061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.347090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.347251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.347425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.347456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.347620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.347758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.347788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.347955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.348148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.348177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.348328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.348494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.348550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.348730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.348877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.348906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.349054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.349172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.349199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.349347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.349495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.349535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.349695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.349860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.349889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.350039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.350206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.350238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.350390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.350561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.350590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.350716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.350884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.350912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.351087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.351241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.351272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.351438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.351632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.351665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.351813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.351950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.351978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.352139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.352306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.352339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.352510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.352650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.352680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.352821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.352975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.353007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.353172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.353362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.353391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.500 qpair failed and we were unable to recover it. 00:27:26.500 [2024-11-28 11:51:46.353584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.500 [2024-11-28 11:51:46.353742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.353773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.353908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.354086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.354117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.354290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.354465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.354497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.354684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.354832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.354861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.355062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.355243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.355274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.355472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.355664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.355697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.355880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.356020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.356049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.356222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.356387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.356416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.356587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.356733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.356762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.356970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.357142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.357171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.357321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.357533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.357562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.357713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.357849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.357893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.358068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.358204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.358232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.358384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.358580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.358609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.358758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.358923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.358961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.359137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.359281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.359325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.359516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.359752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.359785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.359955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.360180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.360213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.360419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.360539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.360569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.360723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.360861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.360904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.361071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.361223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.361268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.361426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.361566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.361598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.361792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.361948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.361979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.362158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.362301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.362348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.362548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.362694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.362726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.362951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.363147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.363180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.363356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.363492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.363521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.363760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.363883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.363915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.364053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.364209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.364245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.501 qpair failed and we were unable to recover it. 00:27:26.501 [2024-11-28 11:51:46.364434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.364616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.501 [2024-11-28 11:51:46.364649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.364788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.364950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.364982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.365178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.365341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.365369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.365547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.365678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.365710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.365948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.366065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.366097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.366263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.366430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.366461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.366665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.366811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.366840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.367004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.367172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.367200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.367352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.367485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.367516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.367684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.367835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.367865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.368017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.368161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.368189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.368320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.368457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.368485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.368646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.368789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.368833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.368997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.369153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.369183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.369371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.369530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.369562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.369715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.369855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.369884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.370066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.370212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.370242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.370425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.370593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.370626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.370828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.370965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.371011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.371274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.371429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.371460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.371620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.371768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.371797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.371978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.372147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.372176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.372352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.372493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.372521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.372686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.372887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.372978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.373147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.373276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.373307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.502 [2024-11-28 11:51:46.373440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.373591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.502 [2024-11-28 11:51:46.373623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.502 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.373824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.374013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.374044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.374237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.374351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.374383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.374541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.374689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.374718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.374860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.374993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.375021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.375171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.375309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.375351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.375512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.375664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.375697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.375899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.376035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.376063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.376221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.376381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.376408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.376567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.376708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.376738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.376945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.377113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.377142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.377292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.377447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.377484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.377673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.377810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.377838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.377990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.378170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.378201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.378358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.378503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.378574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.378730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.378897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.378925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.379181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.379335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.379366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.379540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.379686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.379716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.379893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.380077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.380108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.380301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.380430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.380462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.380634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.380748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.380777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.380957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.381103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.381132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.381271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.381406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.381433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.381632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.381783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.381815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.382056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.382252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.382280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.382453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.382634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.382665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.382829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.383003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.383035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.383208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.383316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.383344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.383475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.383680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.383713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.503 [2024-11-28 11:51:46.383889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.384002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-28 11:51:46.384030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.503 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.384154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.384293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.384325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.384494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.384684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.384716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.384862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.384995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.385024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.385185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.385370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.385402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.385571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.385718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.385749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.385964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.386182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.386211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.386418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.386578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.386609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.386823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.387006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.387038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.387179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.387343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.387371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.387493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.387663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.387692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.387825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.388015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.388047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.388201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.388341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.388369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.388638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.388794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.388823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.389004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.389174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.389205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.389366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.389560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.389593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.389774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.389921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.389949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.390166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.390306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.390335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.390514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.390677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.390710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.390848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.391004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.391035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.391238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.391432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.391465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.391639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.391797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.391827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.391993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.392151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.392184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.392355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.392546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.392577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.392780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.392940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.392972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.393166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.393347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.393377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.393592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.393736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.393766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.393937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.394133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.394160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.394351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.394515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.394587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.504 [2024-11-28 11:51:46.394782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.394937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-28 11:51:46.394969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.504 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.395166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.395319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.395353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.395533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.395639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.395667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.395795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.395935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.395963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.396154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.396401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.396439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.396640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.396775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.396803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.396925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.397078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.397110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.397306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.397447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.397493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.397671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.397826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.397857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.398052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.398235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.398267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.398411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.398565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.398597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.398797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.399008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.399061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.399255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.399423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.399455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.399639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.399776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.399805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.399957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.400069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.400102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.400261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.400398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.400445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.400599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.400757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.400790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.400987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.401118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.401150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.401294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.401451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.401483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.401692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.401855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.401887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.402064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.402232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.402261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.402461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.402683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.402712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.402915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.403163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.403225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.403396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.403566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.403595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.403753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.404004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.404036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.404238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.404365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.404397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.404581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.404800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.404829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.405021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.405157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.405186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.405386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.405569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.405602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.505 qpair failed and we were unable to recover it. 00:27:26.505 [2024-11-28 11:51:46.405797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.406007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-28 11:51:46.406064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.406225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.406379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.406411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.406586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.406812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.406840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.407044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.407197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.407229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.407396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.407557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.407586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.407784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.407914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.407943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.408108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.408288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.408320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.408499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.408667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.408695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.408844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.409000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.409031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.409190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.409354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.409383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.409539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.409712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.409757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.409902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.410089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.410118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.410308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.410460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.410492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.410674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.410789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.410838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.410968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.411132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.411160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.411328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.411471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.411499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.411636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.411800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.411830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.412031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.412161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.412192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.412391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.412551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.412581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.412696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.412833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.412860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.413004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.413184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.413215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.413390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.413557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.413601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.413767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.413908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.413935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.414123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.414266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.414295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.414448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.414663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.414692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.414847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.415018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.415049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.415252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.415436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.415466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.415617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.415796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.415828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.416003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.416150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.416179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.506 [2024-11-28 11:51:46.416357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.416513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.506 [2024-11-28 11:51:46.416556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.506 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.416721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.416838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.416866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.417027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.417218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.417250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.417443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.417597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.417630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.417792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.417962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.417989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.418171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.418311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.418339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.418515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.418696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.418727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.418908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.419071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.419110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.419294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.419447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.419478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.419695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.419861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.419890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.420042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.420209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.420239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.420406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.420560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.420591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.420722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.420903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.420932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.421108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.421277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.421305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.421456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.421612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.421645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.421793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.421946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.421978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.422173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.422330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.422361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.422536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.422703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.422747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.422904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.423055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.423087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.423254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.423410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.423441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.423608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.423767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.423800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.423954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.424104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.424131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.424326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.424520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.424557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.424707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.424900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.424931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.425125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.425314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.425345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.425532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.425675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.507 [2024-11-28 11:51:46.425720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.507 qpair failed and we were unable to recover it. 00:27:26.507 [2024-11-28 11:51:46.425897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.426048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.426080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.426242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.426426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.426457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.426734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.426881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.426911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.427084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.427222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.427251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.427452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.427614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.427646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.427854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.427992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.428021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.428172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.428370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.428402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.428557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.428716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.428744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.428924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.429080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.429112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.429282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.429431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.429463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.429631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.429795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.429825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.429976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.430087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.430114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.430331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.430507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.430566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.431601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.431790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.431823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.431978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.432118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.432145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.432298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.432431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.432474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.432677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.432807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.432839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.433015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.433182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.433210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.433400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.433537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.433570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.433734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.433878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.433906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.434091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.434271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.434303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.434467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.434615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.434648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.434811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.434969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.435000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.435146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.435302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.435331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.435535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.435690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.435721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.435899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.436009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.436037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.436168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.436307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.436351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.436503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.436702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.436730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.436875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.437070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.508 [2024-11-28 11:51:46.437098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.508 qpair failed and we were unable to recover it. 00:27:26.508 [2024-11-28 11:51:46.437256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.437421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.437454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.437648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.437796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.437824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.438003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.438177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.438206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.438390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.438504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.438547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.438713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.438877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.438910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.439076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.439242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.439274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.439441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.439645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.439673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.439807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.439971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.440017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.440156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.440308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.440352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.440537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.440689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.440718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.440881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.441162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.441218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.441428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.441543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.441576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.441708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.441856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.441884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.442013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.442181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.442212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.442356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.442501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.442541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.442714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.442842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.442870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.443004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.443165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.443196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.443386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.443542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.443594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.443746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.443914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.443945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.444118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.444284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.444313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.444468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.444635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.444663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.444795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.444972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.445000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.445175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.445337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.445368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.445579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.445694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.445723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.445957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.446100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.446129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.446334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.446487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.446518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.446736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.446873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.446906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.447078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.447226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.447255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.447422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.447593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.509 [2024-11-28 11:51:46.447622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.509 qpair failed and we were unable to recover it. 00:27:26.509 [2024-11-28 11:51:46.447787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.447960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.447988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.448136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.448315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.448342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.448476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.448638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.448665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.448799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.448932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.448960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.449139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.449272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.449297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.449485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.449636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.449663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.449764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.449894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.449921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.450096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.450207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.450234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.450389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.450536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.450566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.450687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.450815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.450859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.451018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.451157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.451182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.451342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.451491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.451519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.451662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.451821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.451864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.452008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.452151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.452180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.452359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.452496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.452546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.452735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.452874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.452902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.453078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.453188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.453218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.453402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.453563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.453589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.453724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.453879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.453923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.454061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.454238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.454267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.454380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.454536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.454587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.454748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.454931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.454959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.455113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.455245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.455271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.455469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.455573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.455599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.455759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.455920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.455949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.456072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.456200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.456230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.456416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.456551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.456581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.456713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.456831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.456857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.510 [2024-11-28 11:51:46.457018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.457200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.510 [2024-11-28 11:51:46.457228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.510 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.457375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.457489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.457518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.457655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.457787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.457813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.457963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.458121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.458147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.458275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.458377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.458404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.458561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.458693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.458719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.458875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.459006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.459050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.459206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.459372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.459397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.459529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.459675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.459700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.459816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.460017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.460043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.460152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.460261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.460287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.460419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.460624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.460650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.460782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.460904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.460934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.461091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.461239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.461267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.461419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.461531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.461557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.461670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.461770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.461797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.461901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.462027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.462053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.462183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.462336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.462364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.462507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.462666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.462692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.462844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.462996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.463021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.463179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.463339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.463381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.463560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.463698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.463724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.463856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.464017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.464042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.464198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.464375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.464401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.464511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.464669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.464695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.464825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.464969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.465010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.511 qpair failed and we were unable to recover it. 00:27:26.511 [2024-11-28 11:51:46.465128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.511 [2024-11-28 11:51:46.465286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.465313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.465475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.465676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.465702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.465832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.466000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.466026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.466189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.466350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.466378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.466557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.466692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.466717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.466887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.467021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.467047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.467167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.467303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.467330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.467466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.467599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.467630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.467821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.467981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.468007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.468115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.468244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.468273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.469080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.469240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.469267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.470029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.470208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.470244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.470381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.470489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.470515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.470687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.470802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.470831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.470982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.471130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.471159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.471343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.471475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.471501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.471732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.471837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.471863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.472011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.472181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.472210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.472322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.472462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.472491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.472625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.472777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.472816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.472969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.473107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.473133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.473261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.473429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.473462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.473628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.473811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.473839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.473989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.474176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.474202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.474361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.474495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.474545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.474719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.474860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.474888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.475025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.475161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.475186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.475317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.475493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.475521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.475683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.475807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.512 [2024-11-28 11:51:46.475832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.512 qpair failed and we were unable to recover it. 00:27:26.512 [2024-11-28 11:51:46.475990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.476147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.476172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.476302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.476435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.476461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.476570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.476698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.476744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.476852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.476989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.477015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.477153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.477306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.477333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.477484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.477601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.477630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.477777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.477889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.477932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.478067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.478194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.478219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.478383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.478535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.478565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.478708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.478865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.478890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.479033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.479191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.479217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.479406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.479654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.479683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.479808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.479958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.479992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.480140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.480283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.480312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.480449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.480567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.480596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.480744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.480877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.480903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.481057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.481240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.481265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.481402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.481568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.481593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.481754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.481927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.481956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.482159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.482343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.482372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.482546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.482689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.482729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.482860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.483090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.483118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.483289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.483454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.483483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.483625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.483759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.483785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.483942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.484059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.484086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.484198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.484304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.484332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.484466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.484623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.484649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.484848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.484980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.485006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.513 qpair failed and we were unable to recover it. 00:27:26.513 [2024-11-28 11:51:46.485204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.513 [2024-11-28 11:51:46.485336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.485364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.485555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.485708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.485733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.485850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.485975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.486000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.486127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.486254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.486279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.486412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.486590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.486620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.486776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.486947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.486975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.487146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.487255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.487284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.487415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.487574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.487602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.487774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.487893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.487921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.488097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.488268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.488297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.488482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.488624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.488650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.488819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.488980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.489023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.489175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.489343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.489372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.489521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.489675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.489701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.489828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.489996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.490023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.490156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.490284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.490310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.490470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.490594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.490622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.490769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.490910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.490938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.491055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.491195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.491224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.491382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.491513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.491544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.491716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.491859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.491888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.492068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.492227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.492252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.492389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.492540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.492570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.492728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.492853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.492879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.493035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.493152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.493181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.493308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.493487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.493515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.493663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.493806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.493835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.493998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.494131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.494157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.514 qpair failed and we were unable to recover it. 00:27:26.514 [2024-11-28 11:51:46.494343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.494539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.514 [2024-11-28 11:51:46.494565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.494722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.494841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.494869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.495006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.495170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.495195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.495326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.495453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.495478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.495663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.495808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.495836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.495990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.496143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.496169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.496352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.496463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.496490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.496664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.496793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.496835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.496949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.497069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.497094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.497195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.497352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.497381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.497562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.497720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.497761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.497882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.497989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.498014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.498115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.498260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.498285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.498440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.498584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.498614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.498742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.498884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.498923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.499064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.499198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.499223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.499359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.499505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.499540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.499723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.499837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.499867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.500012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.500167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.500193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.500353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.500454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.500481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.500659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.500806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.500835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.500947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.501124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.501149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.501289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.501415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.501441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.501574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.501678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.501705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.501856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.501967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.501997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.502118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.502253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.502282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.502453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.502573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.502602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.502763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.502872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.502897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.503056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.503208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.503234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.515 qpair failed and we were unable to recover it. 00:27:26.515 [2024-11-28 11:51:46.503368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.515 [2024-11-28 11:51:46.503555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.503584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.503737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.503891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.503916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.504075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.504205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.504230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.504331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.504487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.504512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.504687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.504844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.504870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.505035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.505200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.505229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.505364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.505497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.505522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.505684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.505827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.505856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.506005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.506152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.506193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.506328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.506509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.506547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.506729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.506861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.506886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.507019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.507215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.507240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.507372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.507520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.507559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.507710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.507820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.507849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.508006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.508115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.508140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.508294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.508430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.508458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.508613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.508770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.508796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.508951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.509093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.509121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.509253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.509416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.509442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.509549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.509665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.509693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.509882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.510015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.510040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.510202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.510365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.510391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.510521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.510656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.510682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.510844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.510984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.511012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.511191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.511360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.511385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.516 qpair failed and we were unable to recover it. 00:27:26.516 [2024-11-28 11:51:46.511516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.516 [2024-11-28 11:51:46.511657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.511682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.511815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.511945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.511971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.512122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.512241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.512266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.512442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.512618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.512647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.512762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.512911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.512936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.513048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.513159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.513184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.513318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.513426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.513451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.513583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.513740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.513768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.513890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.514079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.514104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.514237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.514365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.514391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.514583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.514694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.514722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.514837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.514980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.515022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.515159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.515286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.515312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.515482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.515642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.515671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.515783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.515927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.515956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.516096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.516236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.516264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.516448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.516595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.516625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.516760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.516917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.516942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.517078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.517211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.517239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.517360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.517511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.517547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.517718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.517833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.517861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.518009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.518118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.518145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.518299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.518467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.518496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.518637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.518799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.518825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.518979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.519138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.519163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.519301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.519403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.519428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.519547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.519682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.519707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.519891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.520021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.520046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.517 qpair failed and we were unable to recover it. 00:27:26.517 [2024-11-28 11:51:46.520205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.520341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.517 [2024-11-28 11:51:46.520369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.518 qpair failed and we were unable to recover it. 00:27:26.518 [2024-11-28 11:51:46.520520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.518 [2024-11-28 11:51:46.520685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.518 [2024-11-28 11:51:46.520728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.518 qpair failed and we were unable to recover it. 00:27:26.518 [2024-11-28 11:51:46.520843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.806 [2024-11-28 11:51:46.520989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.806 [2024-11-28 11:51:46.521015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.806 qpair failed and we were unable to recover it. 00:27:26.806 [2024-11-28 11:51:46.521152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.806 [2024-11-28 11:51:46.521261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.806 [2024-11-28 11:51:46.521286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.806 qpair failed and we were unable to recover it. 00:27:26.806 [2024-11-28 11:51:46.521415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.806 [2024-11-28 11:51:46.521515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.806 [2024-11-28 11:51:46.521548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.806 qpair failed and we were unable to recover it. 00:27:26.806 [2024-11-28 11:51:46.521657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.806 [2024-11-28 11:51:46.521755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.806 [2024-11-28 11:51:46.521785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.806 qpair failed and we were unable to recover it. 00:27:26.806 [2024-11-28 11:51:46.521942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.806 [2024-11-28 11:51:46.522127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.806 [2024-11-28 11:51:46.522152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.806 qpair failed and we were unable to recover it. 00:27:26.806 [2024-11-28 11:51:46.522261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.806 [2024-11-28 11:51:46.522413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.806 [2024-11-28 11:51:46.522442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.806 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.522593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.522714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.522744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.522870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.523037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.523063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.523190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.523364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.523393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.523557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.523657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.523682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.523815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.523936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.523966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.524088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.524243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.524269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.524419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.524537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.524567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.524675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.524818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.524850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.524994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.525135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.525163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.525288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.525417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.525443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.525561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.525679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.525709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.525855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.526027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.526053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.526196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.526336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.526363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.526513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.526625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.526650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.526786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.526898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.526927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.527055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.527153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.527179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.527281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.527438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.527466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.527650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.527761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.527791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.527904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.528031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.528057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-11-28 11:51:46.528185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.528326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-11-28 11:51:46.528354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.528495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.528653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.528683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.528835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.528963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.528989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.529121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.529224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.529249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.529382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.529559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.529589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.529705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.529823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.529851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.530001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.530161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.530201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.530347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.530539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.530574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.530714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.530869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.530903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.531055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.531235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.531261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.531420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.531554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.531580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.531713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.531871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.531913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.532021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.532155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.532180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.532338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.532480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.532508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.532669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.532773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.532799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.532971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.533104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.533131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.533280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.533396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.533426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.533573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.533721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.533750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.533902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.534033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.534060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.534255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.534411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.534436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-11-28 11:51:46.534572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.534708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-11-28 11:51:46.534733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.534871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.535064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.535089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.535243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.535345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.535370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.535499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.535665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.535695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.535834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.535949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.535977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.536104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.536255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.536280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.536428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.536584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.536629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.536744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.536884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.536912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.537082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.537251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.537279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.537432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.537624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.537650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.537776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.537910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.537935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.538093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.538210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.538238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.538368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.538471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.538496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.538636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.538813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.538839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.538997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.539125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.539166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.539281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.539461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.539486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.539596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.539771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.539800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.539927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.540080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.540106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.540214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.540313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.540339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.540475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.540625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.540666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-11-28 11:51:46.540801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-11-28 11:51:46.540929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.540955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.541097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.541211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.541239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.541354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.541485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.541512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.541675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.541824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.541852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.542034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.542179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.542206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.542328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.542505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.542536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.542674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.542778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.542804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.542966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.543079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.543109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.543282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.543420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.543448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.543573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.543716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.543744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.543889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.544025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.544051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.544214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.544394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.544422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.544543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.544684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.544714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.544861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.545001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.545029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.545173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.545329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.545354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.545464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.545616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.545644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.545821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.545938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.545966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.546112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.546232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.546261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.546386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.546515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.546548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.546697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.546829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-11-28 11:51:46.546854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-11-28 11:51:46.546997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.547139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.547167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.547311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.547466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.547492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.547675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.547820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.547845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.547954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.548099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.548140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.548276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.548408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.548433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.548539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.548660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.548689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.548852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.549009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.549035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.549214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.549359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.549392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.549565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.549707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.549735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.549925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.550061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.550086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.550220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.550377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.550402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.550583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.550726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.550754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.550897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.551037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.551078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.551219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.551354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.551378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.551481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.551616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.551642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.551772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.551884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.551913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.552025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.552165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.552193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.552331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.552471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.552511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.552658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.552812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.552837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-11-28 11:51:46.552994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-11-28 11:51:46.553135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.553163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.553277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.553424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.553452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.553605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.553719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.553748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.553876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.554038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.554063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.554214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.554324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.554366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.554469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.554581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.554607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.554719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.554816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.554841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.554974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.555073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.555098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.555237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.555412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.555440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.555570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.555707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.555733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.555864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.555994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.556019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.556125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.556284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.556309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.556415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.556512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.556544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.556656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.556783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.556809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.556925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.557059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.557087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.557266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.557435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.557462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.557579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.557728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.557757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.557863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.557971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.558001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.558173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.558324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.558349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.558484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.558586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-28 11:51:46.558611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-11-28 11:51:46.558772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.558934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.558963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.559135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.559275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.559303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.559456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.559603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.559629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.559737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.559869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.559894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.560014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.560122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.560150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.560270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.560423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.560448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.560585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.560770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.560796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.560929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.561060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.561085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.561245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.561380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.561408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.561565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.561722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.561748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.561900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.562055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.562085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.562240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.562372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.562399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.562545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.562697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.562722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.562876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.563003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.563032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.563184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.563286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-28 11:51:46.563310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-11-28 11:51:46.563414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.563536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.563564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.563683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.563832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.563861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.564021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.564150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.564175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.564366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.564501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.564533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.564677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.564778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.564805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.564950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.565132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.565158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.565259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.565453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.565479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.565613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.565737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.565765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.565913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.566023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.566050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.566160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.566259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.566284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.566443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.566576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.566601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.566718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.566866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.566895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.567050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.567205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.567246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.567361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.567520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.567552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.567685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.567828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.567857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.567998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.568139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.568171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.568299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.568425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.568450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.568581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.568703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.568732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.568844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.568984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.569012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-11-28 11:51:46.569162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-28 11:51:46.569269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.569295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.569453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.569580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.569606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.569708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.569821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.569846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.569975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.570162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.570190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.570326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.570423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.570448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.570579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.570734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.570776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.570960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.571067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.571096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.571224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.571351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.571376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.571538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.571650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.571692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.571824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.571953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.571979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.572105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.572225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.572254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.572397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.572556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.572585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.572738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.572912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.572940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.573064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.573196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.573222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.573346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.573490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.573518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.573670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.573803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.573831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.573982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.574173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.574206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.574360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.574517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.574551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.574712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.574909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.574935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.575036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.575191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-11-28 11:51:46.575221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-11-28 11:51:46.575375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.575518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.575557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.575682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.575787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.575814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.575972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.576132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.576158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.576262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.576412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.576440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.576560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.576699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.576728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.576905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.577033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.577058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.577215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.577362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.577395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.577547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.577705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.577730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.577831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.577978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.578003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.578165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.578272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.578299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.578456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.578576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.578605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.578772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.578915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.578942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.579060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.579249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.579275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.579409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.579511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.579544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.579691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.579798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.579838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.579966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.580113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.580141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.580282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.580395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.580423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.580580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.580693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.580719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.580876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.580983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.581011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-11-28 11:51:46.581154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.581292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-11-28 11:51:46.581320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.581466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.581649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.581675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.581834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.582014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.582043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.582184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.582354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.582382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.582542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.582670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.582696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.582876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.583038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.583063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.583222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.583380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.583406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.583563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.583720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.583745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.583904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.584100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.584125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.584255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.584365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.584390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.584552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.584653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.584679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.584839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.585014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.585043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.585181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.585299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.585329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.585505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.585641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.585667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.585807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.585934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.585959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.586086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.586228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.586258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.586404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.586582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.586611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.586785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.586932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.586960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.587148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.587286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.587329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.587439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.587594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-11-28 11:51:46.587623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-28 11:51:46.587793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.587905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.587934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.588059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.588202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.588230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.588384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.588519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.588562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.588694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.588850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.588890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.589020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.589153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.589179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.589313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.589497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.589534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.589681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.589815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.589840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.590000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.590167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.590196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.590344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.590516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.590553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.590698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.590844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.590873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.591025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.591161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.591186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.591315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.591491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.591519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.591676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.591823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.591852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.592033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.592170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.592196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.592360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.592494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.592545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.592698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.592829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.592856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.593014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.593167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.593196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.593368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.593552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.593578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.593742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.593850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.593876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-28 11:51:46.594002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.594149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-11-28 11:51:46.594176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.594288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.594469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.594497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.594618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.594766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.594794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.594955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.595062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.595089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.595246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.595385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.595410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.595596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.595727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.595752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.595883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.596054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.596082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.596211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.596345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.596370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.596547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.596658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.596684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.596876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.597033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.597058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.597207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.597374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.597403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.597557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.597691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.597717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.597819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.597966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.597995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.598144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.598324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.598352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.598533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.598638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.598664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.598800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.598902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.598929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.599057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.599197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.599225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.599335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.599474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.599502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-11-28 11:51:46.599560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x184c600 (9): Bad file descriptor 00:27:26.819 [2024-11-28 11:51:46.599819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-11-28 11:51:46.599971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.599999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.600164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.600301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.600345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.600453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.600610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.600637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.600802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.600928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.600955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.601087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.601244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.601269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.601405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.601507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.601539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.601693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.601858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.601901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.602034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.602132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.602158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.602289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.602432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.602459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.602590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.602738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.602764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.602981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.603161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.603187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.603324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.603463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.603488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.603604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.603763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.603789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.603926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.604031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.604058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.604228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.604335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.604361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.604468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.604638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.604683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.604815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.604985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.605028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-11-28 11:51:46.605159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.605292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-11-28 11:51:46.605317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.605449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.605569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.605597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.605725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.605859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.605885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.606015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.606147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.606174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.606309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.606446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.606472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.606602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.606790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.606837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.606964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.607091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.607117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.607264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.607395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.607421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.607572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.607693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.607719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.607889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.608022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.608047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.608204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.608334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.608361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.608466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.608617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.608660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.608775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.608944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.608994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.609154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.609256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.609283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.609428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.609530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.609557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.609673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.609845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.609888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.610014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.610190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.610215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.610380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.610541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.610567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.610753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.610887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.610915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.611084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.611237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.611263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-11-28 11:51:46.611369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-11-28 11:51:46.611498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.611529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.611678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.611876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.611922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.612030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.612129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.612156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.612295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.612396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.612422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.612538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.612636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.612662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.612789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.612913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.612938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.613068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.613165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.613190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.613298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.613431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.613456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.613599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.613737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.613763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.613875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.613976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.614002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.614168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.614296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.614321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.614450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.614582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.614608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.614739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.614856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.614884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.615030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.615176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.615204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.615402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.615557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.615584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.615696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.615796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.615840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.615987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.616132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.616161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.616311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.616458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.616486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.616649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.616782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.616807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.616962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.617104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.617132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-11-28 11:51:46.617283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.617458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-11-28 11:51:46.617486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.617647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.617745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.617770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.617913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.618045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.618075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.618207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.618381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.618409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.618541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.618714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.618740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.618921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.619113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.619154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.619345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.619465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.619493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.619649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.619783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.619809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.619982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.620158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.620186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.620369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.620501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.620532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.620661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.620764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.620790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.620936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.621073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.621101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.621230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.621388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.621414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.621573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.621749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.621775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.622015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.622207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.622242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.622427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.622573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.622621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.622799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.622931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.622960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.623196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.623357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.623383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.623512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.623618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.623644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.623747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.623847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.623872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-11-28 11:51:46.624007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-11-28 11:51:46.624135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.624160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.624290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.624430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.624470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.624588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.624704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.624732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.624899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.625062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.625087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.625266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.625447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.625476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.625634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.625803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.625831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.626101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.626235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.626264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.626419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.626578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.626622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.626799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.626936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.626965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.627188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.627353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.627382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.627548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.627681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.627708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.627859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.627966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.627992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.628116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.628288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.628313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.628485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.628625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.628652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.628774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.628930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.628959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.629152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.629258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.629283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.629445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.629578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.629604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.629715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.629874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.629900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.630033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.630145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.630170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.630296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.630402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-11-28 11:51:46.630427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-11-28 11:51:46.630591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.630717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.630743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.630895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.631012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.631040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.631191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.631348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.631389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.631560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.631710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.631738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.631912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.632102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.632127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.632297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.632432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.632477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.632595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.632756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.632782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.632918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.633073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.633098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.633206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.633362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.633388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.633485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.633599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.633625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.633736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.633898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.633923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.634026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.634154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.634180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.634310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.634419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.634445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.634574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.634711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.634737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.634846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.634948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.634977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.635153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.635310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.635336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.635463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.635608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.635638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.635783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.635941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.635967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.636154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.636288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.636313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.636502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.636645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-11-28 11:51:46.636670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-11-28 11:51:46.636777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.636906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.636933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.637117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.637264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.637292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.637462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.637609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.637638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.637768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.637896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.637921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.638065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.638226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.638272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.638454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.638588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.638614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.638758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.638867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.638893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.639076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.639182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.639210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.639383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.639530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.639559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.639709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.639848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.639873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.640035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.640193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.640219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.640344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.640491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.640520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.640723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.640907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.640935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.641117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.641247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.641273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.641441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.641606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.641636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-11-28 11:51:46.641786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-11-28 11:51:46.641917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.641942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.642088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.642241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.642267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.642403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.642542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.642569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.642682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.642781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.642807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.642944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.643122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.643150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.643295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.643446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.643474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.643620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.643734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.643759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.643905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.644055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.644081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.644239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.644394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.644422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.644547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.644711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.644740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.644864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.645005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.645035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.645210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.645383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.645411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.645571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.645703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.645729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.645917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.646099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.646124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.646255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.646388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.646413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.646515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.646652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.646679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.646786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.646941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.646970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.647139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.647308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.647336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.647506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.647637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.647662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.647840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.647953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.647981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-11-28 11:51:46.648179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-11-28 11:51:46.648313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.648341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.648495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.648635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.648662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.648772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.648870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.648896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.649000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.649135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.649160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.649258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.649451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.649479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.649640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.649741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.649766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.649893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.650043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.650069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.650231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.650336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.650377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.650494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.650686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.650711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.650903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.651054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.651079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.651240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.651344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.651369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.651569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.651671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.651698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.651833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.651960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.651985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.652136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.652275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.652304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.652453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.652614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.652640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.652769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.652901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.652926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.653061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.653186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.653227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.653372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.653482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.653511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.653665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.653835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.653860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-11-28 11:51:46.654032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.654158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-11-28 11:51:46.654184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.654338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.654460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.654488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.654644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.654778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.654804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.654981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.655141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.655166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.655266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.655384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.655413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.655576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.655735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.655761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.655901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.656032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.656058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.656163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.656266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.656293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 3930110 Killed "${NVMF_APP[@]}" "$@" 00:27:26.829 [2024-11-28 11:51:46.656475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.656626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.656652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.656756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 11:51:46 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:26.829 [2024-11-28 11:51:46.656915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.656940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 11:51:46 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:26.829 [2024-11-28 11:51:46.657066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 11:51:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:26.829 [2024-11-28 11:51:46.657183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.657212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 11:51:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:26.829 [2024-11-28 11:51:46.657358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 11:51:46 -- common/autotest_common.sh@10 -- # set +x 00:27:26.829 [2024-11-28 11:51:46.657519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.657571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.657705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.657862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.657887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.658011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.658121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.658150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.658294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.658455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.658482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.658597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.658732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.658758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.658909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.659086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.659112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.659281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.659410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.659440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.659595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.659700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.659726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-11-28 11:51:46.659912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-11-28 11:51:46.660070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.660095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-11-28 11:51:46.660256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.660398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.660426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-11-28 11:51:46.660606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.660746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.660771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-11-28 11:51:46.660871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 11:51:46 -- nvmf/common.sh@469 -- # nvmfpid=3930813 00:27:26.830 [2024-11-28 11:51:46.661000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.661028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 11:51:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:26.830 11:51:46 -- nvmf/common.sh@470 -- # waitforlisten 3930813 00:27:26.830 [2024-11-28 11:51:46.661164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 11:51:46 -- common/autotest_common.sh@829 -- # '[' -z 3930813 ']' 00:27:26.830 [2024-11-28 11:51:46.661329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.661357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 11:51:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:26.830 [2024-11-28 11:51:46.661475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 11:51:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:26.830 [2024-11-28 11:51:46.661610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.661637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 11:51:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:26.830 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:26.830 [2024-11-28 11:51:46.661784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 11:51:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:26.830 [2024-11-28 11:51:46.661907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.661937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 11:51:46 -- common/autotest_common.sh@10 -- # set +x 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-11-28 11:51:46.662110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.662245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.662274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-11-28 11:51:46.662430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.662543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.662570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-11-28 11:51:46.662706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.662860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.662888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-11-28 11:51:46.663026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.663150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.663175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-11-28 11:51:46.663336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.663453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.663493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-11-28 11:51:46.663666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.663771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.663798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-11-28 11:51:46.663967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.664101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.664126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-11-28 11:51:46.664257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.664389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.664416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-11-28 11:51:46.664545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.664672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.664698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-11-28 11:51:46.664833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.664938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.664963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-11-28 11:51:46.665122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.665270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-11-28 11:51:46.665295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.665471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.665630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.665656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.665791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.665924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.665950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.666113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.666251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.666277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.666404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.666540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.666568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.666675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.666783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.666825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.666984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.667109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.667136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.667279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.667387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.667413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.667516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.667668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.667693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.667801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.667921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.667947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.668080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.668196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.668222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.668332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.668481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.668508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.668750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.668879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.668907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.669072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.669237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.669263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.669394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.669576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.669602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.669742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.669873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.669899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.670060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.670192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.670217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.670368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.670475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.670502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.670682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.670922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.670950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.671115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.671225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.671254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-11-28 11:51:46.671409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.671568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-11-28 11:51:46.671595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.671705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.671853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.671882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.672054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.672199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.672227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.672409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.672535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.672561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.672663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.672796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.672822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.672973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.673142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.673170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.673302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.673448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.673474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.673629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.673765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.673791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.673965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.674090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.674115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.674246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.674371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.674397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.674497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.674646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.674672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.674806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.674935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.674960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.675121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.675338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.675366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.675501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.675663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.675689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.675790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.675945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.675971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.676120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.676225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.676251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.676385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.676570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.676597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.676747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.676852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.676878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.677036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.677195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.677220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.677359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.677506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.677538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-11-28 11:51:46.677685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-11-28 11:51:46.677816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.677841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.678018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.678150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.678175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.678319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.678452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.678479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.678635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.678768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.678794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.678966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.679102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.679129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.679236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.679386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.679412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.679570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.679702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.679728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.679837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.679953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.679979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.680084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.680191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.680217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.680377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.680474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.680501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.680643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.680756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.680781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.680884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.681017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.681042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.681182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.681319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.681345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.681451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.681611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.681637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.681749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.681890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.681916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.682080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.682211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-11-28 11:51:46.682236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-11-28 11:51:46.682369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.682487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.682512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.682663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.682792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.682817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.682947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.683050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.683076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.683182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.683283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.683308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.683441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.683573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.683599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.683731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.683880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.683906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.684064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.684198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.684223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.684329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.684468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.684493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.684626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.684760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.684785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.684919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.685021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.685046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.685165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.685292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.685317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.685418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.685555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.685583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.685694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.685828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.685854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.685980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.686109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.686136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.686270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.686396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.686421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.686531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.686632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.686657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.686872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.687032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.687058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.687189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.687324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.687349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.687513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.687628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.687653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-11-28 11:51:46.687869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.687999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-11-28 11:51:46.688025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.688171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.688268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.688294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.688430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.688575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.688605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.688740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.688897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.688922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.689053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.689213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.689239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.689351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.689453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.689479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.689631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.689741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.689767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.689879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.690042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.690068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.690206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.690421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.690447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.690572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.690728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.690754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.690906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.691046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.691071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.691212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.691314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.691339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.691476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.691637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.691664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.691801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.691906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.691931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.692069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.692226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.692252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.692383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.692553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.692579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.692717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.692848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.692873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.693000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.693132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.693162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.693292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.693400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.693426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.693642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.693800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.693825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-11-28 11:51:46.693936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.694042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-11-28 11:51:46.694067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.694201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.694330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.694355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.694456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.694596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.694622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.694724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.694835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.694860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.694991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.695120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.695147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.695302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.695407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.695433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.695543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.695680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.695706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.695852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.695989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.696018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.696157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.696254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.696279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.696413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.696540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.696565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.696666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.696776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.696802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.696905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.697030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.697055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.697181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.697284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.697310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.697447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.697576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.697602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.697704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.697825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.697850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.697996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.698146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.698172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.698302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.698432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.698457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.698601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.698702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.698731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.698832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.698963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.698989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.699118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.699241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-11-28 11:51:46.699266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-11-28 11:51:46.699413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.699559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.699585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.699720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.699851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.699878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.700091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.700132] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:26.837 [2024-11-28 11:51:46.700201] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:26.837 [2024-11-28 11:51:46.700220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.700245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.700378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.700510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.700554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.700667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.700822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.700847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.700980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.701115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.701140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.701241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.701338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.701364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.701480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.701647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.701673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.701774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.701912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.701940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.702102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.702231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.702257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.702423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.702560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.702587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.702751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.702896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.702921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.703018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.703114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.703139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.703238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.703368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.703394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.703533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.703662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.703688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.703822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.703958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.703983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.704115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.704253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.704278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.704390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.704562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.704588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.704724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.704831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-11-28 11:51:46.704858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-11-28 11:51:46.704996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.705106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.705132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.705283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.705385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.705411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.705585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.705745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.705771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.705879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.706008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.706034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.706190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.706326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.706351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.706502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.706671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.706699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.706831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.706935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.706960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.707120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.707250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.707275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.707389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.707496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.707521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.707703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.707810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.707834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.707994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.708097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.708122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.708231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.708358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.708383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.708493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.708610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.708636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.708797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.708960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.708986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.709128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.709287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.709313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.709455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.709579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.709606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.709747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.709848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.709874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.710006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.710145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.710171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.710308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.710416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.710442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.710600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.710734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-11-28 11:51:46.710760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-11-28 11:51:46.710889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.711045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.711071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.711224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.711403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.711428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.711569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.711733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.711759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.711930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.712102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.712131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.712268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.712400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.712426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.712581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.712688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.712715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.712823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.712937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.712963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.713113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.713242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.713268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.713429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.713537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.713564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.713667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.713796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.713821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.713966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.714122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.714147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.714266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.714374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.714400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.714572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.714693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.714720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.714862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.715009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.715034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.715157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.715259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.715286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.715434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.715570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.715596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-11-28 11:51:46.715726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.715883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-11-28 11:51:46.715926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.716070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.716200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.716226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.716424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.716631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.716663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.716782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.716947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.716976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.717116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.717257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.717285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.717462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.717603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.717632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.717772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.717908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.717935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.718046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.718154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.718181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.718316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.718541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.718570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.718794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.718933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.718960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.719096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.719212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.719238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.719385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.719503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.719539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.719693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.719816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.719843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.719981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.720143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.720170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.720312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.720454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.720481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.720622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.720791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.720818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.720984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.721147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.721174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.721279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.721409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.721437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.721576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.721719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.721746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.721931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.722083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-11-28 11:51:46.722109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-11-28 11:51:46.722272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.722433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.722461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.722603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.722722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.722749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.722884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.724536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.724578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.724737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.724896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.724924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.725070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.725212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.725240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.725391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.725531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.725558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.725692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.725831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.725858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.726025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.726190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.726217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.726356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.726498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.726540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.726700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.726871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.726899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.727042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.727174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.727201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.727360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.727488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.727516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.727693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.727859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.727890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.729546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.729720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.729749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.729893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.730066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.730094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.730213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.730353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.730381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.730486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.730617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.730646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.730789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.730954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.730982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.731125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.731290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.731317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.731428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.731538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-11-28 11:51:46.731564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-11-28 11:51:46.731705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.731817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.731846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.732016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.732169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.732196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.732327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.732491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.732518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.732671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 EAL: No free 2048 kB hugepages reported on node 1 00:27:26.842 [2024-11-28 11:51:46.734538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.734571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.734725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.734893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.734922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.735094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.735237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.735264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.735403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.735541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.735569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.735689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.735820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.735846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.735985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.736099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.736128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.736281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.736441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.736467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.736592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.736729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.736760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.736898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.737029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.737064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.737203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.737352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.737387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.737590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.737742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.737777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.737909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.738060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.738094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.738220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.738339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.738375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.738541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.738717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.738745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.738899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.739009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.739037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.739162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.739277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.739302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.739436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.739566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.842 [2024-11-28 11:51:46.739593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.842 qpair failed and we were unable to recover it. 00:27:26.842 [2024-11-28 11:51:46.739705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.739847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.739874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.740006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.740102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.740127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.740266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.740429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.740455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.740586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.740722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.740748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.740859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.740990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.741016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.741153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.741280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.741305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.741446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.741561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.741587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.741692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.741802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.741828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.741932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.742056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.742082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.742248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.742382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.742408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.742571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.742730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.742755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.742874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.742999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.743024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.743168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.743336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.743361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.743476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.743647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.743674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.743804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.743936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.743962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.744098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.744229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.744255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.744370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.744509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.744541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.744679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.744789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.744816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.744944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.745075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.745101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.843 [2024-11-28 11:51:46.745232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.745338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.843 [2024-11-28 11:51:46.745364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.843 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.745494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.745713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.745740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.745835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.745940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.745965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.746069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.746225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.746251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.746385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.746516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.746550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.746679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.746780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.746805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.746971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.747083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.747110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.747264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.747388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.747414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.747557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.747715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.747741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.747873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.747973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.748013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.748155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.748285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.748310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.748411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.748570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.748596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.748758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.748899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.748925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.749064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.749196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.749222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.749345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.749465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.749490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.749666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.749822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.749847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.749981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.750083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.750109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.750249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.750378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.750405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.750510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.750676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.750702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.750860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.751017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.751043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.844 qpair failed and we were unable to recover it. 00:27:26.844 [2024-11-28 11:51:46.751173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.844 [2024-11-28 11:51:46.751306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.751331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.751488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.751597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.751623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.751754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.751899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.751924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.752091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.752196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.752223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.752394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.752530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.752557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.752691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.752821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.752847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.752983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.753113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.753138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.753313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.753443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.753470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.753607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.753767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.753793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.753898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.754029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.754054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.754199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.754300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.754324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.754452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.754566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.754591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.754755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.754870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.754895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.755029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.755129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.755154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.755288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.755398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.755424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.755547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.755707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.755733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.755839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.755948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.755974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.756081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.756214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.756240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.756355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.756489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.756515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.756684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.756850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.756876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.757008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.757120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.757145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.845 qpair failed and we were unable to recover it. 00:27:26.845 [2024-11-28 11:51:46.757284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.757441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.845 [2024-11-28 11:51:46.757467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.757630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.757761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.757786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.757891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.758002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.758027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.758145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.758284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.758311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.758471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.758610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.758636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.758753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.758890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.758916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.759027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.759128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.759153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.759320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.759476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.759501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.759635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.759740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.759766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.759887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.760018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.760044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.760179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.760280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.760306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.760468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.760604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.760630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.760756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.760889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.760915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.761079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.761192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.761222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.761383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.761541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.761567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.761706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.761862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.761888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.762032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.762189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.762215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.762356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.762512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.846 [2024-11-28 11:51:46.762560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.846 qpair failed and we were unable to recover it. 00:27:26.846 [2024-11-28 11:51:46.762708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.762842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.762868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.763017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.763133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.763158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.763288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.763423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.763448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.763560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.763665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.763692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.763851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.764016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.764042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.764176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.764333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.764363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.764472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.764608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.764633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.764799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.764929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.764956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.765057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.765181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.765207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.765316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.765448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.765473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.765632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.765738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.765763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.765882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.765984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.766010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.766124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.766280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.766306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.766407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.766515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.766547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.766655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.766787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.766812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.766922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.767079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.767109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.767280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.767405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.767430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.767540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.767648] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:26.847 [2024-11-28 11:51:46.767670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.767695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.767817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.767917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.767942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.768056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.768214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.768240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.768344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.768505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.768546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.847 qpair failed and we were unable to recover it. 00:27:26.847 [2024-11-28 11:51:46.768662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.847 [2024-11-28 11:51:46.768804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.768829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.768941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.769047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.769072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.769176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.769330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.769355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.769519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.769650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.769676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.769815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.769915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.769945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.770054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.770182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.770208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.770315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.770424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.770449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.770600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.770715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.770741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.770900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.771048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.771074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.771206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.771340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.771366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.771482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.771627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.771654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.771788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.771921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.771947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.772062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.772192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.772218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.772357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.772487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.772513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.772632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.772792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.772822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.772948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.773082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.773109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.773246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.773388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.773414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.773549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.773692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.773717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.773831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.773989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.774014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.774183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.774316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.774341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.774500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.774640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.774666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.774806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.774916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.774942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.848 qpair failed and we were unable to recover it. 00:27:26.848 [2024-11-28 11:51:46.775111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.775247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.848 [2024-11-28 11:51:46.775274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.775381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.775494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.775520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.775635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.775776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.775807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.775942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.776072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.776098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.776206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.776340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.776366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.776505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.776653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.776679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.776820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.776953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.776980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.777084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.777195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.777222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.777370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.777502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.777535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.777671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.777830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.777856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.777964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.778061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.778086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.778225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.778359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.778386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.778501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.778661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.778692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.778826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.778994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.779019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.779154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.779282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.779308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.779448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.779612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.779639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.779780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.779892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.779917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.780053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.780187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.780213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.780326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.780460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.780487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.780597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.780699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.780725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.780862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.780996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.781021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.781162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.781293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.781319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.781451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.781604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.781630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.849 [2024-11-28 11:51:46.781797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.781901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.849 [2024-11-28 11:51:46.781926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.849 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.782062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.782191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.782216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.782329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.782430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.782456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.782623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.782755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.782780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.782950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.783078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.783104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.783207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.783346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.783371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.783537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.783670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.783695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.783828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.783930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.783956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.784057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.784196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.784222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.784383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.784547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.784573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.784715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.784873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.784899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.785005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.785165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.785190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.785354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.785485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.785511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.785651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.785784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.785810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.785917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.786046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.786071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.786208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.786351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.786377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.786511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.786624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.786650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.786785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.786892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.786917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.787050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.787150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.787176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.787283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.787419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.787445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.787585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.787709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.787734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.787877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.788034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.788059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.788191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.788318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.788343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.850 [2024-11-28 11:51:46.788476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.788604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.850 [2024-11-28 11:51:46.788630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.850 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.788801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.788930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.788956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.789088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.789192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.789219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.789347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.789454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.789480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.789620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.789755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.789781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.789892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.790025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.790051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.790151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.790251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.790277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.790423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.790530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.790557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.790692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.790850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.790876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.791036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.791147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.791172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.791302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.791458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.791483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.791668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.791797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.791822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.791981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.792138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.792163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.792329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.792432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.792459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.792563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.792723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.792749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.792852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.792961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.792986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.793123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.793219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.793245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.793379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.793539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.793565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.793672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.793776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.793801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.793964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.794067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.794092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.794236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.794375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.794400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.794534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.794635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.794660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.794777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.794879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.794904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.795037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.795169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.795194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.851 qpair failed and we were unable to recover it. 00:27:26.851 [2024-11-28 11:51:46.795329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.851 [2024-11-28 11:51:46.795465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.795491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.795610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.795752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.795778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.795928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.796026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.796052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.796220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.796351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.796377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.796514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.796662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.796688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.796823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.796920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.796945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.797098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.797201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.797227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.797378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.797508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.797542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.797710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.797847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.797872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.797974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.798136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.798161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.798310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.798444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.798470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.798583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.798706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.798732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.798862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.799016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.799041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.799169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.799335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.799368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.799546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.799664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.799692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.799801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.799907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.799934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.800056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.800198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.800226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.800372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.800478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.800505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.800672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.800847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.800876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:26.852 qpair failed and we were unable to recover it. 00:27:26.852 [2024-11-28 11:51:46.801015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.852 [2024-11-28 11:51:46.801147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.801173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.801309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.801412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.801437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.801569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.801700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.801725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.801858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.801995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.802020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.802125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.802248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.802275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.802405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.802562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.802588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.802722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.802850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.802875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.803040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.803173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.803198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.803333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.803465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.803495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.803636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.803793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.803819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.803949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.804078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.804103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.804230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.804352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.804378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.804479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.804612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.804639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.804775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.804905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.804931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.805038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.805172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.805198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.805328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.805485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.805511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.805696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.805834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.805860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.805994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.806128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.806154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.806261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.806394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.806419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.806559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.806693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.806718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.806852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.806984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.807009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.807114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.807245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.807271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.807383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.807533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.807559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.807720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.807851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.807876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.853 [2024-11-28 11:51:46.808009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.808143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.853 [2024-11-28 11:51:46.808169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.853 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.808298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.808392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.808418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.808579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.808738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.808764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.808861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.809019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.809044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.809179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.809350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.809375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.809494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.809660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.809687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.809820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.809948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.809973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.810082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.810184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.810209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.810312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.810444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.810469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.810607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.810768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.810793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.810913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.811075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.811101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.811234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.811334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.811359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.811520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.811661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.811686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.811787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.811911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.811936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.812045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.812202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.812228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.812335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.812461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.812487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.812607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.812734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.812760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.812892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.813048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.813073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.813217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.813341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.813367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.813479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.813582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.813609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.813764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.813921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.813951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.814058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.814160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.814185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.814323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.814430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.814456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.814570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.814702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.814727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.854 qpair failed and we were unable to recover it. 00:27:26.854 [2024-11-28 11:51:46.814885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.814989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.854 [2024-11-28 11:51:46.815014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.815177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.815275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.815301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.815433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.815567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.815593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.815702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.815860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.815885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.816001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.816131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.816156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.816287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.816415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.816440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.816572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.816705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.816736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.816873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.816983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.817008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.817170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.817301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.817326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.817429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.817562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.817588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.817695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.817861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.817887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.818048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.818154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.818179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.818341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.818466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.818492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.818633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.818760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.818786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.818922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.819080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.819106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.819236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.819371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.819396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.819560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.819664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.819694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.819801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.819913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.819938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.820067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.820171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.820196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.820363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.820488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.820513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.820664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.820792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.820816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.820946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.821080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.821105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.821241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.821344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.821370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.821535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.821690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.821715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.855 qpair failed and we were unable to recover it. 00:27:26.855 [2024-11-28 11:51:46.821826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.855 [2024-11-28 11:51:46.821927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.821953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.822066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.822171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.822197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.822328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.822440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.822470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.822588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.822694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.822721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.822847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.822979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.823006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.823137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.823271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.823296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.823455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.823555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.823581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.823739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.823877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.823902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.824072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.824203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.824229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.824392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.824549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.824575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.824674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.824780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.824807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.824940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.825083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.825109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.825243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.825382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.825407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.825546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.825680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.825706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.825867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.825999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.826024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.826122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.826255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.826279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.826417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.826550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.826577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.826708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.826811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.826838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.827000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.827140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.827165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.827276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.827407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.827432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.827535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.827657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.827683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.827783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.827927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.827952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.828087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.828201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.828227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.828377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.828484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.828509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.828673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.828801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.828828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.828967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.829094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.829120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.856 [2024-11-28 11:51:46.829230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.829334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.856 [2024-11-28 11:51:46.829359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.856 qpair failed and we were unable to recover it. 00:27:26.857 [2024-11-28 11:51:46.829460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.857 [2024-11-28 11:51:46.829663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.857 [2024-11-28 11:51:46.829689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.857 qpair failed and we were unable to recover it. 00:27:26.857 [2024-11-28 11:51:46.829824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.857 [2024-11-28 11:51:46.829979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.857 [2024-11-28 11:51:46.830004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.857 qpair failed and we were unable to recover it. 00:27:26.857 [2024-11-28 11:51:46.830146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.857 [2024-11-28 11:51:46.830247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.857 [2024-11-28 11:51:46.830272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.857 qpair failed and we were unable to recover it. 00:27:26.857 [2024-11-28 11:51:46.830380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.857 [2024-11-28 11:51:46.830535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.857 [2024-11-28 11:51:46.830561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.857 qpair failed and we were unable to recover it. 00:27:26.857 [2024-11-28 11:51:46.830701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.857 [2024-11-28 11:51:46.830846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.857 [2024-11-28 11:51:46.830872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.857 qpair failed and we were unable to recover it. 00:27:26.857 [2024-11-28 11:51:46.830984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.857 [2024-11-28 11:51:46.831152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.857 [2024-11-28 11:51:46.831178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:26.857 qpair failed and we were unable to recover it. 00:27:26.857 [2024-11-28 11:51:46.831292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.857 [2024-11-28 11:51:46.831402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.857 [2024-11-28 11:51:46.831427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.831549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.831663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.831688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.831824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.831970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.831996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.832163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.832301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.832329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.832483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.832621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.832648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.832769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.832879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.832905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.833012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.833179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.833207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.833357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.833467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.833494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.833617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.833722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.833748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.833860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.833972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.833997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.834107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.834244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.834270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.834377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.834511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.834544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.834656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.834763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.834790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.834925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.835085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.835111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.835212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.835343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.835368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.835480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.835584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.835610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.835733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.835840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.835865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.835974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.836122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.836147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-11-28 11:51:46.836257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-11-28 11:51:46.836363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.836388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.836500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.836641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.836667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.836783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.836929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.836954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.837065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.837171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.837197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.837341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.837444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.837470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.837583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.837727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.837753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.837866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.837973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.837998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.838104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.838218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.838244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.838372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.838476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.838501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.838666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.838826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.838855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.838978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.839122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.839149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.839252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.839382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.839408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.839518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.839637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.839664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.839784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.839900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.839925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.840059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.840163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.840190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.840292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.840420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.840446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.840568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.840663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.840688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.840798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.840931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.840957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.841065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.841168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.841196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.841362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.841510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.841542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.841661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.841815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.841841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.841966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.842067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.842092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.842220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.842338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.842368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.842535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.842679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.842706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.842822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.842956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.842982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.843197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.843332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.843358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.843489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.843601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.843627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.843729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.843843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.843869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-11-28 11:51:46.844006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-11-28 11:51:46.844109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.844135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.844267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.844374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.844399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.844514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.844651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.844677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.844782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.844893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.844919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.845055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.845187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.845213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.845316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.845427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.845453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.845590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.845691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.845717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.845827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.845944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.845970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.846085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.846218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.846244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.846380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.846512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.846543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.846653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.846783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.846808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.846912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.847031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.847057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.847220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.847350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.847376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.847483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.847614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.847640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.847856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.847970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.847996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.848127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.848258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.848284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.848427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.848540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.848567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.848678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.848809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.848834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.848980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.849117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.849142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.849244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.849358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.849383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.849490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.849602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.849628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.849731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.849834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.849860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.849992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.850098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.850124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.850259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.850357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.850382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.850532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.850666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.850692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.850806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.850945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.850970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.851076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.851184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.851209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.851344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.851449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.851475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-11-28 11:51:46.851625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-11-28 11:51:46.851767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.851793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.851912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.852045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.852071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.852227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.852353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.852378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.852485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.852627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.852653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.852760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.852859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.852885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.852987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.853104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.853130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.853288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.853393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.853419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.853558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.853663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.853688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.853800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.853932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.853957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.854060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.854175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.854201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.854316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.854442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.854468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.854589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.854738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.854767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.854866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.855001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.855027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.855192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.855291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.855317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.855421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.855530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.855557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.855699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.855826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.855852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.855990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.856098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.856124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.856225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.856329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.856356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.856492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.856630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.856657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.856795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.856930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.856956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.857089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.857218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.857243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.857387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.857490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.857517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.857666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.857797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.857823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.857974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.858132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.858158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.858264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.858370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.858396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.858498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.858634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.858660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.858781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.858911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.858942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.859083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.859181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.859207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-11-28 11:51:46.859308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.859409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-11-28 11:51:46.859435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.859577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.859681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.859706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.859837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.859973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.859999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.860138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.860274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.860300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.860435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.860554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.860581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.860691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.860803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.860829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.860966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.861066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.861092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.861227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.861359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.861385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.861517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.861661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.861692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.861839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.861955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.861981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.862089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.862196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.862221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.862368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.862502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.862534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.862701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.862829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.862855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.862988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.863102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.863128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.863231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.863341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.863369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.863504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.863619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.863646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.863780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.863936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.863962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.864098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.864200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.864225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.864335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.864437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.864469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.864630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.864733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.864758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.864874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.865032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.865058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.865195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.865294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.865319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.865433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.865542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.865568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.865711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.865840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.865866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.865971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.866070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.866096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.866203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.866336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-11-28 11:51:46.866362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-11-28 11:51:46.866463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.866565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.866591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.866730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.866868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.866893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.866999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.867154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.867184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.867321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.867457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.867483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.867603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.867738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.867764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.867904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.868005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.868031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.868163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.868267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.868294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.868430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.868536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.868562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.868664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.868775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.868801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.868907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.869065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.869091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.869263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.869393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.869419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.869534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.869635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.869661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.869762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.869893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.869920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.870058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.870200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.870226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.870327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.870453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.870479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.870597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.870703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.870729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.870906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.871062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.871087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.871224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.871328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.871355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.871460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.871589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.871615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.871713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.871818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.871843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.871955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.872089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.872116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.872225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.872322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.872347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.872515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.872650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.872676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.872842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.872956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.872982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.873114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.873222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.873248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.873409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.873540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.873566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.873733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.873898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.873924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.874057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.874165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.874190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.874328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.874488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.874513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-11-28 11:51:46.874658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-11-28 11:51:46.874762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.874788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.874921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.875021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.875048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.875184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.875313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.875338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.875466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.875574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.875602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.875710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.875870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.875896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.876004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.876134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.876160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.876266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.876373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.876400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.876538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.876700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.876726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.876848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.876958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.876984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.877089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.877221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.877246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.877377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.877559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.877586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.877717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.877846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.877871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.877975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.878106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.878133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.878250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.878382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.878408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.878555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.878665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.878690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.878810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.878923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.878948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.879077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.879208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.879234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.879397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.879536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.879562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.879662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.879821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.879846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.879982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.880125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.880151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.880312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.880417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.880444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.880547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.880653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.880681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.880842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.881002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.881028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.881140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.881269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.881294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.881401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.881553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.881579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.881726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.881872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.881898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.882034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.882160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.882186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.882285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.882411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.882436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.882537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.882666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.882692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.882799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.882834] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:27.173 [2024-11-28 11:51:46.882897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.882925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.882957] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:27.173 [2024-11-28 11:51:46.882976] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:27.173 [2024-11-28 11:51:46.882990] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:27.173 [2024-11-28 11:51:46.883035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.883061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:27.173 [2024-11-28 11:51:46.883138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.883162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 [2024-11-28 11:51:46.883117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.883120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:27.173 [2024-11-28 11:51:46.883091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:27.173 [2024-11-28 11:51:46.883271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.883387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.883413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.883532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.883690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.883715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.883829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.883933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.883958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.884092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.884222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.884247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.884384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.884486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.884512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.884625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.884757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.884783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.884889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.885000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.885025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.885133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.885244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.885270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.885375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.885473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.885498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.885606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.885713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.885738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-11-28 11:51:46.885879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-11-28 11:51:46.886001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.886027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.886130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.886264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.886289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.886390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.886489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.886515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.886632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.886745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.886771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.886887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.887020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.887046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.887157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.887260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.887286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.887418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.887521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.887554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.887668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.887773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.887800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.887924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.888047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.888073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.888208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.888311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.888337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.888435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.888541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.888568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.888710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.888809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.888835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.888957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.889068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.889094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.889201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.889304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.889330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.889429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.889544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.889570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.889678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.889780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.889806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.889907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.890033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.890058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.890159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.890273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.890298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.890405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.890504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.890544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.890678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.890786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.890812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.890918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.891025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.891052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.891220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.891336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.891367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.891517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.891626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.891653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.891784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.891911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.891937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.892038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.892164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.892190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.892330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.892440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.892466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.892593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.892699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.892725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.892840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.892987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.893012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.893127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.893285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.893311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.893409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.893518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.893552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.893684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.893789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.893815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.893972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.894096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.894126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.894230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.894340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.894366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.894538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.894639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.894666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.894807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.894943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.894969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.895131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.895235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.895261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.895370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.895503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.895537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.895653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.895783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.895808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.895938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.896047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.896073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.896230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.896380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.896406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.896515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.896636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.896662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.896797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.896913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.896940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.897047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.897145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.897171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-11-28 11:51:46.897308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.897434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-11-28 11:51:46.897460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.897577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.897720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.897746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.897850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.897976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.898003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.898149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.898266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.898293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.898425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.898578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.898604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.898712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.898844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.898870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.898968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.899129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.899155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.899258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.899361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.899387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.899481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.899640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.899666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.899806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.899905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.899932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.900072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.900177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.900203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.900352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.900541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.900567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.900705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.900833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.900858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.900953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.901083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.901108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.901214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.901343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.901369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.901513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.901626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.901652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.901755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.901892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.901918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.902013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.902144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.902170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.902300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.902420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.902446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.902554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.902668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.902695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.902852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.902949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.902975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.903116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.903215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.903241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.903373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.903506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.903539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.903640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.903769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.903794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.903901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.904006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.904031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.904152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.904257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.904284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.904386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.904483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.904508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.904674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.904835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.904861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-11-28 11:51:46.904963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.905095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-11-28 11:51:46.905121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.905233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.905339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.905365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.905493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.905656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.905682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.905792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.905923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.905950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.906059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.906193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.906219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.906319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.906478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.906503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.906649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.906757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.906783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.906887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.906989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.907014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.907151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.907277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.907302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.907402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.907523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.907557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.907694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.907812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.907842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.907947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.908050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.908076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.908206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.908308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.908333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.908434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.908564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.908590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.908704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.908813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.908838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.908946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.909053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.909079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.909184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.909310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.909335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.909468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.909575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.909602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.909710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.909811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.909837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.909954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.910089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.910114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.910222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.910352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.910383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.910549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.910680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.910705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.910805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.910912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.910939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.911077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.911179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.911205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.911311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.911438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.911463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.911604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.911734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.911761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.911876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.912023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.912048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.912151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.912281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.912307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.912442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.912542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.912569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.912668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.912765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.912790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.912884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.913041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.913071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.913214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.913343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.913369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.913485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.913638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.913665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.913769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.913869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.913895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.914025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.914126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.914151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.914277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.914383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.914411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.914531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.914643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.914669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.914802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.914922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.914948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.915110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.915218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.915245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.915351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.915489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.915518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-11-28 11:51:46.915669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.915772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-11-28 11:51:46.915799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.915923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.916032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.916057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.916211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.916317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.916343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.916477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.916598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.916625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.916735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.916858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.916884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.916988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.917115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.917141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.917287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.917417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.917442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.917582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.917699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.917726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.917841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.917974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.918000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.918108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.918211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.918236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.918344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.918447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.918473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.918630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.918732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.918758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.918904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.919034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.919060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.919209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.919351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.919377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.919536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.919636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.919662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.919792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.919899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.919924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.920032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.920134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.920161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.920263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.920401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.920428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.920539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.920666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.920691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.920799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.920944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.920970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.921079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.921237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.921263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.921403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.921534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.921560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.921696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.921796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.921823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.921961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.922092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.922117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.922224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.922321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.922349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.922453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.922572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.922598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.922733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.922879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.922905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.923043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.923147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.923172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.923282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.923414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.923440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.923584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.923711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.923737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.923848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.923979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.924005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.924113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.924250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.924276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.924442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.924563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.924590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.924740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.924885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.924911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.925011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.925111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.925137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.925271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.925372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.925397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.925532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.925637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.925664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.925801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.925896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.925921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.926057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.926196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.926222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.926334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.926461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.926487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-11-28 11:51:46.926599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.926706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-11-28 11:51:46.926731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.926881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.926985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.927011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.927115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.927223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.927249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.927385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.927492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.927518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.927627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.927738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.927763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.927920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.928064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.928089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.928227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.928350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.928377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.928478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.928596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.928622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.928758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.928870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.928895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.929007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.929136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.929161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.929293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.929440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.929465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.929587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.929721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.929746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.929896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.930031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.930056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.930159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.930257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.930282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.930389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.930538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.930564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.930672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.930775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.930800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.930943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.931083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.931109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.931212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.931324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.931350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.931468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.931584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.931610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.931744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.931856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.931881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.932012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.932111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.932136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.932293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.932390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.932416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.932553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.932657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.932685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.932789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.932891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.932917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.933050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.933176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.933202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.933301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.933430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.933456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.933563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.933693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.933719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.933853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.933962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.933987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.934116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.934214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.934239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.934344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.934503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.934538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.934757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.934887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.934913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.935050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.935162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.935187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.935289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.935403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.935429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.935576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.935713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.935739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.935845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.935981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.936007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.936146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.936287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-11-28 11:51:46.936313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-11-28 11:51:46.936418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.936547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.936574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.936676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.936835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.936861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.936974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.937103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.937128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.937277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.937379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.937405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.937511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.937628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.937654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.937867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.938005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.938030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.938134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.938250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.938278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.938379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.938507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.938538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.938676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.938781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.938806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.938938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.939075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.939100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.939205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.939307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.939334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.939435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.939595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.939621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.939727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.939829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.939854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.939953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.940055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.940082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.940177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.940303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.940328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.940433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.940552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.940579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.940712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.940856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.940881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.941021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.941122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.941148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.941253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.941363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.941389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.941559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.941669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.941695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.941792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.941919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.941945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.942063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.942169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.942195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.942301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.942431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.942456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.942565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.942693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.942719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.942854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.942985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.943011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.943113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.943243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.943268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.943398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.943502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.943532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.943686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.943825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.943850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.943980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.944166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.944191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.944296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.944405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.944431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.944598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.944729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.944755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.944903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.945032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.945058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.945166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.945267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.945292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.945396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.945530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.945557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.945664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.945763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.945788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.945898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.946052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.946079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.946203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.946310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.946336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.946495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.946625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.946651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.946775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.946884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.946912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-11-28 11:51:46.947029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-11-28 11:51:46.947165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.947191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.947297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.947421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.947446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.947560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.947666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.947692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.947828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.947930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.947957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.948130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.948263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.948289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.948421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.948538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.948565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.948705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.948812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.948843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.948988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.949093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.949118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.949253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.949387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.949413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.949541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.949640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.949666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.949793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.949895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.949921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.950025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.950130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.950157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.950298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.950437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.950463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.950576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.950677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.950703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.950808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.950949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.950975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.951108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.951267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.951293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.951397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.951533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.951564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.951671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.951779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.951812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.951957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.952050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.952075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.952209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.952354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.952380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.952513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.952632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.952658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.952768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.952887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.952914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.953048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.953185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.953211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.953314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.953448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.953475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.953604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.953707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.953732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.953830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.953984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.954010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.954112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.954211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.954241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.954348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.954483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.954519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.954664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.954790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.954816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.954974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.955079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.955106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.955218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.955380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.955405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.955522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.955664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.955690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.955850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.955952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.955979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.956117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.956226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.956253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.956367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.956479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.956504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.956643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.956757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.956783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.956893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.957032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.957062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.957200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.957329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.957354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.957488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.957614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.957640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.957738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.957897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.957923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-11-28 11:51:46.958031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.958128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-11-28 11:51:46.958154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.958260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.958362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.958389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.958489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.958647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.958673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.958782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.958908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.958934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.959036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.959139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.959165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.959326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.959457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.959483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.959649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.959784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.959817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.959957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.960059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.960085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.960188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.960319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.960345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.960480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.960615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.960641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.960776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.960906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.960932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.961046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.961148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.961173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.961282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.961388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.961414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.961555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.961665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.961692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.961811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.961925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.961950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.962113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.962244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.962269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.962374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.962503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.962546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.962695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.962802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.962827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.962998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.963137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.963163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.963266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.963368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.963393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.963561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.963665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.963691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.963811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.963940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.963965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.964070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.964200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.964225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.964337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.964446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.964472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.964586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.964716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.964741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.964856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.964952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.964978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.965114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.965219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.965244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.965352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.965485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.965511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.965621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.965722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.965747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.965870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.966002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.966027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.966132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.966261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.966286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.966386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.966518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.966551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.966673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.966775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.966800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.966901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.967007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.967032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.967167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.967324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.967350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.967458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.967576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.967602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.967708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.967806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.967831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.967955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.968095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.968120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.968223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.968348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.968373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.968483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.968619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-11-28 11:51:46.968645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-11-28 11:51:46.968785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.968884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.968909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.969022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.969123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.969148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.969247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.969374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.969399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.969497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.969633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.969660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.969773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.969917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.969942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.970044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.970152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.970177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.970276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.970398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.970424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.970577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.970708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.970734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.970834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.970940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.970965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.971098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.971237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.971262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.971424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.971559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.971585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.971737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.971875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.971901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.972030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.972132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.972159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.972268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.972426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.972452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.972611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.972737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.972762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.972869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.972974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.972999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.973137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.973262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.973287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.973394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.973499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.973529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.973651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.973749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.973774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.973887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.973992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.974017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.974121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.974259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.974284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.974448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.974556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.974583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.974725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.974858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.974885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.974997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.975098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.975123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.975222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.975350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.975375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.975520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.975669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.975695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.975824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.975930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.975956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.976068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.976200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.976225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.976336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.976469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.976494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.976607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.976732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.976757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.976876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.977040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.977065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.977199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.977332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.977357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.977496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.977611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.977638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.977746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.977889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.977914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.978044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.978143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.978170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-11-28 11:51:46.978281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.978413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-11-28 11:51:46.978439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.978553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.978686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.978712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.978832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.979011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.979039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.979183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.979319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.979344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.979480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.979605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.979632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.979767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.979899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.979925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.980055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.980158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.980184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.980286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.980381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.980406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.980513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.980648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.980674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.980802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.980957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.980982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.981109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.981238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.981263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.981394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.981515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.981546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.981652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.981791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.981822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.981963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.982099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.982125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.982237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.982375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.982400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.982510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.982649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.982675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.982781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.982881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.982906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.983007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.983136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.983161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.983268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.983369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.983394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.983509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.983650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.983676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.983824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.983952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.983977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.984103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.984207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.984233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.984364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.984467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.984494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.984608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.984721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.984746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.984860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.984984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.985010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.985110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.985214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.985240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.985357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.985498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.985530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.985636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.985763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.985788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.985892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.985994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.986020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.986161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.986291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.986316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.986472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.986580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.986606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.986745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.986859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.986885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.987027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.987136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.987164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.987302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.987401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.987427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.987529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.987636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.987662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.987772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.987919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.987945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.988080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.988208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.988233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.988338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.988495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.988520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.988635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.988743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-11-28 11:51:46.988768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-11-28 11:51:46.988872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.989000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.989026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.989123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.989262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.989288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.989392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.989531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.989557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.989664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.989802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.989828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.989928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.990035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.990061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.990190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.990319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.990344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.990481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.990601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.990627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.990769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.990878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.990903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.991043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.991148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.991174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.991270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.991368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.991393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.991488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.991625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.991652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.991783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.991877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.991903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.992041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.992142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.992167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.992269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.992371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.992400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.992518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.992660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.992686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.992819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.992919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.992944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.993045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.993146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.993173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.993274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.993402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.993427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.993570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.993668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.993693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.993795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.993897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.993922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.994062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.994196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.994222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.994353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.994455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.994481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.994596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.994694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.994719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.994856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.994988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.995018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.995157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.995248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.995274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.995391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.995552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.995578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.995679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.995811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.995837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.995936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.996073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.996100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.996200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.996305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.996331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.996466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.996577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.996603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.996706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.996833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.996858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.996966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.997066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.997092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.997203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.997339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.997364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.997468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.997604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.997635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.997752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.997890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.997916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.998077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.998178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.998205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.998311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.998410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.998436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.998554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.998655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.998680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.998848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.998943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.998969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.999100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.999201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.999227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.999337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.999442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.999468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.999590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.999723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.999749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.184 qpair failed and we were unable to recover it. 00:27:27.184 [2024-11-28 11:51:46.999856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.184 [2024-11-28 11:51:46.999987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.000013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.000122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.000257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.000287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.000386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.000522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.000561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.000659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.000758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.000784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.000887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.001020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.001046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.001160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.001304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.001330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.001435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.001543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.001569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.001669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.001772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.001798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.001902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.002008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.002033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.002138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.002240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.002265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.002394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.002493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.002518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.002635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.002770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.002796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.002936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.003064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.003089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.003221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.003319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.003345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.003448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.003583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.003609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.003708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.003813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.003839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.003964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.004073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.004098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.004245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.004371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.004397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.004531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.004628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.004654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.004765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.004876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.004902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.005001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.005097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.005123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.005278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.005437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.005462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.005574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.005705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.005731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.005842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.005934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.005959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.006060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.006154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.006179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.006287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.006387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.006413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.006522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.006656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.006682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.006774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.006903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.006930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.007030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.007124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.007150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.007283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.007383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.007408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.007551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.007676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.007702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.007830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.007935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.007960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.008076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.008205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.008230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.008344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.008442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.008467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.008572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.008679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.008705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.008815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.008942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.008968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.185 qpair failed and we were unable to recover it. 00:27:27.185 [2024-11-28 11:51:47.009066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.009195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.185 [2024-11-28 11:51:47.009221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.009326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.009423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.009448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.009593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.009726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.009752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.009884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.010019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.010045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.010147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.010240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.010266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.010400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.010500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.010531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.010664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.010801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.010826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.010933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.011030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.011055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.011151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.011247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.011274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.011404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.011500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.011539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.011645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.011744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.011770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.011875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.011978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.012002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.012129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.012260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.012287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.012388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.012490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.012515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.012631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.012734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.012758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.012862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.012969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.012994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.013104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.013214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.013239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.013346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.013473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.013499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.013645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.013741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.013766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.013892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.013998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.014024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.014127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.014261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.014287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.014395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.014504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.014538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.014638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.014744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.014769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.014874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.014973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.014998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.015097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.015204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.015229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.015328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.015423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.015448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.015618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.015723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.015750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.015848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.015952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.015977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.016107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.016216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.016241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.016402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.016493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.016518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.016649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.016779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.016805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.016915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.017018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.017043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.186 qpair failed and we were unable to recover it. 00:27:27.186 [2024-11-28 11:51:47.017178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.186 [2024-11-28 11:51:47.017283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.017309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.017410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.017507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.017536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.017665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.017797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.017822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.017953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.018047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.018072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.018177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.018278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.018304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.018436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.018537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.018565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.018667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.018765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.018790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.018924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.019055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.019080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.019175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.019285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.019310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.019417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.019522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.019554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.019657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.019758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.019782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.019884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.019993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.020019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.020128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.020252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.020276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.020385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.020482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.020508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.020631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.020726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.020752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.020854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.020950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.020975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.021086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.021214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.021239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.021344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.021472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.021496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.021599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.021700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.021725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.021824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.021929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.021953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.022059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.022188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.022213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.022342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.022447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.022471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.022580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.022682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.022708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.022806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.022928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.022954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.023095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.023202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.023227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.023320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.023450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.023475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.023583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.023690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.023716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.023823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.023980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.024006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.024109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.024233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.024258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.024386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.024503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.024534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.024643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.024743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.024768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.187 qpair failed and we were unable to recover it. 00:27:27.187 [2024-11-28 11:51:47.024899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.025001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.187 [2024-11-28 11:51:47.025026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.025127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.025236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.025262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.025363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.025491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.025517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.025655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.025773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.025799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.025897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.025998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.026023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.026161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.026260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.026285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.026440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.026548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.026574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.026704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.026810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.026836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.026968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.027096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.027121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.027224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.027318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.027344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.027503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.027638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.027664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.027796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.027890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.027916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.028071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.028202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.028227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.028326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.028466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.028491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.028603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.028728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.028754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.028887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.029014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.029040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.029136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.029240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.029265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.029367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.029469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.029496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.029636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.029765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.029791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.029896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.030025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.030051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.030154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.030261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.030286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.030384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.030494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.030519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.030635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.030761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.030786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.030893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.030998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.031022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.031185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.031288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.031312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.031439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.031571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.031596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.031729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.031860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.031886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.031987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.032098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.032124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.032260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.032392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.032419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.032522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.032634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.188 [2024-11-28 11:51:47.032659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.188 qpair failed and we were unable to recover it. 00:27:27.188 [2024-11-28 11:51:47.032798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.032926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.032951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.033053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.033155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.033181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.033320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.033481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.033506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.033644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.033746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.033775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.033875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.033978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.034003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.037669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.037798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.037827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.037955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.038051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.038077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.038207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.038310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.038336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.038444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.038553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.038580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.038687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.038823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.038849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.039000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.039125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.039150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.039283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.039383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.039408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.039516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.039653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.039678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.039808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.039941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.039971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.040074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.040229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.040254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.040382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.040480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.040505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.040651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.040753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.040780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.040883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.041038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.041063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.041172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.041304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.041330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.041460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.041590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.041618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.041728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.041834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.041860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.041990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.042089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.042116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.042215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.042350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.042376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.042490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.042630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.042662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.189 qpair failed and we were unable to recover it. 00:27:27.189 [2024-11-28 11:51:47.042762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.042886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.189 [2024-11-28 11:51:47.042912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.043041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.043178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.043204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.043303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.043401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.043428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.043557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.043708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.043735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.043843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.043978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.044004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.044100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.044194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.044219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.044350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.044484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.044509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.044619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.044733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.044758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.044868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.044976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.045002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.045101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.045229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.045255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.045363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.045458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.045483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.045649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.045748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.045773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.045879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.046013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.046039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.046173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.046289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.046315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.046422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.046559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.046585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.046693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.046793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.046820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.046945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.047049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.047074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.047182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.047285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.047312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.047414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.047541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.047567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.047674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.047775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.047802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.047919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.048028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.048053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.048151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.048278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.048302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.048433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.048541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.048567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.048669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.048772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.048798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.048903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.049000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.049026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.049137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.049270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.049295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.049404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.049544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.049570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.049673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.049803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.049827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.049933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.050031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.050055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.190 qpair failed and we were unable to recover it. 00:27:27.190 [2024-11-28 11:51:47.050165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.050265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.190 [2024-11-28 11:51:47.050289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.050404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.050505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.050538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.050641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.050776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.050800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.050929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.051029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.051054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.051191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.051285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.051310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.051412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.051549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.051591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.051725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.051879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.051904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.052008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.052111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.052135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.052241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.052340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.052365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.052480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.052606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.052634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.052739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.052851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.052877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.052984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.053078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.053103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.053207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.053310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.053335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.053497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.053602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.053629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.053730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.053832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.053857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.053963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.054088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.054114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.054220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.054349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.054376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.054482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.054613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.054639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.054776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.054913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.054938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.055039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.055136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.055161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.055263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.055390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.055416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.055563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.055695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.055720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.055824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.055957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.055982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.056091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.056185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.056210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.056317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.056472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.056497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.056610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.056708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.056732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.056890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.057017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.057041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.057171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.057276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.057300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.057404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.057502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.057531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.057634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.057726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.057750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.057854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.057966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.057992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.058126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.058232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.058257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.191 [2024-11-28 11:51:47.058392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.058491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.191 [2024-11-28 11:51:47.058517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.191 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.058685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.058784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.058808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.058966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.059099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.059123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.059232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.059337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.059362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.059472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.059606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.059632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.059788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.059888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.059914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.060072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.060202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.060228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.060332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.060442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.060467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.060595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.060703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.060728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.060892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.061021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.061045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.061183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.061308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.061333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.061438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.061540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.061566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.061670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.061775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.061800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.061930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.062087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.062113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.062249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.062351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.062376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.062477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.062598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.062623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.062727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.062826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.062852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.062947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.063058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.063082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.063187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.063316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.063340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.063489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.063641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.063671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.063780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.063886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.063912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.064006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.064150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.064176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.064289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.064391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.064416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.064549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.064657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.064684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.064788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.064947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.064973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.065082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.065191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.065218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.065326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.065428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.065455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.065569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.065693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.065719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.065832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.065934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.065959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.066061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.066196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.066222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.066339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.066470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.066496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.066604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.066733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.066759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.066863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.066988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.067014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.192 qpair failed and we were unable to recover it. 00:27:27.192 [2024-11-28 11:51:47.067147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.192 [2024-11-28 11:51:47.067265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.067291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.067394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.067491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.067517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.067679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.067810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.067837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.067938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.068039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.068066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.068225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.068327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.068352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.068458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.068558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.068584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.068688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.068793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.068819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.068935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.069067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.069092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.069229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.069337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.069363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.069500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.069604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.069630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.069760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.069864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.069889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.069993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.070096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.070121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.070228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.070329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.070355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.070515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.070644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.070671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.070803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.070908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.070934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.071060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.071185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.071210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.071316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.071450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.071476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.071615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.071718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.071744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.071839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.071936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.071963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.072102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.072243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.072270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.072408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.072504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.072537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.072639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.072748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.072773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.072936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.073066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.073091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.073202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.073307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.073332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.073433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.073591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.073617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.073751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.073886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.073912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.074051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.074150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.074175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.193 [2024-11-28 11:51:47.074287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.074387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.193 [2024-11-28 11:51:47.074413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.193 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.074577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.074682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.074709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.074841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.074972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.074997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.075135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.075240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.075266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.075363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.075467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.075493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.075599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.075696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.075722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.075862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.075989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.076014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.076124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.076224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.076249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.076375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.076470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.076496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.076609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.076716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.076747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.076883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.077019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.077044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.077143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.077275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.077301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.077402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.077506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.077540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.077680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.077786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.077813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.077972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.078067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.078093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.078227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.078327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.078352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.078491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.078610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.078636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.078737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.078838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.078864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.078972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.079132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.079158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.079263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.079361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.079391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.079496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.079644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.079671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.079768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.079873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.079900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.080032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.080156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.080182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.080319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.080415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.080441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.080542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.080642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.080667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.080804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.080928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.080953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.081088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.081201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.081228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.081337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.081442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.081467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.081579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.081708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.081733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.081845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.081953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.081985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.082089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.082198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.082223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.082362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.082469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.082494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.194 qpair failed and we were unable to recover it. 00:27:27.194 [2024-11-28 11:51:47.082631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.194 [2024-11-28 11:51:47.082742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.082767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.082868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.083004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.083029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.083136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.083254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.083281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.083438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.083565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.083591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.083697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.083828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.083854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.084014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.084124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.084149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.084257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.084385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.084410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.084549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.084651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.084681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.084789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.084920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.084947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.085080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.085188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.085213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.085351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.085474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.085499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.085641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.085740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.085767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.085899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.085998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.086023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.086118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.086221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.086247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.086379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.086478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.086504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.086644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.086776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.086802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.086899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.087037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.087063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.087222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.087349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.087374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.087488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.087657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.087684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.087796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.087929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.087955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.088107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.088231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.088257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.088364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.088500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.088533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.088639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.088746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.088771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.088909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.089009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.089034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.089166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.089295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.089321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.089424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.089523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.089555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.089666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.089779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.089805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.089905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.090043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.090069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.090175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.090314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.090339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.090445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.090552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.090585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.090699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.090850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.090875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.090982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.091118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.091144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.091283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.091413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.091439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.195 qpair failed and we were unable to recover it. 00:27:27.195 [2024-11-28 11:51:47.091549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.195 [2024-11-28 11:51:47.091652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.091679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.091812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.091921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.091946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.092079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.092206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.092232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.092332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.092478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.092503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.092621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.092755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.092781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.092893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.092992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.093018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.093126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.093228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.093254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.093402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.093507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.093540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.093675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.093823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.093849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.093976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.094101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.094127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.094263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.094369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.094395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.094499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.094634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.094660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.094761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.094856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.094883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.094991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.095094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.095119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.095230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.095354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.095380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.095515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.095650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.095676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.095775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.095875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.095900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.096006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.096170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.096196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.096300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.096409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.096436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.096549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.096678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.096703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.096811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.096917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.096943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.097074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.097171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.097196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.097292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.097446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.097471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.097607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.097739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.097765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.097894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.098007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.098032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.098143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.098248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.098274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.098411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.098568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.098594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.098693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.098797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.098824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.098932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.099042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.099067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.099209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.099345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.099371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.099466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.099680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.099707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.099809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.099965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.099990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.196 qpair failed and we were unable to recover it. 00:27:27.196 [2024-11-28 11:51:47.100154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.196 [2024-11-28 11:51:47.100364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.100390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.100496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.100638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.100665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.100797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.100956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.100982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.101099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.101198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.101224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.101328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.101423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.101448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.101586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.101685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.101712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.101829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.101932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.101958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.102074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.102166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.102191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.102292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.102399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.102425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.102537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.102636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.102662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.102761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.102888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.102913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.103011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.103111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.103137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.103274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.103431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.103456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.103597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.103730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.103756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.103857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.103956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.103983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.104142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.104275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.104301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.104433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.104534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.104561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.104668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.104794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.104820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.104981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.105081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.105107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.105240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.105365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.105391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.105518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.105629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.105654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.105768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.105875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.105901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.106050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.106186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.106212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.106363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.106495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.106521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.106639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.106762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.106787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.106890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.106988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.197 [2024-11-28 11:51:47.107013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.197 qpair failed and we were unable to recover it. 00:27:27.197 [2024-11-28 11:51:47.107139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.107240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.107266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.107383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.107510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.107543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.107682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.107783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.107808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.107937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.108083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.108108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.108238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.108339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.108364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.108458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.108605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.108632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.108732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.108841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.108867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.108997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.109135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.109161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.109292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.109395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.109421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.109549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.109697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.109722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.109871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.109998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.110024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.110153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.110259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.110285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.110399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.110530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.110557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.110665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.110763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.110789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.110892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.110991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.111016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.111132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.111277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.111302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.111417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.111553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.111579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.111704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.111815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.111841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.111957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.112104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.112129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.112263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.112417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.112442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.112545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.112692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.112717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.112826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.112954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.112980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.113117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.113218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.113244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.113352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.113479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.113505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.113640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.113750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.113777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.113912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.114009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.114035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.114155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.114255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.114281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.114399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.114510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.114540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.114690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.114793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.114818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.114927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.115048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.115074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.115201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.115379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.115404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.198 [2024-11-28 11:51:47.115547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.115655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.198 [2024-11-28 11:51:47.115682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.198 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.115825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.115957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.115983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.116094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.116189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.116214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.116312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.116408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.116433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.116543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.116675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.116701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.116810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.116907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.116932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.117069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.117210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.117235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.117337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.117438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.117464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.117606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.117713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.117740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.117886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.117987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.118012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.118142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.118246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.118271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.118384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.118492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.118518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.118658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.118783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.118809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.118956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.119083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.119110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.119257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.119392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.119417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.119559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.119670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.119695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.119829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.119959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.119989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.120095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.120200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.120226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.120333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.120460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.120485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.120595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.120693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.120719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.120825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.120929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.120954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.121086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.121214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.121239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.121372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.121473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.121498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.121619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.121718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.121744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.121916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.122015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.122040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.122137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.122292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.122318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.122452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.122565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.122596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.122766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.122881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.122906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.123042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.123149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.123174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.123276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.123384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.123410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.123558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.123681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.123706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.123808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.123909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.199 [2024-11-28 11:51:47.123934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.199 qpair failed and we were unable to recover it. 00:27:27.199 [2024-11-28 11:51:47.124038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.124164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.124190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.124296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.124421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.124446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.124589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.124721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.124747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.124858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.124955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.124980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.125092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.125225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.125255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.125365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.125494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.125520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.125665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.125766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.125791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.125905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.126060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.126086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.126187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.126289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.126314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.126423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.126553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.126579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.126722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.126819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.126844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.126950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.127080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.127106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.127234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.127340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.127365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.127496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.127612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.127638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.127768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.127880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.127911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.128015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.128109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.128134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.128248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.128400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.128426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.128565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.128691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.128716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.128829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.128930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.128955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.129091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.129222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.129247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.129348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.129477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.129503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.129614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.129721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.129747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.129893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.130019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.130044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.130140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.130233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.130258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.130393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.130496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.130521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.130640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.130746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.130772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.130929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.131033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.131059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.131174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.131283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.131308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.131437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.131551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.131577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.131708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.131813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.131838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.131973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.132098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.132123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.132283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.132409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.132435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.200 qpair failed and we were unable to recover it. 00:27:27.200 [2024-11-28 11:51:47.132541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.200 [2024-11-28 11:51:47.132641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.132667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.132784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.132911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.132937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.133042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.133171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.133197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.133314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.133448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.133474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.133596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.133756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.133781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.133898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.134003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.134030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.134169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.134293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.134318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.134422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.134529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.134556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.134670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.134796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.134822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.134954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.135058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.135084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.135193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.135293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.135320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.135448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.135561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.135587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.135715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.135816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.135841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.135975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.136105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.136131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.136233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.136368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.136393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.136490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.136600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.136626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.136751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.136889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.136914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.137044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.137172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.137197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.137300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.137405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.137430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.137534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.137634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.137660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.137762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.137858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.137884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.137979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.138072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.138098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.138237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.138361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.138387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.138523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.138633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.138660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.138793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.138926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.138952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.139055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.139181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.139206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.139311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.139407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.139433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.139568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.139725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.139750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.139879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.140011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.140036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.140141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.140282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.140307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.201 qpair failed and we were unable to recover it. 00:27:27.201 [2024-11-28 11:51:47.140409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.140507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.201 [2024-11-28 11:51:47.140538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.140646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.140753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.140780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.140907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.141006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.141032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.141135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.141259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.141284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.141387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.141489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.141515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.141630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.141741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.141766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.141876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.141973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.141997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.142128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.142227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.142253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.142352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.142486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.142511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.142624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.142782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.142807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.142936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.143039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.143064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.143190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.143295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.143322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.143422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.143574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.143599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.143717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.143812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.143837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.143942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.144097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.144122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.144233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.144343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.144368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.144479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.144610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.144637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.144751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.144895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.144920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.145022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.145129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.145154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.145250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.145347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.145372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.145478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.145637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.145662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.145803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.145936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.145961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.146063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.146170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.146195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.146364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.146478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.146506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.146655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.146761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.146788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.146935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.147048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.147073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.147185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.147290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.147316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.147416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.147537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.147563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.147666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.147759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.147784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.147888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.147981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.148010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.148136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.148232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.148261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.148418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.148522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.148552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.202 qpair failed and we were unable to recover it. 00:27:27.202 [2024-11-28 11:51:47.148664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.148791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.202 [2024-11-28 11:51:47.148816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.148969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.149147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.149175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.149318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.149424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.149449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.149586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.149724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.149750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.149847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.149948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.149975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.150083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.150189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.150214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.150321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.150421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.150446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.150574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.150685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.150710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.150859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.150959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.150984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.151090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.151216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.151241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.151350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.151477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.151501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.151611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.151721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.151747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.151881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.152038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.152063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.152167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.152270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.152295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.152405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.152501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.152531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.152638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.152744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.152769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.152906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.153036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.153061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.153168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.153293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.153318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.153425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.153557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.153583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.153683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.153782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.153806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.153911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.154020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.154044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.154143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.154242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.154272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.154403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.154552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.154579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.154681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.154779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.154804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.154930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.155038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.155063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.155192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.155290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.155315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.155423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.155529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.155564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.155675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.155806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.155830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.155934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.156023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.156048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.156175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.156273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.156297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.156401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.156502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.156533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.156638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.156796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.156822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.156969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.157080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.203 [2024-11-28 11:51:47.157104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.203 qpair failed and we were unable to recover it. 00:27:27.203 [2024-11-28 11:51:47.157207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.157300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.157325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.157452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.157580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.157606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.157734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.157942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.157966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.158099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.158223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.158247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.158376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.158482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.158506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.158620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.158725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.158751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.158866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.158995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.159020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.159133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.159231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.159256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.159365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.159493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.159518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.159670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.159769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.159794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.159896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.160000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.160025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.160159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.160287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.160312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.160442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.160546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.160572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.160682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.160786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.160812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.160913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.161044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.161069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.161207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.161335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.161360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.161463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.161567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.161593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.161696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.161803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.161828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.162040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.162172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.162196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.162327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.162430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.162455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.162558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.162687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.162711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.162819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.162962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.162986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.163116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.163215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.163239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.163335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.163443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.163468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.163587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.163690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.163715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.163818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.163926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.163952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.164061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.164173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.164198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.164306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.164401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.164426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.164522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.164637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.164662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.164795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.164902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.164926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.165064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.165170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.165195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.165297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.165401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.165425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.165539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.165663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.165688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.204 [2024-11-28 11:51:47.165796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.165900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.204 [2024-11-28 11:51:47.165925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.204 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.166033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.166134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.166159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.166293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.166420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.166445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.166548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.166692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.166717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.166814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.166955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.166980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.167088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.167185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.167210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.167338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.167445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.167476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.167619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.167750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.167776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.167901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.168030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.168055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.168188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.168287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.168312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.168443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.168549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.168574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.168675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.168805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.168831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.168991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.169087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.169114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.169213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.169310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.169336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.169431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.169537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.169563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.169702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.169800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.169825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.169941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.170032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.170058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.170194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.170294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.170320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.170429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.170554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.170580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.170789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.170890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.170915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.171012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.171108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.171133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.171239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.171338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.171363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.171467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.171605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.171631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.171800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.171910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.171935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.172046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.172153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.172178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.172306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.172435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.172459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.172563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.172654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.172678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.172815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.172939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.172964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.173070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.173169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.173194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.173328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.173430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.173455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.205 [2024-11-28 11:51:47.173569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.173693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.205 [2024-11-28 11:51:47.173718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.205 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.173845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.173952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.173977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.174085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.174190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.174215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.174345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.174448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.174473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.174580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.174680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.174705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.174832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.174953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.174978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.175081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.175209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.175234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.175342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.175441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.175466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.175570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.175682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.175707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.175816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.175919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.175944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.176079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.176286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.176311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.176446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.176578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.176603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.176715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.176817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.176842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.176979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.177076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.177100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.177193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.177294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.177318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.177537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.177672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.177697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.177791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.177922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.177947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.178049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.178187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.178212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.178345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.178451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.178475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.178583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.178706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.178730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.178837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.178962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.178987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.179093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.179200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.179225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.179326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.179429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.179454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.206 qpair failed and we were unable to recover it. 00:27:27.206 [2024-11-28 11:51:47.179587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.206 [2024-11-28 11:51:47.179696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.179722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.179832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.179934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.179959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.180062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.180161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.180186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.180321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.180419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.180444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.180549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.180678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.180707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.180807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.180946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.180970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.181096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.181202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.181227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.181335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.181462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.181487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.181600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.181701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.181725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.181849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.181952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.181977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.182110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.182239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.182264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.182367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.182462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.182487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.182600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.182708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.182733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.182864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.183070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.183095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.183304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.183428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.183457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.183593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.183730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.183754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.183862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.183962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.183988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.184088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.184195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.184219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.184326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.184428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.184453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.184664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.184759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.184784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.184886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.185010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.185035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.185144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.185252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.185277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.185389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.185483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.185508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.185620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.185722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.185747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.185877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.185975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.185999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.186110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.186238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.186263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.186395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.186486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.186511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.186632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.186773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.186798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.207 qpair failed and we were unable to recover it. 00:27:27.207 [2024-11-28 11:51:47.186910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.187011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.207 [2024-11-28 11:51:47.187037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.187135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.187233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.187258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.187370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.187461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.187485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.187641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.187775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.187799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.187899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.187996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.188021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.188135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.188234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.188259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.188395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.188535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.188560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.188663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.188765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.188790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.188898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.189001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.189025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.189135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.189250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.189275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.189406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.189574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.189599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.189702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.189808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.189832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.189963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.190067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.190092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.190228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.190360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.190386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.190480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.190586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.190611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.190745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.190876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.190901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.191034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.191138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.191163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.191270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.191377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.191402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.191502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.191609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.191635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.191743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.191845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.191869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.191973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.192074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.192098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.192202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.192299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.192323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.192426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.192584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.192609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.192740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.192843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.192869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.193030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.193130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.193154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.193290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.193386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.193411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.193516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.193656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.193681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.193782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.193895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.193921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.208 qpair failed and we were unable to recover it. 00:27:27.208 [2024-11-28 11:51:47.194024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.208 [2024-11-28 11:51:47.194156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.209 [2024-11-28 11:51:47.194180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.209 qpair failed and we were unable to recover it. 00:27:27.209 [2024-11-28 11:51:47.194287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.209 [2024-11-28 11:51:47.194395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.209 [2024-11-28 11:51:47.194420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.209 qpair failed and we were unable to recover it. 00:27:27.209 [2024-11-28 11:51:47.194564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.209 [2024-11-28 11:51:47.194675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.209 [2024-11-28 11:51:47.194703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.209 qpair failed and we were unable to recover it. 00:27:27.209 [2024-11-28 11:51:47.194818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.209 [2024-11-28 11:51:47.194979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.209 [2024-11-28 11:51:47.195006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.209 qpair failed and we were unable to recover it. 00:27:27.209 [2024-11-28 11:51:47.195109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.209 [2024-11-28 11:51:47.195215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.209 [2024-11-28 11:51:47.195242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.209 qpair failed and we were unable to recover it. 00:27:27.209 [2024-11-28 11:51:47.195339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.209 [2024-11-28 11:51:47.195475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.209 [2024-11-28 11:51:47.195501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.209 qpair failed and we were unable to recover it. 00:27:27.209 [2024-11-28 11:51:47.195619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.195730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.195756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-11-28 11:51:47.195853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.195990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.196015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-11-28 11:51:47.196129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.196222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.196247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-11-28 11:51:47.196385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.196485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.196513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-11-28 11:51:47.196619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.196743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.196768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-11-28 11:51:47.196911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.197040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.197065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-11-28 11:51:47.197206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.197310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.197335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-11-28 11:51:47.197435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.197535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.197561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-11-28 11:51:47.197656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.197758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.197783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-11-28 11:51:47.197890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.197987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.198012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-11-28 11:51:47.198154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.198263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.198287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-11-28 11:51:47.198499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.198637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.198662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-11-28 11:51:47.198772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.198877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.198904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-11-28 11:51:47.199009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.199109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.199135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-11-28 11:51:47.199235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.199340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-11-28 11:51:47.199365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.199474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.199613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.199639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.199742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.199862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.199887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.199996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.200100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.200125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.200257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.200359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.200384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.200483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.200605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.200630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.200726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.200818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.200843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.200944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.201042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.201067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.201173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.201280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.201304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.201436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.201565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.201590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.201736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.201832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.201857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.201988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.202098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.202123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.202231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.202331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.202356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.202463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.202564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.202589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.202695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.202799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.202823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.202929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.203026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.203052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.203154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.203256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.203281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.203378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.203503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.203547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.203657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.203766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.203790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.203891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.203985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.204010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.204122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.204229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.204254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.204387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.204491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.204516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.204631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.204726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.204752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.204855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.204953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.204978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.205081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.205174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.205199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.205301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.205437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.205462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.205570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.205679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.205705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.205809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.205939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.205964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.206066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.206165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.206189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-11-28 11:51:47.206336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.206436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-11-28 11:51:47.206461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.206646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.206795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.206824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.206965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.207097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.207123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.207224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.207322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.207348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.207479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.207584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.207611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.207720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.207821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.207847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.207957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.208054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.208079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.208216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.208345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.208370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.208483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.208601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.208627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.208758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.208857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.208882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.209010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.209107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.209133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.209245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.209390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.209416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.209517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.209633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.209659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.209766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.209865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.209890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.210055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.210175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.210200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.210310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.210413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.210439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.210544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.210647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.210673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.210835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.210966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.210992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.211097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.211223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.211248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.211347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.211451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.211478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.211592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.211700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.211726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.211834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.211967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.211992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.212126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.212226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.212252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.212357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.212487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.212512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.212622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.212757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.212784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.212912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.213009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.213035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.213164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.213261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.213286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.213384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.213539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.213565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.213679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.213785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.213812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-11-28 11:51:47.213948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.214054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-11-28 11:51:47.214080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.214209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.214337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.214362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.214522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.214627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.214657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.214821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.214953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.214978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.215075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.215205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.215231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.215343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.215450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.215475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.215586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.215697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.215724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.215831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.215930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.215956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.216058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.216219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.216245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.216361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.216493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.216518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.216656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.216788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.216814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.216924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.217026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.217053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.217187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.217313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.217344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.217444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.217546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.217573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.217679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.217810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.217835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.217941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.218073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.218098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.218241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.218337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.218364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.218469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.218593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.218619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.218760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.218862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.218887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.218990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.219082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.219107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.219219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.219343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.219368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.219504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.219634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.219660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.219769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.219897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.219927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.220032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.220163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.220189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.220302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.220399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.220426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.220569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.220676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.220702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.220808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.220935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.220961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.221101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.221204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.221229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-11-28 11:51:47.221360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-11-28 11:51:47.221463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.221488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.221595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.221723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.221749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.221887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.221987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.222015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.222145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.222251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.222277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.222372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.222511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.222550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.222655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.222794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.222820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.222925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.223059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.223085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.223223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.223322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.223349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.223467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.223566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.223592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.223692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.223821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.223846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.223953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.224088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.224114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.224249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.224352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.224378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.224485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.224598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.224624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.224726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.224856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.224882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.224988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.225124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.225150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.225288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.225423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.225448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.225610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.225713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.225738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.225846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.225943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.225968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.226094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.226198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.226224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.226320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.226449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.226475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.226618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.226724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.226749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.226883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.226979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.227005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.227102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.227229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.227254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.227391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.227494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.227520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.227666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.227775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.227802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.227942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.228082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.228107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.228242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.228339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.228364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-11-28 11:51:47.228467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.228590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-11-28 11:51:47.228616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.228716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.228820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.228847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.228953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.229051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.229077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.229207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.229309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.229335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.229464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.229591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.229617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.229756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.229882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.229907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.230015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.230142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.230167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.230295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.230400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.230426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.230565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.230691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.230717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.230827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.230933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.230959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.231100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.231226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.231252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.231362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.231462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.231487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.231611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.231716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.231741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.231869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.231977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.232002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.232137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.232290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.232316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.232420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.232533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.232561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.232694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.232827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.232853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.232964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.233064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.233089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.233205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.233338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.233363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.233488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.233601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.233627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.233759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.233918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.233943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.234043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.234164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.234189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.234323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.234421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.234447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.234556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.234691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.234717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.234853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.234979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.235004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.235111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.235218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-11-28 11:51:47.235243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-11-28 11:51:47.235384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.235487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.235512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.235646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.235745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.235770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.235905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.236009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.236034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.236143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.236248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.236273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.236370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.236473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.236499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.236633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.236734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.236761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.236902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.237031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.237058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.237152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.237256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.237281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.237388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.237538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.237564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.237668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.237798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.237823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.237927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.238027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.238053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.238163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.238263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.238289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.238407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.238498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.238531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.238646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.238775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.238800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.238934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.239031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.239056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.239224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.239325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.239352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.239514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.239675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.239701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.239827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.239926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.239953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.240092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.240225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.240251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.240358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.240483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.240508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.240624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.240724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.240750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.240914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.241018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.241044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.241157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.241252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.241278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.241375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.241500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.241533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.241638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.241748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.241774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.241907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.242020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.242046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.242152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.242251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.242276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.242389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.242492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.242518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-11-28 11:51:47.242665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.242802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-11-28 11:51:47.242828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.242962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.243069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.243095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.243230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.243327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.243352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.243478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.243577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.243603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.243710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.243813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.243841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.243950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.244106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.244131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.244238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.244342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.244368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.244461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.244567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.244593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.244724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.244825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.244850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.244957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.245061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.245087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.245193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.245324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.245349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.245446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.245550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.245577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.245690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.245848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.245874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.245988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.246142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.246167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.246325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.246464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.246489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.246602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.246702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.246727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.246836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.246942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.246968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.247071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.247170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.247197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.247308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.247408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.247435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.247565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.247676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.247702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.247804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.247905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.247932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.248043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.248150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.248175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.248312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.248443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.248469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.248597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.248734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.248759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.248860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.249012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.249037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.249176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.249339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.249365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.249475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.249588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.249614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.249719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.249827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.249853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.249960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.250059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.250085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-11-28 11:51:47.250193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.250299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-11-28 11:51:47.250325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.250458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.250562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.250588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.250688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.250813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.250838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.250970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.251101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.251128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.251260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.251396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.251422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.251555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.251685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.251711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.251870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.252002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.252027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.252156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.252251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.252277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.252378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.252509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.252541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.252648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.252783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.252809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.252913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.253022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.253047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.253152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.253282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.253308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.253448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.253553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.253582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.253692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.253794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.253820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.253922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.254015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.254042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.254176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.254285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.254310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.254411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.254512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.254542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.254652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.254809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.254834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.254947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.255079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.255105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.255207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.255314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.255340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.255440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.255539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.255566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.255674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.255831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.255856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.255953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.256088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.256113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.256270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.256390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.256416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.256582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.256681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.256707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.256842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.256950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.256981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.257118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.257251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.257278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.257383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.257513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.257547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.257650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.257747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.257773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-11-28 11:51:47.257879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.258005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-11-28 11:51:47.258031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.258162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.258291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.258317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.258449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.258559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.258597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.258758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.258888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.258914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.259022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.259156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.259183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.259291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.259422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.259448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.259551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.259712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.259742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.259889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.260002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.260029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.260162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.260260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.260286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.260396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.260495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.260522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.260671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.260773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.260799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.260908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.261041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.261065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.261162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.261308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.261334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.261471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.261580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.261606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.261709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.261815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.261840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.261993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.262093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.262119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.262263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.262396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.262427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.262552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.262660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.262686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.262812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.262943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.262969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.263078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.263210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.263235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.263337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.263465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.263490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.263607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.263713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.263740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.263873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.264008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.264034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.264145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.264293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.264318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.264418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.264534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.264560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-11-28 11:51:47.264660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.264761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-11-28 11:51:47.264787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.264894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.265003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.265033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.265131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.265263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.265289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.265401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.265516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.265547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.265666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.265801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.265827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.265934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.266060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.266085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.266191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.266354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.266379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.266532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.266647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.266672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.266785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.266888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.266914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.267051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.267162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.267188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.267298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.267406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.267432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.267571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.267673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.267700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.267812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.267924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.267949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.268081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.268180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.268205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.268304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.268410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.268437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.268569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.268681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.268707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.268809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.268939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.268965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.269122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.269228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.269253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.269361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.269454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.269479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.269631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.269759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.269784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.269893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.270021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.270046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.270186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.270288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.270314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.270416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.270549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.270586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.270692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.270822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.270848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.270984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.271080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.271107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.271223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.271324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.271349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.271461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.271558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.271585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.271687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.271791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.271817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.271921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.272055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.272080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-11-28 11:51:47.272188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.272316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-11-28 11:51:47.272341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.272500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.272661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.272686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.272824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.272927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.272953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.273087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.273185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.273210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.273337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.273442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.273469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.273569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.273729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.273755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.273873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.274008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.274034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.274145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.274255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.274281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.274410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.274521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.274552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.274658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.274789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.274815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.274922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.275020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.275046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.275176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.275284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.275310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.275410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.275561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.275596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.275738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.275874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.275900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.276033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.276168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.276194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.276295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.276425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.276451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.276567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.276669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.276695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.276803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.276900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.276925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.277053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.277178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.277203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.277341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.277453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.277478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.277595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.277727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.277753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.277856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.277987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.278013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.278148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.278306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.278331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.278443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.278550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.278576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.278702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.278833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.278858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.278961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.279059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.279085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.279203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.279304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.279330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.279430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.279541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.279568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.279704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.279829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.279855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-11-28 11:51:47.279960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.280087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-11-28 11:51:47.280114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.280258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.280385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.280410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.280515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.280632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.280659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.280769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.280897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.280922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.281029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.281142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.281167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.281314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.281425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.281450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.281545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.281649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.281674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.281778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.281872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.281898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.282008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.282140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.282166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.282311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.282468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.282493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.282625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.282729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.282756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.282905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.283035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.283061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.283202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.283305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.283330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.283439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.283585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.283611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.283740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.283863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.283891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.284039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.284170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.284195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.284335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.284433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.284459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.284578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.284676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.284701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.284801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.284929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.284955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.285069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.285173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.285200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.285305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.285428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.285453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.285567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.285676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.285701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.285798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.285923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.285947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.286053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.286181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.286207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.286351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.286508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.286538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.286642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.286768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.286792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.286901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.287024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.287049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.287161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.287257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.287282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.287383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.287515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.287547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-11-28 11:51:47.287666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-28 11:51:47.287799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.287825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.287937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.288039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.288064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.288171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.288277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.288303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.288438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.288603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.288630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.288734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.288832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.288858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.288956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.289087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.289113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.289215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.289318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.289344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.289450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.289553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.289579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.289674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.289808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.289834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.289968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.290069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.290095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.290227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.290328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.290353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.290512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.290623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.290648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.290751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.290850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.290875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.290988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.291112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.291139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.291245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.291373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.291398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.291537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.291658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.291684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.291790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.291891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.291919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.292018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.292141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.292167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.292296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.292393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.292419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.292522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.292660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.292687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.292823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.292957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.292982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.293086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.293228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.293255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.293367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.293467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.293492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.293634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.293732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.293758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.293861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.294016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.294042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.294150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.294285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.294311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.294412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.294542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.294568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.294678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.294777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.294803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-11-28 11:51:47.294947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.295052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-28 11:51:47.295078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.295186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.295315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.295340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.295442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.295547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.295574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.295689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.295789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.295814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.295913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.296036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.296062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.296163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.296260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.296286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.296423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.296577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.296604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.296711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.296851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.296878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.297040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.297141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.297167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.297280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.297410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.297436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.297577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.297679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.297706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.297807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.297913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.297939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.298073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.298205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.298231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.298327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.298429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.298455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.298561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.298686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.298712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.298845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.298942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.298969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.299071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.299168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.299194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.299328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.299453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.299483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.299592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.299702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.299728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.299829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.299953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.299979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.300106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.300206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.300233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.300343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.300469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.300495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.300616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.300719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.300745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.300850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.300949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.300976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.301085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.301240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.301265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.301368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.301472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-28 11:51:47.301498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-11-28 11:51:47.301633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.301729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.301755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.301921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.302046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.302077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.302186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.302316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.302341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.302472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.302614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.302641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.302781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.302907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.302933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.303068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.303175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.303201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.303302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.303435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.303462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.303575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.303675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.303703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.303832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.303930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.303956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.304057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.304161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.304188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.304293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.304392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.304418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.304529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.304665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.304695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.304795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.304887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.304913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.305045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.305139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.305164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.305305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.305409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.305436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.305566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.305670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.305697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.305839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.305936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.305961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.306074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.306203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.306229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.306329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.306457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.306482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.306597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.306722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.306748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.306881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.306990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.307015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.307146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.307244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.307270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.307373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.307503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.307535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.307674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.307782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.307807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.307948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.308055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.308081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.308183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.308314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.308340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.308473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.308605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.308631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.308742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.308872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.308899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-11-28 11:51:47.309009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.309142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-28 11:51:47.309168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.309296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.309395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.309421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.309520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.309630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.309656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.309769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.309880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.309905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.310046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.310145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.310171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.310302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.310427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.310453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.310560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.310657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.310683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.310819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.310915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.310941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.311047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.311173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.311199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.311305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.311404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.311430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.311537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.311670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.311696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.311807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.311942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.311968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.312100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.312206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.312231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.312363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.312476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.312502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.312642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.312751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.312777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.312892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.312991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.313016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.313119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.313243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.313268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.313397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.313499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.313530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.313643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.313776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.313801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.313900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.314025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.314050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.314155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.314308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.314333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.314439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.314538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.314564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.314666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.314827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.314852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.314987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.315089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.315116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.315235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.315331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.315356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.315450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.315553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.315579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.315689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.315782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.315807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.315920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.316016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.316041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.316136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.316235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.316260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-11-28 11:51:47.316359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.316459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-11-28 11:51:47.316485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.316603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.316703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.316729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.316862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.316986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.317012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.317142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.317246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.317272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.317378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.317487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.317513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.317636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.317745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.317770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.317871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.317967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.317991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.318089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.318195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.318219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.318321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.318451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.318476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.318580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.318686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.318710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.318813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.318943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.318968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.319074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.319174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.319200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.319362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.319497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.319522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.319642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.319746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.319770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.319900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.320027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.320052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.320161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.320268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.320293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.320429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.320532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.320557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.320660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.320760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.320785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.320912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.321006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.321031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.321134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.321244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.321269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.321372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.321470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.321495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.321621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.321744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.321773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.321941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.322043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.322070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.322177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.322284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.322309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.322408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.322508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.322542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.322658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.322771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.322798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.322935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.323069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.323095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.323224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.323358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.323384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.323488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.323595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.323621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-11-28 11:51:47.323719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-11-28 11:51:47.323822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.323848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.323981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.324075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.324101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.324237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.324333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.324359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.324470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.324569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.324595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.324728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.324854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.324879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.324990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.325090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.325116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.325225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.325354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.325380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.325484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.325604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.325631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.325766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.325866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.325892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.326003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.326135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.326160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.326264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.326364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.326391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.326533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.326638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.326663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.326789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.326891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.326916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.327054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.327183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.327209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.327321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.327448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.327473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.327581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.327696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.327720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.327881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.327987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.328012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.328123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.328258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.328283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.328412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.328517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.328556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.328660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.328758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.328784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.328921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.329052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.329078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.329208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.329311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.329337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.329447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.329554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.329580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.329683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.329788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.329813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.329920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.330047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.330072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-11-28 11:51:47.330176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.330301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-11-28 11:51:47.330325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.330424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.330535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.330560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.330684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.330811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.330835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.330971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.331078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.331104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.331235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.331342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.331366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.331500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.331620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.331646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.331746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.331849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.331874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.331984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.332115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.332141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.332269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.332372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.332397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.332530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.332640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.332665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.332798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.332932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.332957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.333056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.333166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.333192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.333291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.333393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.333418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.333559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.333679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.333704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.333804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.333903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.333928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.334041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.334173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.334198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.334305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.334402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.334427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.334536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.334632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.334657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.334753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.334864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.334889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.335019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.335147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.335173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.335272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.335398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.335423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.335531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.335636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.335662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.335780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.335908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.335934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.336038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.336170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.336196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.336298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.336402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.336428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.336564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.336665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.336690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.336828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.336929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.336954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.337060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.337191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.337217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.337325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.337455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.337481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-11-28 11:51:47.337590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-11-28 11:51:47.337696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.337722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.337868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.337969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.337994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.338102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.338225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.338257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.338364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.338491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.338517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.338631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.338755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.338780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.338895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.338991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.339016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.339129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.339228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.339253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.339353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.339461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.339487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.339606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.339712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.339737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.339893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.340028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.340053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.340152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.340276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.340302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.340410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.340543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.340577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.340679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.340778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.340807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.340936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.341038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.341063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.341173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.341274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.341299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.341404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.341511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.341542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.341671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.341795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.341821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.341929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.342051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.342075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.342205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.342301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.342326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.342419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.342552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.342578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.342687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.342822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.342846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.342954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.343054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.343079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.343210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.343314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.343345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.343482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.343623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.343649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.343780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.343877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.343901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.343996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.344126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.344151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.344278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.344369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.344393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.344497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.344608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.344633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.344736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.344856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.344882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-11-28 11:51:47.345020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-11-28 11:51:47.345127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.345152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.345282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.345411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.345437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.345542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.345650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.345674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.345810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.345940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.345969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.346080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.346185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.346210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.346310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.346434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.346459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.346590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.346696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.346721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.346859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.346988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.347014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.347115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.347211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.347235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.347338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.347444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.347469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.347595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.347723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.347748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.347855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.347953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.347978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.348082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.348178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.348203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.348362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.348461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.348488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.348605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.348709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.348735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.348841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.348938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.348963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.349068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.349200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.349225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.349329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.349432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.349456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.349628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.349727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.349752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.349858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.349981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.350006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.350099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.350198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.350224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.350328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.350460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.350485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.350602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.350738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.350763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.350906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.351042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.351066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.351167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.351294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.351320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.351450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.351542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.351573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.351727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.351830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.351855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.351956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.352063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.352088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.352221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.352324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-11-28 11:51:47.352349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-11-28 11:51:47.352447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.352579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.352606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.352716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.352821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.352846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.352948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.353050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.353076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.353177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.353301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.353325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.353462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.353561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.353586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.353724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.353822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.353846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.353952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.354056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.354080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.354245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.354374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.354399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.354533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.354636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.354660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.354769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.354898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.354922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.355028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.355132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.355158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.355264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.355365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.355391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.355523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.355626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.355652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.355762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.355895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.355920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.356046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.356146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.356171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.356270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.356405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.356431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.356565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.356669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.356694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.356801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.356898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.356923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.357025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.357130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.357154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.357280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.357435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.357460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.357618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.357729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.357753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.357852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.357977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.358002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.358104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.358229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.358254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.358365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.358468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.358493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.358617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.358746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.358771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-11-28 11:51:47.358889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.358994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-11-28 11:51:47.359019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.359119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.359254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.359278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.359371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.359475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.359499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.359623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.359789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.359813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.359928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.360030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.360055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.360154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.360257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.360282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.360385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.360519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.360549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.360657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.360757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.360783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.360925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.361055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.361079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.361208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.361313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.361338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.361475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.361607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.361633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.361727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.361854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.361878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.361986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.362086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.362110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.362276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.362407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.362432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.362626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.362757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.362783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.362900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.363029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.363054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.363182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.363286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.363311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.363414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.363542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.363568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.363701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.363801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.363826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.363936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.364089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.515 [2024-11-28 11:51:47.364114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.515 qpair failed and we were unable to recover it. 00:27:27.515 [2024-11-28 11:51:47.364243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.364343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.364368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.364474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.364584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.364609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.364771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.364914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.364939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.365067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.365199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.365223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.365325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.365449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.365474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.365579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.365710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.365736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.365843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.365981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.366006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.366151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.366244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.366269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.366369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.366491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.366515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.366648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.366755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.366780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.366889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.366998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.367025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.367127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.367228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.367254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.367356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.367468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.367492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.367640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.367742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.367768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.367882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.368010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.368035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.368178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.368277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.368303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.368405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.368534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.368560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.368667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.368787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.368811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.368921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.369017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.369042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.369157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.369259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.369285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.369417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.369587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.369613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.369718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.369838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.369862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.369996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.370095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.370119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.370217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.370326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.370351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.370465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.370568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.370594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.370702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.370834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.370858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.370963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.371089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.371114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.371221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.371346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.371371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.516 qpair failed and we were unable to recover it. 00:27:27.516 [2024-11-28 11:51:47.371474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.371573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.516 [2024-11-28 11:51:47.371598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.371725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.371820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.371845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.371955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.372064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.372089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.372225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.372328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.372353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.372457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.372562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.372593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.372721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.372847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.372871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.372979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.373105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.373130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.373254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.373349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.373376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.373505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.373656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.373682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.373791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.373922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.373946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.374076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.374202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.374227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.374331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.374430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.374454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.374583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.374684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.374709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.374841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.374940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.374966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.375129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.375261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.375286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.375424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.375577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.375603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.375713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.375817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.375843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.375971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.376074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.376099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.376207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.376310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.376335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.376468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.376587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.376614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.376717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.376856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.376883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.376995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.377117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.377143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.517 qpair failed and we were unable to recover it. 00:27:27.517 [2024-11-28 11:51:47.377242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.517 [2024-11-28 11:51:47.377347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.377373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.377473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.377613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.377639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.377749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.377858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.377883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.378013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.378113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.378139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.378266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.378396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.378422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.378555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.378716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.378743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.378855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.378990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.379015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.379142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.379272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.379297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.379401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.379531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.379556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.379662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.379785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.379810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.379941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.380041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.380071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.380186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.380294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.380320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.380424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.380567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.380593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.380697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.380802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.380837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.380969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.381095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.381120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.381230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.381371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.381396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.381503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.381616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.381641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.381741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.381849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.381875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.382036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.382138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.382163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.382269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.382367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.382392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.382538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.382644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.382673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.382807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.382937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.382964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.383080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.383248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.383273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.383376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.383476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.383501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.383622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.383731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.383755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.383866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.383997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.384022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.384128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.384227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.384254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.384362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.384459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.384484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.518 [2024-11-28 11:51:47.384627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.384756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.518 [2024-11-28 11:51:47.384781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.518 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.384917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.385018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.385043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.385173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.385283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.385314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.385451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.385563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.385590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.385700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.385827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.385852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.385954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.386062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.386087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.386185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.386320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.386345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.386451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.386552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.386578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.386682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.386812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.386837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.386934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.387038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.387063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.387160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.387261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.387287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.387421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.387555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.387580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.387680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.387775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.387804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.387917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.388040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.388065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.388160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.388287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.388312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.388417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.388515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.388549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.388695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.388796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.388821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.388917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.389014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.389039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.389144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.389283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.389309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.389409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.389519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.389550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.389686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.389793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.389819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.389923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.390028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.390053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.390182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.390282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.390308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.390425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.390553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.390580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.519 qpair failed and we were unable to recover it. 00:27:27.519 [2024-11-28 11:51:47.390683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.390811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.519 [2024-11-28 11:51:47.390836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.390948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.391080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.391107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.391210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.391313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.391338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.391454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.391561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.391588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.391694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.391823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.391849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.391952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.392057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.392083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.392182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.392308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.392334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.392477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.392613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.392644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.392755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.392886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.392913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.393025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.393132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.393158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.393296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.393422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.393448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.393583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.393684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.393711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.393815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.393915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.393941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.394102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.394234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.394259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.394368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.394521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.394552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.394656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.394756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.394782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.394887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.394991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.395018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.395158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.395283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.395309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.395417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.395529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.395557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.395701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.395807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.395833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.395971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.396076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.396102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.396200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.396333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.396359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.520 qpair failed and we were unable to recover it. 00:27:27.520 [2024-11-28 11:51:47.396457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.520 [2024-11-28 11:51:47.396560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.396586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.396691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.396795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.396820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.396920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.397020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.397045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.397170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.397274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.397300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.397400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.397508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.397542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.397682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.397779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.397804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.397909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.398039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.398065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.398209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.398312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.398339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.398440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.398549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.398576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.398684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.398788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.398814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.398949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.399050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.399075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.399214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.399342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.399368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.399483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.399621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.399648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.399777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.399909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.399935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.400046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.400174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.400200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.400333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.400441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.400466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.400600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.400700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.400725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.400867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.401010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.401034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.401141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.401241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.401266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.401368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.401493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.401518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.401630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.401726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.401751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.401876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.402005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.402030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.402136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.402231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.402255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.402384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.402485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.402512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.402630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.402734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.402759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.402899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.403004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.403029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.403159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.403285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.403310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.403422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.403517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.521 [2024-11-28 11:51:47.403560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.521 qpair failed and we were unable to recover it. 00:27:27.521 [2024-11-28 11:51:47.403661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.403756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.403781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.403913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.404010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.404035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.404171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.404270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.404295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.404433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.404546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.404573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.404682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.404784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.404809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.404918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.405044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.405069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.405206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.405338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.405364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.405464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.405578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.405605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.405712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.405817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.405842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.405955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.406081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.406106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.406210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.406311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.406336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.406430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.406535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.406561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.406696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.406821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.406846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.406946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.407079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.407105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.407241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.407339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.407363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.407472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.407613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.407638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.407764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.407878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.407904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.408035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.408160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.408185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.408285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.408380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.408405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.408538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.408651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.408676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.408779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.408890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.408915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.409021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.409146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.522 [2024-11-28 11:51:47.409171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.522 qpair failed and we were unable to recover it. 00:27:27.522 [2024-11-28 11:51:47.409273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.409368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.409392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.409494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.409633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.409658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.409766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.409895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.409919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.410026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.410126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.410151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.410307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.410405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.410430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.410542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.410650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.410675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.410774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.410909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.410934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.411068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.411169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.411195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.411297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.411430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.411455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.411561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.411669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.411694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.411802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.411905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.411930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.412063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.412200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.412225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.412326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.412428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.412452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.412578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.412684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.412708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.412812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.412914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.412939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.413034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.413135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.413160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.413262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.413363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.413388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.413532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.413648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.413673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.413776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.413911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.413937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.414070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.414175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.414200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.414327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.414417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.414442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.414547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.414658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.414685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.414783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.414918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.414943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.415081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.415181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.415206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.415312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.415416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.415441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.415547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.415683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.415709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.415840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.415938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.415964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.416092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.416205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.416230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.523 qpair failed and we were unable to recover it. 00:27:27.523 [2024-11-28 11:51:47.416359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.523 [2024-11-28 11:51:47.416488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.416514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.416629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.416727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.416752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.416912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.417046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.417071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.417176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.417273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.417298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.417431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.417538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.417563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.417667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.417805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.417829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.417943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.418075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.418100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.418240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.418370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.418395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.418498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.418604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.418630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.418761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.418864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.418898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.419064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.419167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.419193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.419295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.419401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.419427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.419534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.419638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.419662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.419768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.419869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.419893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.420003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.420100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.420126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.420238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.420338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.420365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.420482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.420601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.420627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.420726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.420828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.420854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.420960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.421088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.421112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.421221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.421317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.421347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.421448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.421611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.421637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.421738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.421871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.421895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.422002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.422104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.422128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.422220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.422326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.422351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.422446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.422551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.422576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.422689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.422823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.422847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.423007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.423110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.423134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.423239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.423371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.524 [2024-11-28 11:51:47.423396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.524 qpair failed and we were unable to recover it. 00:27:27.524 [2024-11-28 11:51:47.423500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.423611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.423636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.423761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.423860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.423893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.423993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.424085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.424110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.424252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.424378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.424403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.424509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.424631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.424657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.424789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.424925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.424950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.425094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.425223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.425248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.425379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.425513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.425549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.425663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.425799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.425823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.425929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.426032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.426057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.426185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.426280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.426305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.426414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.426518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.426556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.426688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.426795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.426821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.426924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.427025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.427051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.427155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.427286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.427311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.427418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.427578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.427604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.427702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.427795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.427820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.427953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.428114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.428139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.428239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.428348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.428373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.428475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.428579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.428605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.428739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.428869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.428895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.429005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.429103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.429129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.429268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.429365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.429392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.429520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.429629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.429656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.525 qpair failed and we were unable to recover it. 00:27:27.525 [2024-11-28 11:51:47.429822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-11-28 11:51:47.429920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.429946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.430053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.430147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.430173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.430281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.430386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.430411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.430512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.430622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.430648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.430779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.430911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.430936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.431039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.431172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.431198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.431300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.431410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.431435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.431539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.431670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.431696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.431801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.431904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.431929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.432037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.432138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.432164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.432295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.432400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.432426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.432550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.432688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.432713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.432822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.432919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.432944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.433075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.433206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.433232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.433338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.433472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.433498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.433607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.433706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.433730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.433830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.433989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.434014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.434113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.434221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.434245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.434386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.434494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.434520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.434668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.434781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.434806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.434935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.435062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.435087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.435220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.435316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.435341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.435451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.435606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.435632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.435732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.435834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.435859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.435961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.436096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.436122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.436255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.436391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.436416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.436523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.436634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.436659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.436792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.436897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.436923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.437060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.437169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.526 [2024-11-28 11:51:47.437194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.526 qpair failed and we were unable to recover it. 00:27:27.526 [2024-11-28 11:51:47.437313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.437403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.437428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.437535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.437651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.437680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.437781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.437887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.437911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.438043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.438139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.438164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.438292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.438386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.438410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.438510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.438656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.438681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.438827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.438943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.438971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.439088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.439216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.439242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.439369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.439471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.439497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.439619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.439721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.439747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.439864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.439970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.439997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.440100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.440207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.440233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.440366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.440469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.440495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.440612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.440717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.440742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.440872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.440977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.441002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.441135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.441269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.441295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.441408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.441502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.441536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.441675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.441801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.441827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.441929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.442065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.442091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.442233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.442360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.442386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.442493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.442607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.442635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.442735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.442868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.442895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.443026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.443163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.443188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.443296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.443401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.443426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.443563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.443663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.443688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.443824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.443927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.443954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.444064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.444167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.444192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.444335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.444497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.444522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.444642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.444742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.527 [2024-11-28 11:51:47.444767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.527 qpair failed and we were unable to recover it. 00:27:27.527 [2024-11-28 11:51:47.444889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.444992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.445018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.445153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.445269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.445294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.445399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.445495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.445520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.445664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.445776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.445802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.445927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.446083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.446109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.446240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.446370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.446397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.446493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.446609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.446636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.446768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.446877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.446902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.447011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.447110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.447136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.447240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.447371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.447397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.447509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.447631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.447657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.447762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.447872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.447897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.448005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.448107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.448132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.448240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.448340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.448364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.448468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.448601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.448628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.448727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.448826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.448852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.448956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.449086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.449111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.449239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.449348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.449374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.449475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.449621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.449647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.449752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.449905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.449929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.450030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.450160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.450185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.450287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.450415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.450441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.450576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.450684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.450711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.450815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.450910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.450935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.451031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.451130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.451155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.451255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.451376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.451401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.451514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.451633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.451659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.451799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.451907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.451933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.528 [2024-11-28 11:51:47.452059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.452161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.528 [2024-11-28 11:51:47.452187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.528 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.452300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.452396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.452421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.452518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.452638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.452665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.452774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.452875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.452902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.453010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.453146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.453171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.453276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.453403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.453428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.453536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.453686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.453711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.453815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.453936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.453961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.454065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.454169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.454195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.454325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.454426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.454451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.454566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.454670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.454697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.454801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.454899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.454925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.455030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.455161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.455186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.455349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.455453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.455479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.455590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.455718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.455744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.455870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.455971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.455996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.456134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.456267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.456293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.456425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.456518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.456548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.456662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.456790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.456815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.456949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.457048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.457074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.457185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.457314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.457338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.457439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.457537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.457562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.457671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.457780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.457806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.457919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.458044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.458069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.458175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.458303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.458328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.458457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.458585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.458612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.458725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.458826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.458852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.458963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.459063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.459089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.459195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.459327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.459352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.529 qpair failed and we were unable to recover it. 00:27:27.529 [2024-11-28 11:51:47.459454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.529 [2024-11-28 11:51:47.459578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.459605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.459720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.459822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.459847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.459981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.460108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.460133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.460236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.460334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.460363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.460470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.460595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.460625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.460739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.460850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.460878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.460994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.461116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.461142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.461272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.461376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.461403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.461510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.461661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.461687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.461820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.461943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.461970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.462108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.462239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.462265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.462369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.462470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.462496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.462606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.462701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.462727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.462847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.462977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.463009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.463116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.463270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.463296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.463395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.463502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.463535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.463646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.463775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.463802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.463915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.464046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.464074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.464176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.464271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.464296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.464400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.464503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.464537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.464656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.464786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.464812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.464922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.465043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.465069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.465178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.465337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.465363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.465463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.465568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.465602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.465707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.465802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.465828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.530 qpair failed and we were unable to recover it. 00:27:27.530 [2024-11-28 11:51:47.465954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.530 [2024-11-28 11:51:47.466058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.466085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.466192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.466299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.466325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.466428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.466575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.466610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.466718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.466818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.466845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.466976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.467069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.467094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.467203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.467338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.467363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.467498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.467620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.467645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.467783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.467938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.467964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.468068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.468168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.468199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.468326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.468456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.468482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.468626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.468761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.468788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.468893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.469000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.469026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.469153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.469258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.469283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.469389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.469518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.469551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.469657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.469760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.469785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.469901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.469997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.470023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.470153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.470250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.470276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.470379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.470504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.470538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.470644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.470767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.470793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.470928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.471065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.471090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.471190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.471286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.471311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.471447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.471573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.471599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.471709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.471820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.471845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.471939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.472072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.472098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.472235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.472369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.472396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.472502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.472607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.472633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.472763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.472898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.472924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.473026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.473126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.473152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.531 qpair failed and we were unable to recover it. 00:27:27.531 [2024-11-28 11:51:47.473257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.473359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.531 [2024-11-28 11:51:47.473385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.473567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.473699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.473726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.473836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.473936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.473962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.474066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.474198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.474224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.474353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.474478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.474504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.474615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.474715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.474741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.474844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.474942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.474969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.475096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.475225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.475251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.475354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.475453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.475480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.475593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.475752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.475778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.475879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.475988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.476015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.476153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.476252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.476277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.476407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.476503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.476535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.476645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.476753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.476778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.476908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.477001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.477026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.477129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.477254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.477279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.477386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.477518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.477553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.477660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.477786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.477810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.477917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.478018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.478043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.478147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.478246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.478270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.478374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.478480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.478505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.478641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.478766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.478797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.478913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.479040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.479067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.479185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.479290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.479317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.479450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.479584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.479612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.479711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.479843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.479869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.479988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.480085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.480111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.480213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.480338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.480365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.480475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.480597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.480624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.532 qpair failed and we were unable to recover it. 00:27:27.532 [2024-11-28 11:51:47.480738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.532 [2024-11-28 11:51:47.480851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.480878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.481014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.481115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.481142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.481247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.481376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.481403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.481519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.481660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.481687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.481831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.481972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.481999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.482139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.482263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.482289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.482391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.482496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.482522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.482670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.482766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.482791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.482929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.483059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.483084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.483191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.483290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.483314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.483471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.483577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.483603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.483733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.483831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.483857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.483978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.484081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.484106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.484245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.484349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.484376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.484490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.484600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.484628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.484732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.484863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.484890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.485001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.485102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.485128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.485225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.485335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.485360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.485497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.485616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.485644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.485751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.485856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.485881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.485980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.486111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.486137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.486253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.486382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.486407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.486555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.486730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.486759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.486874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.486981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.487008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.487122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.487256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.487283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.487387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.487485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.487512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.487619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.487729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.487755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.487888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.487994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.488019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.488147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.488254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.533 [2024-11-28 11:51:47.488281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.533 qpair failed and we were unable to recover it. 00:27:27.533 [2024-11-28 11:51:47.488408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.488511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.488543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.488648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.488751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.488778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.488917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.489031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.489057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.489180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.489314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.489341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.489447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.489556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.489582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.489714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.489823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.489849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.489981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.490107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.490133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.490241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.490344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.490371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.490476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.490604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.490630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.490734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.490832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.490859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.490997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.491100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.491125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.491230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.491368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.491394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.491504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.491640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.491668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.491779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.491884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.491910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.492042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.492138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.492163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.492260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.492430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.492456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.492594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.492698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.492724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.492857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.492954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.492980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.493078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.493179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.493205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.493312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.493438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.493464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.493571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.493701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.493728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.493827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.493962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.493988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.494101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.494211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.494238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.494373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.494506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.494541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.534 [2024-11-28 11:51:47.494645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.494753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.534 [2024-11-28 11:51:47.494778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.534 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.494943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.495079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.495104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.495212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.495313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.495340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.495471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.495608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.495635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.495736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.495867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.495892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.496029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.496155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.496181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.496292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.496423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.496450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.496593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.496694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.496719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.496826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.496924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.496950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.497090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.497234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.497261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.497390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.497494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.497520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.497663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.497764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.497790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.497917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.498023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.498050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.498157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.498266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.498291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.498452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.498579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.498606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.498707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.498840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.498867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.498976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.499076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.499102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.499207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.499313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.499339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.499473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.499584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.499610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.499716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.499818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.499844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.499978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.500109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.500136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.500242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.500374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.500401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.500571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.500673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.500699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.500807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.500912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.500938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.501044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.501144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.501169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.501274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.501372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.501399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.501565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.501690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.501716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.501849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.501952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.501979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.502119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.502226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.502253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.535 qpair failed and we were unable to recover it. 00:27:27.535 [2024-11-28 11:51:47.502360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.502467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.535 [2024-11-28 11:51:47.502498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.502624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.502729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.502755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.502868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.502967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.502993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.503091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.503217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.503242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.503372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.503479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.503505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.503645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.503751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.503779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.503907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.504046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.504072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.504226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.504322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.504348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.504451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.504562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.504588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.504695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.504803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.504832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.504966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.505095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.505125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.505257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.505362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.505388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.505483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.505591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.505618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.505758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.505866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.505891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.505998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.506098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.506124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.506222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.506335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.506360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.506494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.506628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.506654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.506764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.506861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.506887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.507020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.507154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.507180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.507330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.507461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.507486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.507623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.507725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.507757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.507890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.507992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.508019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.508120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.508225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.508252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.508385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.508516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.508549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.508665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.508803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.508830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.508938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.509038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.509064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.509168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.509299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.509324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.509427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.509550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.509578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.509677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.509814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.509840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.509973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.510126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.510151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.510279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.510378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.510408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.536 qpair failed and we were unable to recover it. 00:27:27.536 [2024-11-28 11:51:47.510510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.536 [2024-11-28 11:51:47.510649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.510674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.510782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.510880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.510906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.511036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.511135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.511161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.511272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.511402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.511429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.511542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.511636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.511662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.511764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.511876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.511902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.512035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.512160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.512186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.512294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.512427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.512453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.512557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.512670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.512697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.512837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.512937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.512963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.513109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.513217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.513242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.513401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.513511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.513557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.513657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.513787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.513813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.513945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.514075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.514100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.514205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.514306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.514331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.514443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.514540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.514566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.514672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.514776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.514802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.514935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.515066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.515093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.515197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.515331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.515357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.515497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.515605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.515632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.515770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.515903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.515928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.516033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.516124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.516150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.516313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.516441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.516467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.516574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.516709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.516734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.516839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.516940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.516965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.517065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.517220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.517245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.517403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.517514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.517571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.517686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.517799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.517825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.517932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.518066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.518092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.518190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.518292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.518318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.518453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.518563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.518590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.537 qpair failed and we were unable to recover it. 00:27:27.537 [2024-11-28 11:51:47.518698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.537 [2024-11-28 11:51:47.518806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.518832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.538 qpair failed and we were unable to recover it. 00:27:27.538 [2024-11-28 11:51:47.518963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.519066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.519092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.538 qpair failed and we were unable to recover it. 00:27:27.538 [2024-11-28 11:51:47.519249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.519345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.519370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.538 qpair failed and we were unable to recover it. 00:27:27.538 [2024-11-28 11:51:47.519506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.519645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.519670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.538 qpair failed and we were unable to recover it. 00:27:27.538 [2024-11-28 11:51:47.519777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.519884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.519910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.538 qpair failed and we were unable to recover it. 00:27:27.538 [2024-11-28 11:51:47.520045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.520172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.520198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.538 qpair failed and we were unable to recover it. 00:27:27.538 [2024-11-28 11:51:47.520303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.520405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.520430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.538 qpair failed and we were unable to recover it. 00:27:27.538 [2024-11-28 11:51:47.520539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.520680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.520705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.538 qpair failed and we were unable to recover it. 00:27:27.538 [2024-11-28 11:51:47.520812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.520944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.520970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.538 qpair failed and we were unable to recover it. 00:27:27.538 [2024-11-28 11:51:47.521112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.521224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.521251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.538 qpair failed and we were unable to recover it. 00:27:27.538 [2024-11-28 11:51:47.521354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.521456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.521482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.538 qpair failed and we were unable to recover it. 00:27:27.538 [2024-11-28 11:51:47.521603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.521709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.521736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.538 qpair failed and we were unable to recover it. 00:27:27.538 [2024-11-28 11:51:47.521843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.521955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.538 [2024-11-28 11:51:47.521980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.538 qpair failed and we were unable to recover it. 00:27:27.538 [2024-11-28 11:51:47.522094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.522196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.522221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.822 qpair failed and we were unable to recover it. 00:27:27.822 [2024-11-28 11:51:47.522361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.522465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.522490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.822 qpair failed and we were unable to recover it. 00:27:27.822 [2024-11-28 11:51:47.522633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.522764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.522789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.822 qpair failed and we were unable to recover it. 00:27:27.822 [2024-11-28 11:51:47.522901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.523000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.523026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.822 qpair failed and we were unable to recover it. 00:27:27.822 [2024-11-28 11:51:47.523151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.523262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.523289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.822 qpair failed and we were unable to recover it. 00:27:27.822 [2024-11-28 11:51:47.523402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.523510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.523541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.822 qpair failed and we were unable to recover it. 00:27:27.822 [2024-11-28 11:51:47.523654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.523759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.523784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.822 qpair failed and we were unable to recover it. 00:27:27.822 [2024-11-28 11:51:47.523887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.523990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.524016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.822 qpair failed and we were unable to recover it. 00:27:27.822 [2024-11-28 11:51:47.524148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.524281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.524307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.822 qpair failed and we were unable to recover it. 00:27:27.822 [2024-11-28 11:51:47.524420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.524550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.524577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.822 qpair failed and we were unable to recover it. 00:27:27.822 [2024-11-28 11:51:47.524679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.524788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.524815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.822 qpair failed and we were unable to recover it. 00:27:27.822 [2024-11-28 11:51:47.524928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.525054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.525080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.822 qpair failed and we were unable to recover it. 00:27:27.822 [2024-11-28 11:51:47.525187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.525323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.525349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.822 qpair failed and we were unable to recover it. 00:27:27.822 [2024-11-28 11:51:47.525489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.822 [2024-11-28 11:51:47.525599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.525626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.525760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.525858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.525885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.525991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.526112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.526138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.526242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.526341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.526367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.526476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.526614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.526640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.526750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.526860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.526887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.526988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.527096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.527122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.527261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.527364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.527389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.527492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.527592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.527618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.527719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.527832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.527858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.527965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.528104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.528130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.528229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.528339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.528364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.528475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.528610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.528637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.528757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.528883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.528909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.529009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.529119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.529146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.529255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.529381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.529407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.529512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.529649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.529675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.529805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.529899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.529924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.530029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.530129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.530155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.530289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.530449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.530474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.530632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.530736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.530762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.530867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.530976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.531001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.531134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.531266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.531292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.531401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.531497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.531523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.531643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.531745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.531771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.531880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.532011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.532036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.532143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.532248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.532274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.532375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.532539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.532565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.532674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.532805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.823 [2024-11-28 11:51:47.532831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.823 qpair failed and we were unable to recover it. 00:27:27.823 [2024-11-28 11:51:47.532960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.533093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.533119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.533226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.533327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.533352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.533453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.533608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.533635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.533735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.533868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.533894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.534022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.534153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.534179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.534295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.534394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.534421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.534528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.534650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.534676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.534808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.534941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.534967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.535067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.535163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.535189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.535315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.535426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.535451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.535556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.535657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.535684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.535786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.535881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.535908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.536042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.536177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.536203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.536302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.536430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.536455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.536570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.536675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.536701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.536825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.536928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.536954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.537091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.537197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.537223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.537383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.537516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.537549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.537657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.537787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.537811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.537910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.538043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.538068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.538201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.538308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.538333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.538438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.538546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.538573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.538687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.538821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.538847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.538983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.539116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.539143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.539247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.539352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.539378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.539494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.539602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.539628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.539745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.539900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.539926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.540033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.540159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.540184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.824 qpair failed and we were unable to recover it. 00:27:27.824 [2024-11-28 11:51:47.540290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.540389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.824 [2024-11-28 11:51:47.540415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.540522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.540667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.540692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.540801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.540913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.540938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.541047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.541155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.541181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.541286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.541384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.541409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.541538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.541644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.541670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.541800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.541905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.541936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.542043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.542141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.542167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.542297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.542400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.542426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.542539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.542643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.542668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.542782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.542915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.542942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.543041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.543144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.543169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.543307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.543447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.543473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.543588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.543684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.543709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.543821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.543928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.543956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.544065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.544166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.544191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.544300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.544426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.544457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.544588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.544716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.544741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.544846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.544949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.544975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.545106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.545212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.545239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.545371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.545475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.545500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.545645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.545780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.545806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.545911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.546038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.546065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.546173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.546306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.546332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.546440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.546578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.546605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.546711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.546817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.546844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.546976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.547076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.547107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.547241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.547398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.547424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.547535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.547639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.547664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.825 qpair failed and we were unable to recover it. 00:27:27.825 [2024-11-28 11:51:47.547782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.825 [2024-11-28 11:51:47.547879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.547905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.548036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.548169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.548195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.548302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.548403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.548429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.548534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.548629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.548656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.548790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.548890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.548917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.549015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.549121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.549148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.549243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.549371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.549397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.549536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.549670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.549701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.549813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.549918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.549944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.550082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.550182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.550208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.550343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.550449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.550476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.550619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.550718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.550744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.550856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.550982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.551007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.551114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.551249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.551275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.551386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.551519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.551553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.551685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.551824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.551849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.551955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.552059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.552086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.552217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.552320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.552345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.552477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.552588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.552615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.552746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.552877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.552904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.553011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.553109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.553135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.553261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.553392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.553418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.553522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.553685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.553711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.553823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.553952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.553979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.554076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.554213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.554239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.554342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.554448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.554474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.554583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.554710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.554736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.554835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.554937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.826 [2024-11-28 11:51:47.554963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.826 qpair failed and we were unable to recover it. 00:27:27.826 [2024-11-28 11:51:47.555077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.555207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.555234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.555339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.555437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.555463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.555590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.555699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.555725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.555828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.555935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.555962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.556077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.556199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.556225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.556323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.556444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.556470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.556570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.556679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.556705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.556838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.556967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.556993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.557130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.557234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.557260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.557393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.557489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.557515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.557668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.557806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.557832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.557946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.558054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.558082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.558187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.558291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.558317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.558425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.558558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.558585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.558718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.558823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.558849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.558981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.559139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.559165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.559312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.559423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.559450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.559557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.559661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.559687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.559797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.559926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.559951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.560059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.560182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.560207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.560317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.560448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.560474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.560583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.560707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.560733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.560882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.561036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.561062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.827 [2024-11-28 11:51:47.561164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.561264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.827 [2024-11-28 11:51:47.561290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.827 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.561396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.561495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.561522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.561638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.561740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.561766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.561873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.561973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.561999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.562098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.562194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.562220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.562325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.562439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.562464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.562565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.562693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.562719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.562822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.562955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.562981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.563090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.563224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.563250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.563355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.563481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.563506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.563649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.563804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.563830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.563937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.564086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.564111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.564215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.564319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.564345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.564441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.564545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.564571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.564704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.564811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.564837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.564943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.565047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.565072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.565167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.565293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.565318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.565457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.565561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.565587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.565723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.565859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.565885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.565988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.566136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.566162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.566265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.566396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.566422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.566533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.566639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.566665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.566776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.566875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.566901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.567033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.567129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.567154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.567278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.567406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.567432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.567541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.567693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.567719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.567848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.567987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.568014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.568131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.568261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.568288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.568430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.568534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.568560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.828 [2024-11-28 11:51:47.568665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.568793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.828 [2024-11-28 11:51:47.568819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.828 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.568920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.569053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.569079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.569181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.569279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.569306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.569408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.569538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.569565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.569667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.569799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.569827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.569926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.570085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.570111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.570245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.570369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.570395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.570534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.570668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.570695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.570859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.570964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.570990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.571116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.571214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.571239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.571338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.571468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.571493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.571591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.571696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.571723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.571829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.571935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.571961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.572090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.572198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.572223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.572356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.572489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.572514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.572622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.572723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.572748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.572855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.572962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.572988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.573124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.573226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.573251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.573382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.573517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.573550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.573660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.573762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.573790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.573897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.574026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.574052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.574162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.574290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.574316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.574422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.574535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.574561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.574657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.574817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.574843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.574955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.575057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.575082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.575211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.575306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.575332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.575488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.575634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.575661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.575773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.575897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.575923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.576057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.576168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.576195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.829 qpair failed and we were unable to recover it. 00:27:27.829 [2024-11-28 11:51:47.576326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.576424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.829 [2024-11-28 11:51:47.576451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.576616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.576754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.576780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.576876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.577003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.577028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.577132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.577238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.577263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.577428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.577531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.577556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.577675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.577780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.577806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.577935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.578039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.578066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.578167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.578302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.578329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.578484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.578588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.578615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.578727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.578839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.578865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.579006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.579111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.579136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.579243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.579347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.579373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.579481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.579627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.579654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.579783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.579882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.579907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.580013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.580111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.580137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.580240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.580339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.580364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.580501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.580635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.580661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.580765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.580898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.580924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.581042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.581148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.581174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.581343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.581504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.581538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.581640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.581768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.581794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.581891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.581989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.582015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.582156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.582284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.582310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.582445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.582543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.582569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.582671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.582806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.582832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.582963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.583094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.583120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.583226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.583349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.583375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.583475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.583582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.583610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.583748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.583851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.583876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.830 qpair failed and we were unable to recover it. 00:27:27.830 [2024-11-28 11:51:47.584006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.830 [2024-11-28 11:51:47.584133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.584162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.584266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.584363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.584389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.584497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.584641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.584667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.584801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.584904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.584931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.585066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.585167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.585193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.585309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.585415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.585441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.585582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.585683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.585709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.585811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.585913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.585939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.586071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.586174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.586200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.586306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.586432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.586458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.586571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.586706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.586737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.586848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.586951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.586977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.587109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.587243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.587269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.587378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.587485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.587512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.587627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.587726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.587752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.587881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.588003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.588029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.588127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.588239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.588265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.588370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.588472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.588498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.588617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.588758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.588783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.588913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.589044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.589069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.589201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.589326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.589356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.589485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.589629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.589656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.589794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.589888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.589914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.590048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.590183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.590208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.590305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.590415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.590442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.590576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.590708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.831 [2024-11-28 11:51:47.590735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.831 qpair failed and we were unable to recover it. 00:27:27.831 [2024-11-28 11:51:47.590864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.590977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.591004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.591107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.591210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.591236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.591343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.591478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.591505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.591642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.591780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.591806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.591913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.592022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.592053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.592192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.592302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.592328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.592431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.592540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.592567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.592698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.592826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.592852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.592951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.593051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.593077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.593186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.593285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.593310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.593417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.593519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.593549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.593659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.593796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.593822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.593953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.594059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.594085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.594179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.594339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.594365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.594471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.594600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.594627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.594735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.594834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.594860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.594993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.595103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.595129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.595233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.595359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.595385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.595489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.595598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.595625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.595731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.595835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.595860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.595966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.596098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.596124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.596223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.596359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.596384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.596497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.596639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.596665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.596769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.596875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.596901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.597007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.597135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.597161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.597300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.597400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.597426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.597563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.597689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.597714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.597812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.597939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.597965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.832 [2024-11-28 11:51:47.598069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.598177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.832 [2024-11-28 11:51:47.598203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.832 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.598314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.598419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.598445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.598553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.598663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.598689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.598798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.598896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.598921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.599028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.599155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.599181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.599292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.599395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.599420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.599556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.599688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.599713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.599821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.599948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.599973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.600079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.600205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.600231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.600329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.600433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.600459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.600569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.600663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.600689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.600788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.600920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.600946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.601048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.601154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.601179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.601316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.601417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.601443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.601550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.601651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.601678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.601790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.601928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.601953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.602085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.602190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.602216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.602320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.602420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.602446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.602551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.602653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.602679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.602784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.602885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.602910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.603021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.603150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.603175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.603275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.603384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.603410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.603511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.603648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.603674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.603781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.603887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.603913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.604019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.604122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.604149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.604254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.604379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.604405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.604502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.604613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.604639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.604783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.604922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.604947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.605052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.605155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.605181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.833 qpair failed and we were unable to recover it. 00:27:27.833 [2024-11-28 11:51:47.605287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.605383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.833 [2024-11-28 11:51:47.605409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.605510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.605653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.605680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.605786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.605917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.605943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.606051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.606145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.606171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.606268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.606370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.606396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.606542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.606642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.606668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.606768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.606872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.606899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.607031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.607136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.607162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.607306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.607414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.607440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.607550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.607681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.607706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.607804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.607929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.607954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.608065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.608194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.608219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.608350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.608482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.608509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.608612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.608737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.608763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.608867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.608965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.608991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.609091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.609185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.609211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.609340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.609444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.609469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.609578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.609677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.609702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.609808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.609910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.609936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.610062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.610193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.610219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.610318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.610439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.610464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.610578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.610676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.610702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.610805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.610915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.610942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.611074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.611168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.611194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.611288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.611421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.611447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.611557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.611718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.611744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.611873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.612001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.612026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.612136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.612240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.612265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.612372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.612484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.612510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.834 qpair failed and we were unable to recover it. 00:27:27.834 [2024-11-28 11:51:47.612623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.834 [2024-11-28 11:51:47.612731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.612756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.612854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.612952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.612977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.613104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.613212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.613237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.613369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.613475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.613500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.613610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.613743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.613770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.613874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.613979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.614006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.614142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.614242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.614267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.614403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.614507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.614549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.614655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.614756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.614782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.614919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.615031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.615056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.615196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.615310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.615335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.615439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.615543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.615569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.615668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.615791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.615817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.615920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.616018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.616043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.616149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.616250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.616275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.616377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.616482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.616507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.616622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.616750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.616776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.616876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.616981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.617008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.617139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.617264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.617289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.617382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.617485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.617511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.617627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.617753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.617779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.617884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.618017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.618043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.618156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.618261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.618287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.618393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.618532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.618558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.618658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.618789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.618816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.618920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.619020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.619046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.619153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.619313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.619339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.619445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.619555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.619581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.619686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.619780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.619805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.835 qpair failed and we were unable to recover it. 00:27:27.835 [2024-11-28 11:51:47.619932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.835 [2024-11-28 11:51:47.620046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.620073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.620201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.620330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.620357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.620459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.620560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.620586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.620718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.620819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.620846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.620972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.621097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.621123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.621255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.621381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.621406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.621554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.621658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.621685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.621818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.621979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.622004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.622107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.622206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.622232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.622338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.622465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.622491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.622608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.622738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.622764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.622865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.622995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.623022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.623123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.623218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.623244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.623373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.623475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.623501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.623609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.623714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.623740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.623842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.623974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.624000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.624105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.624209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.624235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.624331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.624433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.624459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.624585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.624693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.624719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.624820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.624925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.624951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.625082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.625188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.625218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.625356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.625452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.625477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.625588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.625684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.625710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.625815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.625940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.625967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.626067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.626200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.626227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.836 qpair failed and we were unable to recover it. 00:27:27.836 [2024-11-28 11:51:47.626330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.836 [2024-11-28 11:51:47.626459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.626484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.626601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.626703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.626729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.626840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.626942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.626969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.627105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.627211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.627237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.627336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.627438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.627465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.627563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.627694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.627724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.627830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.627963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.627989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.628121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.628259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.628285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.628386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.628514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.628547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.628662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.628756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.628781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.628880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.628977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.629002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.629102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.629232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.629257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.629393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.629500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.629533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.629638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.629767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.629793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.629902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.630036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.630061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.630155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.630259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.630290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.630426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.630534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.630562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.630669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.630771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.630797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.630928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.631055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.631081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.631211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.631337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.631362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.631469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.631583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.631610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.631713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.631820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.631847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.631974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.632073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.632099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.632226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.632331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.632358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.632458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.632567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.632595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.632725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.632832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.632863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.632971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.633075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.633101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.633235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.633382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.633408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.633551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.633653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.837 [2024-11-28 11:51:47.633681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.837 qpair failed and we were unable to recover it. 00:27:27.837 [2024-11-28 11:51:47.633811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.633937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.633963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.634065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.634201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.634227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.634338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.634466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.634492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.634607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.634709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.634736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.634838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.634963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.634988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.635118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.635215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.635241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.635380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.635484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.635511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.635673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.635782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.635808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.635914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.636012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.636038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.636143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.636273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.636299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.636395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.636537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.636563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.636699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.636805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.636831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.636942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.637047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.637073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.637202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.637300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.637325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.637425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.637520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.637561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.637677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.637804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.637830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.637927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.638059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.638085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.638221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.638320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.638346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.638452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.638613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.638639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.638782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.638883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.638908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.639013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.639151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.639178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.639305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.639458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.639484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.639622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.639730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.639756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.639860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.639961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.639987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.640093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.640200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.640226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.640356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.640484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.640510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.640665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.640762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.640787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.640893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.640997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.641023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.641152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.641252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.838 [2024-11-28 11:51:47.641278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.838 qpair failed and we were unable to recover it. 00:27:27.838 [2024-11-28 11:51:47.641396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.641494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.641520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.641643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.641750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.641776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.641905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.642012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.642039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.642169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.642272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.642299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.642399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.642497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.642532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.642635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.642734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.642759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.642884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.643014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.643039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.643142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.643239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.643264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.643400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.643498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.643532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.643672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.643800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.643825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.643956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.644079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.644105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.644206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.644312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.644337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.644446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.644568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.644594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.644698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.644804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.644830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.644926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.645027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.645054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.645165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.645269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.645294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.645452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.645556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.645584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.645686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.645792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.645818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.645920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.646019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.646045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.646151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.646280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.646307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.646413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.646549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.646576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.646677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.646780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.646805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.646940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.647042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.647067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.647197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.647297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.647323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.647426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.647535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.647562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.647686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.647790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.647818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.647917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.648016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.648043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.648180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.648314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.648340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.839 [2024-11-28 11:51:47.648447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.648585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.839 [2024-11-28 11:51:47.648612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.839 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.648707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.648806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.648832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.648963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.649099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.649126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.649234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.649378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.649404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.649535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.649640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.649667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.649767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.649862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.649888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.649988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.650146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.650171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.650271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.650365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.650391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.650528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.650633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.650660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.650768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.650882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.650908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa24000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.651025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.651135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.651164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.651281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.651386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.651415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.651518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.651630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.651656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.651762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.651901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.651927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.652029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.652135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.652162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.652265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.652370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.652395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.652498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.652610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.652638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.652747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.652843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.652869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.652964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.653120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.653147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.653258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.653359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.653386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.653521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.653639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.653666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.653772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.653906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.653932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.654043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.654150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.654176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.654280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.654412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.654437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.654548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.654647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.654674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.654772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.654872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.654899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-11-28 11:51:47.655004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.840 [2024-11-28 11:51:47.655110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.655136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.655247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.655349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.655375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.655499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.655641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.655667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.655775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.655882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.655908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.656039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.656140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.656167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.656264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.656359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.656386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.656511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.656612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.656638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.656744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.656864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.656890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.656994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.657091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.657117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.657219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.657325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.657351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.657479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.657606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.657632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.657733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.657836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.657862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.657973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.658073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.658099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.658227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.658329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.658356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.658459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.658561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.658588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.658698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.658800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.658826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.658933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.659043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.659070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.659165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.659294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.659320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.659449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.659563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.659589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.659693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.659799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.659825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.659984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.660081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.660108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.660211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.660341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.660367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.660464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.660597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.660623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.660727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.660828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.660853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.660956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.661089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.661116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.661224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.661320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.661345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.661474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.661577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.661602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.661729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.661833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.661859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.661993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.662098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.841 [2024-11-28 11:51:47.662123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-11-28 11:51:47.662228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.662326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.662352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.662458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.662581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.662608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.662705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.662802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.662827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.662933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.663034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.663060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.663167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.663266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.663292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.663400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.663500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.663535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.663665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.663788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.663814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.663919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.664022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.664047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.664145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.664247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.664274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.664402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.664535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.664561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.664668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.664774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.664800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.664901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.665002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.665027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.665122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.665218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.665244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.665381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.665491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.665518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.665633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.665729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.665754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.665859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.665960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.665992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.666102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.666198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.666223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.666323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.666422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.666448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.666550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.666655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.666682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.666812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.666946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.666971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.667069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.667162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.667188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.667303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.667428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.667455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.667566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.667698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.667724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.667861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.667974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.668000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.668099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.668201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.668227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.668329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.668428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.668459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.668563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.668691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.668716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.668814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.668941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.668966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-11-28 11:51:47.669068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.669194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.842 [2024-11-28 11:51:47.669219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.669326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.669461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.669485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.669594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.669760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.669786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.669920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.670021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.670046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.670207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.670311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.670336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.670468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.670599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.670625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.670726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.670853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.670879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.670986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.671090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.671122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.671266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.671405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.671430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.671529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.671635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.671661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.671767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.671926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.671951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.672081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.672208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.672233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.672335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.672434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.672460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.672574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.672672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.672699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.672805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.672903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.672929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.673026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.673136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.673163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.673269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.673360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.673386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.673497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.673631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.673657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.673797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.673935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.673960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.674090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.674190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.674216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.674344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.674472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.674498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.674671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.674775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.674801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.674936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.675041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.675067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.675180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.675318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.675344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.675454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.675582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.675609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.675709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.675808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.675834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.675966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.676063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.676088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.676222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.676324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.676350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.676460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.676564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.676591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-11-28 11:51:47.676724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.843 [2024-11-28 11:51:47.676837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.676862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.676972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.677072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.677099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.677237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.677341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.677367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.677470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.677573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.677599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.677731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.677866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.677891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.678030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.678123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.678149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.678261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.678360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.678386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.678491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.678628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.678654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.678758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.678854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.678879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.679016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.679121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.679148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.679254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.679350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.679376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.679489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.679607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.679635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.679746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.679846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.679873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.680009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.680103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.680129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.680228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.680337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.680363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.680492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.680592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.680619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.680725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.680829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.680857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.680957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.681079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.681105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.681236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.681336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.681361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.681462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.681562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.681588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.681700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.681826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.681852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.681962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.682063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.682089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.682204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.682336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.682361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.682466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.682569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.682595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.682695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.682822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.682847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.682958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.683063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.683091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.683221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.683327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.683353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.683461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.683563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.683589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.683696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.683791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.844 [2024-11-28 11:51:47.683816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.844 qpair failed and we were unable to recover it. 00:27:27.844 [2024-11-28 11:51:47.683951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.684056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.684081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.684185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.684287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.684313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.684420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.684555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.684582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.684693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.684793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.684819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.684928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.685030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.685055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.685155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.685277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.685303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.685405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.685507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.685540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.685644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.685778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.685803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.685908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.686008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.686033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.686139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.686237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.686262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.686370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.686534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.686561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.686721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.686818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.686844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.686978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.687110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.687137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.687244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.687376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.687401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.687505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.687635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.687661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.687769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.687902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.687927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.688026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.688125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.688151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.688252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.688346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.688372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.688472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.688577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.688603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.688707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.688806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.688832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.688949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.689055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.689082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.689218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.689325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.689350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.689449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.689559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.689587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.689720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.689815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.689841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.689940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.690078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.690105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.845 qpair failed and we were unable to recover it. 00:27:27.845 [2024-11-28 11:51:47.690241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.845 [2024-11-28 11:51:47.690339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.690365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.690463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.690603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.690630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.690728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.690835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.690860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.690968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.691069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.691095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.691195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.691294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.691321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa28000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.691441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.691589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.691619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.691755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.691858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.691886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.692016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.692147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.692173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.692277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.692384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.692410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.692578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.692679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.692705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.692802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.692899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.692925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.693023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.693151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.693176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.693304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.693401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.693428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.693538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.693646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.693671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.693773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.693873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.693899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.694001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.694102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.694127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.694264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.694370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.694395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.694499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.694604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.694630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.694738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.694857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.694883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.694988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.695086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.695112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.695242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.695356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.695382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.695490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.695623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.695649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.695761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.695861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.695887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.695980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.696091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.696118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.696223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.696379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.696405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.696511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.696618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.696644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.696751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.696902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.696927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.697029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.697128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.697153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.697288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.697423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.846 [2024-11-28 11:51:47.697448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.846 qpair failed and we were unable to recover it. 00:27:27.846 [2024-11-28 11:51:47.697582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.697713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.697738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.697838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.697968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.697993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.698096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.698194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.698219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.698350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.698445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.698471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.698576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.698677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.698702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.698832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.698962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.698987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.699115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.699251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.699278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.699384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.699490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.699516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.699639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.699764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.699789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.699893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.700001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.700027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.700153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.700250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.700275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.700379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.700476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.700501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.700607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.700738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.700763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.700860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.700967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.700992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.701087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.701179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.701204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.701307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.701409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.701434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.701544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.701683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.701708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.701867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.701973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.701997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.702094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.702196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.702220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.702316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.702412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.702437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.702544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.702675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.702700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.702802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.702930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.702954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.703063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.703192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.703218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.703323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.703430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.703455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.703560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.703694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.703720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.703827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.703931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.703958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.704062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.704186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.704217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.704325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.704449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.704474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.847 [2024-11-28 11:51:47.704575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.704674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.847 [2024-11-28 11:51:47.704700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.847 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.704804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.704897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.704921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.705057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.705159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.705185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.705286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.705389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.705415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.705522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.705636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.705662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.705769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.705873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.705898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.706028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.706153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.706179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.706285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.706383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.706408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.706518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.706630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.706659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.706765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.706894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.706919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.707057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.707186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.707210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.707306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.707437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.707462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.707562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.707667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.707692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.707799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.707931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.707956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.708060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.708163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.708188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.708288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.708418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.708443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.708553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.708659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.708684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.708821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.708944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.708968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.709067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.709169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.709200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.709331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.709457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.709481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.709627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.709730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.709756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.709865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.709971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.709996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.710127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.710229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.710254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.710383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.710486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.710510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.710625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.710760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.710785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.710889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.710992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.711017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.711117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.711251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.711277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.711377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.711509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.711543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.711657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.711792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.711836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.848 qpair failed and we were unable to recover it. 00:27:27.848 [2024-11-28 11:51:47.711966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.712062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.848 [2024-11-28 11:51:47.712087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.712224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.712323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.712348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.712449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.712555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.712581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.712694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.712798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.712823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.712924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.713030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.713055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.713184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.713286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.713310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.713420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.713528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.713553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.713687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.713790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.713815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.713919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.714022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.714047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.714145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.714270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.714294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.714403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.714536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.714561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.714668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.714799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.714824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.714931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.715032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.715057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.715165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.715296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.715322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.715430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.715565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.715590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.715697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.715799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.715826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.715938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.716074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.716099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.716225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.716324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.716349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.716454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.716588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.716613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.716721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.716818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.716843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.716986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.717093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.717118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.717225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.717385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.717410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.717514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.717629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.717654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.717782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.717909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.717934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.718070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.718168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.718193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.718317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.718422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.849 [2024-11-28 11:51:47.718448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.849 qpair failed and we were unable to recover it. 00:27:27.849 [2024-11-28 11:51:47.718553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.718655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.718680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.718808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.718943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.718969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.719067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.719196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.719221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.719322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.719421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.719448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.719560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.719715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.719741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.719843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.719944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.719971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.720081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.720189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.720215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.720313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.720439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.720464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.720565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.720672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.720698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.720810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.720918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.720945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.721055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.721154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.721179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.721305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.721438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.721465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.721591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.721724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.721749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.721846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.721953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.721978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.722088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.722190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.722216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.722322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.722427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.722453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.722553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.722661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.722686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.722792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.722892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.722916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.723015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.723140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.723165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.723298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.723398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.723423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.723580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.723684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.723710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.723816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.723950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.723975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.724072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.724176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.724201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.724302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.724400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.724425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.724538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.724644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.724669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.724781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.724914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.724940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.725037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.725140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.725165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.725259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.725383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.725408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.850 qpair failed and we were unable to recover it. 00:27:27.850 [2024-11-28 11:51:47.725516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.725633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.850 [2024-11-28 11:51:47.725661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.725767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.725880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.725906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.726023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.726118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.726143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.726274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.726405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.726431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.726568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.726695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.726722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.726864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.726989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.727013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.727127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.727259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.727284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.727379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.727509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.727540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.727641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.727744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.727769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.727873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.728016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.728042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.728179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.728278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.728304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.728404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.728542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.728569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.728666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.728763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.728789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.728920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.729052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.729078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.729207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.729335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.729361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.729468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.729581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.729608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.729713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.729820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.729847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.729975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.730099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.730124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.730220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.730320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.730346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.730457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.730567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.730593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.730707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.730809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.730835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.730962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.731060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.731085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.731219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.731319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.731345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.731471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.731598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.731624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.731727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.731830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.731855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.731969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.732065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.732090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.732191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.732321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.732347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.732449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.732552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.732578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.732707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.732802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.732828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.851 qpair failed and we were unable to recover it. 00:27:27.851 [2024-11-28 11:51:47.732958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.851 [2024-11-28 11:51:47.733059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.733085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.733192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.733294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.733320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.733448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.733553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.733580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.733684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.733785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.733812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.733916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.734044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.734069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.734171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.734306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.734332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.734440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.734538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.734564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.734701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.734806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.734832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.734941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.735071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.735097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.735227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.735324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.735350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.735511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.735614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.735640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.735740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.735867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.735893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.736000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.736108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.736134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.736239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.736373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.736399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.736536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.736637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.736663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.736792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.736894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.736919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.737041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.737167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.737192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.737301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.737432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.737457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.737557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.737658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.737682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.737785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.737908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.737932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.738025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.738125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.738150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.738253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.738356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.738380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.738476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.738588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.738613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.738714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.738870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.738895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.738993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.739086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.739111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.739214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.739306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.739331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.739431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.739557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.739583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.739689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.739819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.739844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.739954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.740060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.852 [2024-11-28 11:51:47.740085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.852 qpair failed and we were unable to recover it. 00:27:27.852 [2024-11-28 11:51:47.740193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.740324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.740349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.740453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.740556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.740582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.740688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.740793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.740819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.740946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.741043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.741068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.741201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.741359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.741384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.741489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.741602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.741628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.741729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.741827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.741854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.741960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.742084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.742109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.742207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.742341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.742366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.742492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.742596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.742622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.742722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.742820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.742844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.742952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.743076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.743102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.743211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.743306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.743330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.743460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.743566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.743591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.743725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.743856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.743881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.743984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.744109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.744134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.744244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.744344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.744368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.744498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.744605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.744630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.744744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.744880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.744908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.745009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.745138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.745163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.745317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.745412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.745436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.745597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.745730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.745755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.745864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.745967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.745992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.746096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.746197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.746223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.746327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.746433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.746458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.746567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.746674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.746698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.746793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.746922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.746947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.747055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.747179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.747203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.853 [2024-11-28 11:51:47.747307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.747402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.853 [2024-11-28 11:51:47.747432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.853 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.747539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.747645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.747670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.747795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.747897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.747922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.748057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.748164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.748189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.748297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.748395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.748420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.748517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.748625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.748653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.748765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.748864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.748889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.749020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.749118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.749142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.749245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.749345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.749369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.749505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.749626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.749651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.749754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.749880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.749911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.750021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.750152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.750179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.750303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.750424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.750449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.750585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.750715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.750741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.750845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.750944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.750970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.751079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.751180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.751205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.751335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.751450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.751475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.751579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.751682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.751707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.751835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.751963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.751988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.752094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.752254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.752279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.752381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.752490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.752520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.752666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.752777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.752802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.752909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.753013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.753039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.753143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.753239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.753265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.753371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.753474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.753499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.753645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.753745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.854 [2024-11-28 11:51:47.753771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.854 qpair failed and we were unable to recover it. 00:27:27.854 [2024-11-28 11:51:47.753906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.754040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.754066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.754174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.754288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.754314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.754418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.754532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.754558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.754685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.754816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.754841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.754943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.755042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.755068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.755179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.755277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.755302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.755402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.755537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.755563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.755673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.755770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.755795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.755902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.756000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.756024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.756156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.756283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.756309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.756439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.756546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.756573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.756681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.756781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.756805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.756906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.757012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.757036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.757140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.757272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.757300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.757432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.757540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.757565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.757674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.757773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.757798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.757902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.758000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.758025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.758155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.758269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.758294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.758400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.758503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.758534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.758632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.758799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.758824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.758933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.759041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.759066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.759231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.759339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.759364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.759492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.759629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.759655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.759760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.759866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.759890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.760020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.760153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.760178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.760289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.760442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.760467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.760594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.760695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.760720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.760827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.760926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.760950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.855 [2024-11-28 11:51:47.761072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.761181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.855 [2024-11-28 11:51:47.761206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.855 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.761339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.761460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.761485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.761594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.761692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.761717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.761846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.761954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.761980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.762082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.762214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.762240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.762378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.762515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.762555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.762661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.762758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.762783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.762921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.763049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.763074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.763183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.763299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.763325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.763463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.763565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.763590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.763724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.763830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.763854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.763961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.764058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.764084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.764189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.764281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.764306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.764436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.764543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.764568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.764676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.764779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.764804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.764910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.765063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.765089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.765185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.765282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.765308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.765454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.765559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.765585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.765696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.765789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.765813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.765915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.766017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.766043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.766144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.766272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.766296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.766404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.766561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.766586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.766694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.766828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.766853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.766955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.767046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.767070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.767202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.767423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.767449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.767613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.767738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.767763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.767870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.767969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.767994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.768095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.768192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.768217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.768326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 11:51:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:27.856 [2024-11-28 11:51:47.768426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.768452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.856 qpair failed and we were unable to recover it. 00:27:27.856 [2024-11-28 11:51:47.768569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.856 [2024-11-28 11:51:47.768668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.768693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 11:51:47 -- common/autotest_common.sh@862 -- # return 0 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.768798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.768919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.768944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.769046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 11:51:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:27.857 [2024-11-28 11:51:47.769154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.769180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.769310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 11:51:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:27.857 [2024-11-28 11:51:47.769437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.769462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.769570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 11:51:47 -- common/autotest_common.sh@10 -- # set +x 00:27:27.857 [2024-11-28 11:51:47.769673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.769699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.769829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.769956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.769982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.770114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.770237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.770274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.770382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.770516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.770557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.770666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.770805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.770829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.770934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.771038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.771062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.771199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.771297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.771321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.771421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.771532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.771559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.771669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.771776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.771801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.771933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.772023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.772049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.772176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.772308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.772334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.772439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.772539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.772575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.772681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.772788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.772814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.772923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.773084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.773114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.773222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.773349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.773374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.773478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.773581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.773606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.773711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.773818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.773843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.773949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.774081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.774106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.774213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.774342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.774369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.774498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.774648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.774675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.774780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.774909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.774934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.775043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.775152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.775177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.775289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.775386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.775412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.775520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.775654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.775685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.857 qpair failed and we were unable to recover it. 00:27:27.857 [2024-11-28 11:51:47.775803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.857 [2024-11-28 11:51:47.775959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.775984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.776115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.776240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.776264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.776370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.776494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.776519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.776628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.776731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.776755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.776862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.776984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.777009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.777141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.777237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.777262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.777364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.777521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.777554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.777685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.777790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.777816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.777948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.778052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.778078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.778184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.778307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.778337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.778464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.778568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.778593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.778726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.778848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.778872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.779011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.779107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.779132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.779270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.779404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.779429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.779562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.779660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.779685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.779816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.779968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.779993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.780096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.780199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.780224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.780328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.780454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.780480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.780615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.780751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.780776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.780904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.781007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.781036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.781172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.781303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.781329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.781443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.781550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.781576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.781685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.781813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.781838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.781947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.782045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.782069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.782203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.782306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.782332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.858 [2024-11-28 11:51:47.782433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.782563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.858 [2024-11-28 11:51:47.782590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.858 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.782706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.782839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.782864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.782961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.783068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.783093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.783226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.783328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.783353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.783476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.783607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.783632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.783738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.783872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.783898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.784036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.784144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.784169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.784299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.784425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.784450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.784565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.784700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.784726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.784832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.784944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.784970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.785075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.785205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.785231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.785371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.785501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.785531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.785694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.785804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.785830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.785967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.786067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.786094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.786196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.786329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.786355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.786492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.786604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.786629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.786728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.786880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.786905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.787011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.787112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.787138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.787270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.787374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.787401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.787545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.787651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.787676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.787774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.787910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.787936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.788051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.788192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.788216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.788344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.788444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.788468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.788581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.788712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.788738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.788838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.788937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.788962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.789070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.789193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.789219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.789367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.789506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.789538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.789646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.789741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.789767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.789905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.790034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.790059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.859 qpair failed and we were unable to recover it. 00:27:27.859 [2024-11-28 11:51:47.790191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.859 [2024-11-28 11:51:47.790296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.790320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.790419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.790522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.790562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.790705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.790811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.790836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.790945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.791045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.791070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.791183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.791292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.791317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.791452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.791561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.791588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.791708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.791838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.791863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.791968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.792073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.792098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.792224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.792318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.792344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 11:51:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.792451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.792580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.792606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 11:51:47 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:27.860 [2024-11-28 11:51:47.792714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.792806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.792832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 11:51:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:27.860 [2024-11-28 11:51:47.792938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.793042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.793067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 11:51:47 -- common/autotest_common.sh@10 -- # set +x 00:27:27.860 [2024-11-28 11:51:47.793202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.793304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.793330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.793446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.793574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.793602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.793697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.793796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.793820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.793931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.794065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.794090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.794220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.794320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.794344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.794450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.794555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.794581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.794692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.794847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.794872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.795001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.795098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.795124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.795231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.795353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.795378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.795482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.795592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.795619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.795733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.795863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.795889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.796024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.796154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.796180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.796281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.796376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.796400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.796536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.796659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.796686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.796801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.796928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.796954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.797052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.797152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.797177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.860 qpair failed and we were unable to recover it. 00:27:27.860 [2024-11-28 11:51:47.797306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.860 [2024-11-28 11:51:47.797429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.797454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.797582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.797685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.797710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.797816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.797918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.797943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.798045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.798173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.798198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.798304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.798413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.798439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.798540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.798645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.798669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.798797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.798928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.798953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.799083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.799231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.799256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.799387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.799495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.799519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.799666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.799771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.799795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.799908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.800009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.800033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.800161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.800261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.800285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.800389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.800536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.800561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.800705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.800841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.800866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.800967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.801074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.801100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.801238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.801368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.801393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.801500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.801613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.801639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.801758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.801892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.801917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.802021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.802126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.802152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.802278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.802403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.802428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.802559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.802688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.802713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.802818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.802949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.802974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.803089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.803183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.803208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.803313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.803421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.803447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.803577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.803683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.803709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.803840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.804012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.804037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.804172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.804272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.804297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.804405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.804542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.804568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.804686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.804789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-28 11:51:47.804814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.861 qpair failed and we were unable to recover it. 00:27:27.861 [2024-11-28 11:51:47.804946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.805101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.805126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.805240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.805346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.805371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.805502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.805633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.805659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.805768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.805869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.805894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.806003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.806099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.806124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.806231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.806359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.806384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.806501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.806622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.806648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.806784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.806961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.806986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.807117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.807251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.807282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.807391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.807501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.807532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.807676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.807804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.807830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.807928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.808062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.808088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.808187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.808288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.808313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.808422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.808557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.808588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.808730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.808863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.808888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.808992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.809091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.809116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.809293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.809401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.809427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.809559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.809676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.809701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.809799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.809929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.809959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.810057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.810161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.810188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.810326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.810424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.810449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.810570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.810675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.810700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.810798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.810897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.810921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.811026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.811131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.811157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.811262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.811422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.811447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.811583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.811691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.811716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.811828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.811930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.811954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.812055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.812184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.812208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.812311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.812417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-28 11:51:47.812446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.862 qpair failed and we were unable to recover it. 00:27:27.862 [2024-11-28 11:51:47.812556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.812674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.812698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.812796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.812932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.812957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.813085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.813211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.813236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.813339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.813438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.813463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.813587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.813732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.813757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.813869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.813972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.813996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.814099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.814234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.814259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.814364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.814471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.814495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.814602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.814719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.814746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.814882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.814984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.815014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.815145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.815274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.815299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.815440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.815548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.815574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.815723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.815824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.815849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.815957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.816065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.816090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.816224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.816333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.816358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.816472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.816571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.816597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.816708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.816810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.816836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.816941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.817049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.817075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.817222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.817320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.817345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.817454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.817587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.817612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.817734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.817846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.817871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.817976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.818104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.818128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.818261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.818367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.818392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.818554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.818658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.818683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.818813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.818917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-28 11:51:47.818942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.863 qpair failed and we were unable to recover it. 00:27:27.863 [2024-11-28 11:51:47.819070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.819168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.819193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.819295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.819391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.819416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.819535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.819697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.819721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.819828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.819931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.819955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.820064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.820195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.820220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.820356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.820459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.820484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.820631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.820769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.820793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 Malloc0 00:27:27.864 [2024-11-28 11:51:47.820926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.821039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.821064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.821193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 11:51:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:27.864 [2024-11-28 11:51:47.821301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.821325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 11:51:47 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:27.864 [2024-11-28 11:51:47.821425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.821521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.821553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 11:51:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 11:51:47 -- common/autotest_common.sh@10 -- # set +x 00:27:27.864 [2024-11-28 11:51:47.821685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.821788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.821812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.821934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.822042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.822068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.822175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.822276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.822301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.822416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.822557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.822586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.822698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.822810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.822836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.822947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.823075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.823101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.823199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.823329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.823354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.823483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.823633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.823659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.823769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.823927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.823952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.824061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.824165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.824189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.824348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.824476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.824501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.824554] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:27.864 [2024-11-28 11:51:47.824618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.824726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.824750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.824862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.824969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.824995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.825131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.825264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.825290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.825396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.825503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.825534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.825646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.825779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.825805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.825963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.826077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.826102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.864 qpair failed and we were unable to recover it. 00:27:27.864 [2024-11-28 11:51:47.826237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.864 [2024-11-28 11:51:47.826346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.826372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.826503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.826647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.826673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.826798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.826906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.826932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.827045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.827154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.827180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.827285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.827420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.827446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.827558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.827662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.827687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.827850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.827953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.827977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.828140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.828269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.828294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.828453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.828560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.828586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.828704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.828832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.828857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.828961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.829089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.829114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.829224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.829326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.829351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.829467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.829600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.829626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.829733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.829865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.829889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.830025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.830129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.830154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.830259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.830359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.830384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.830493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.830623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.830648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.830783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.830913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.830938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.831074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.831175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.831199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.831337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.831434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.831458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.831561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.831716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.831741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.831847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.831945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.831969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.832127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.832229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.832254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.832353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.832456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.832480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.832603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.832735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.832760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 11:51:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:27.865 [2024-11-28 11:51:47.832866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 11:51:47 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:27.865 [2024-11-28 11:51:47.833000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.833025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 11:51:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.865 [2024-11-28 11:51:47.833129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 11:51:47 -- common/autotest_common.sh@10 -- # set +x 00:27:27.865 [2024-11-28 11:51:47.833254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.865 [2024-11-28 11:51:47.833283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.865 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.833380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.833484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.833508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.833632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.833769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.833794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.833899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.834009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.834033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.834137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.834266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.834291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.834400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.834500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.834530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.834634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.834738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.834764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.834893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.834999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.835023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.835127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.835226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.835250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.835381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.835495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.835520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.835673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.835768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.835798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.835909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.836039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.836063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.836171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.836277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.836302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.836405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.836561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.836587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.836701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.836829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.836853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.836967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.837106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.837131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.837240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.837341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.837365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.837474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.837608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.837634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.837778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.837884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.837909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.838039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.838150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.838176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.838285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.838395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.838424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.838534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.838641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.838666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.838800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.838903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.838927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.839031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.839191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.839216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.839316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.839415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.839439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.839547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.839643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.839667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.839803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.839910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.839935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.840065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.840168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.840192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.840292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.840450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.840474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 [2024-11-28 11:51:47.840592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.840698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 [2024-11-28 11:51:47.840723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.866 qpair failed and we were unable to recover it. 00:27:27.866 11:51:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:27.866 [2024-11-28 11:51:47.840820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.866 11:51:47 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:27.866 [2024-11-28 11:51:47.840980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.841005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 11:51:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:27.867 [2024-11-28 11:51:47.841108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 11:51:47 -- common/autotest_common.sh@10 -- # set +x 00:27:27.867 [2024-11-28 11:51:47.841218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.841243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.841371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.841507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.841537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.841653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.841770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.841794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.841898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.842001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.842026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.842125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.842229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.842254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.842364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.842495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.842520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.842631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.842759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.842783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.842918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.843024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.843049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.843178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.843304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.843329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.843476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.843583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.843608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.843716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.843824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.843848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.843979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.844080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.844104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.844263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.844397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.844422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.844564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.844666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.844692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.844799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.844928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.844952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.845064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.845172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.845196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.845307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.845437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.845462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.845570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.845680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.845706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.845841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.845944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.845968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.846083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.846209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.846234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.846356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.846458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.846484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.846595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.846726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.846751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.846855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.846959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.846984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.847121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.847229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.847254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.847390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.847522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.847554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.867 [2024-11-28 11:51:47.847662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.847772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.867 [2024-11-28 11:51:47.847797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.867 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.847926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.848032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.848058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.848220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.848361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.848387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.848500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.848607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.848632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ffa30000b90 with addr=10.0.0.2, port=4420 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.848763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 11:51:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:27.868 [2024-11-28 11:51:47.848911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.848940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 11:51:47 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:27.868 [2024-11-28 11:51:47.849056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 11:51:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:27.868 [2024-11-28 11:51:47.849157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.849182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.868 11:51:47 -- common/autotest_common.sh@10 -- # set +x 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.849294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.849400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.849425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.849540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.849646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.849673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.849775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.849877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.849903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.850018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.850123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.850148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.850258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.850364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.850389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.850498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.850611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.850636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.850749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.850877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.850903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.851003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.851111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.851143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.851253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.851355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.851380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.851521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.851638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.868 [2024-11-28 11:51:47.851663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:27.868 qpair failed and we were unable to recover it. 00:27:27.868 [2024-11-28 11:51:47.851766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-28 11:51:47.851867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.127 [2024-11-28 11:51:47.851892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:28.127 qpair failed and we were unable to recover it. 00:27:28.128 [2024-11-28 11:51:47.852023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.128 [2024-11-28 11:51:47.852123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.128 [2024-11-28 11:51:47.852148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:28.128 qpair failed and we were unable to recover it. 00:27:28.128 [2024-11-28 11:51:47.852270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.128 [2024-11-28 11:51:47.852391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.128 [2024-11-28 11:51:47.852416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:28.128 qpair failed and we were unable to recover it. 00:27:28.128 [2024-11-28 11:51:47.852520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.128 [2024-11-28 11:51:47.852645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.128 [2024-11-28 11:51:47.852670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183ecb0 with addr=10.0.0.2, port=4420 00:27:28.128 qpair failed and we were unable to recover it. 00:27:28.128 [2024-11-28 11:51:47.852823] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:28.128 [2024-11-28 11:51:47.855250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.128 [2024-11-28 11:51:47.855382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.128 [2024-11-28 11:51:47.855410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.128 [2024-11-28 11:51:47.855426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.128 [2024-11-28 11:51:47.855439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.128 [2024-11-28 11:51:47.855474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.128 qpair failed and we were unable to recover it. 00:27:28.128 11:51:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.128 11:51:47 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:28.128 11:51:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.128 11:51:47 -- common/autotest_common.sh@10 -- # set +x 00:27:28.128 11:51:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.128 11:51:47 -- host/target_disconnect.sh@58 -- # wait 3930265 00:27:28.128 [2024-11-28 11:51:47.865110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.128 [2024-11-28 11:51:47.865226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.128 [2024-11-28 11:51:47.865252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.128 [2024-11-28 11:51:47.865267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.128 [2024-11-28 11:51:47.865280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.128 [2024-11-28 11:51:47.865308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.128 qpair failed and we were unable to recover it. 00:27:28.128 [2024-11-28 11:51:47.875234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.128 [2024-11-28 11:51:47.875339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.128 [2024-11-28 11:51:47.875366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.128 [2024-11-28 11:51:47.875381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.128 [2024-11-28 11:51:47.875394] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.128 [2024-11-28 11:51:47.875422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.128 qpair failed and we were unable to recover it. 00:27:28.128 [2024-11-28 11:51:47.885190] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.128 [2024-11-28 11:51:47.885308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.128 [2024-11-28 11:51:47.885333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.128 [2024-11-28 11:51:47.885347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.128 [2024-11-28 11:51:47.885360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.128 [2024-11-28 11:51:47.885389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.128 qpair failed and we were unable to recover it. 00:27:28.128 [2024-11-28 11:51:47.895151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.128 [2024-11-28 11:51:47.895255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.128 [2024-11-28 11:51:47.895281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.128 [2024-11-28 11:51:47.895296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.128 [2024-11-28 11:51:47.895308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.128 [2024-11-28 11:51:47.895339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.128 qpair failed and we were unable to recover it. 00:27:28.128 [2024-11-28 11:51:47.905400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.128 [2024-11-28 11:51:47.905512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.128 [2024-11-28 11:51:47.905554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.128 [2024-11-28 11:51:47.905577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.128 [2024-11-28 11:51:47.905591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.128 [2024-11-28 11:51:47.905620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.128 qpair failed and we were unable to recover it. 00:27:28.128 [2024-11-28 11:51:47.915229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.128 [2024-11-28 11:51:47.915340] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.128 [2024-11-28 11:51:47.915366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.128 [2024-11-28 11:51:47.915380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.128 [2024-11-28 11:51:47.915393] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.128 [2024-11-28 11:51:47.915422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.128 qpair failed and we were unable to recover it. 00:27:28.128 [2024-11-28 11:51:47.925245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.128 [2024-11-28 11:51:47.925357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.128 [2024-11-28 11:51:47.925382] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.128 [2024-11-28 11:51:47.925396] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.128 [2024-11-28 11:51:47.925410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.128 [2024-11-28 11:51:47.925440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.128 qpair failed and we were unable to recover it. 00:27:28.128 [2024-11-28 11:51:47.935281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.128 [2024-11-28 11:51:47.935397] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.128 [2024-11-28 11:51:47.935422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.128 [2024-11-28 11:51:47.935436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.128 [2024-11-28 11:51:47.935449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.128 [2024-11-28 11:51:47.935477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.128 qpair failed and we were unable to recover it. 00:27:28.128 [2024-11-28 11:51:47.945331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.128 [2024-11-28 11:51:47.945440] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.128 [2024-11-28 11:51:47.945466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.128 [2024-11-28 11:51:47.945480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.128 [2024-11-28 11:51:47.945493] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.128 [2024-11-28 11:51:47.945521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.128 qpair failed and we were unable to recover it. 00:27:28.128 [2024-11-28 11:51:47.955279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.128 [2024-11-28 11:51:47.955383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.128 [2024-11-28 11:51:47.955409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.128 [2024-11-28 11:51:47.955423] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.128 [2024-11-28 11:51:47.955436] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.128 [2024-11-28 11:51:47.955464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.128 qpair failed and we were unable to recover it. 00:27:28.128 [2024-11-28 11:51:47.965308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.128 [2024-11-28 11:51:47.965416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.129 [2024-11-28 11:51:47.965441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.129 [2024-11-28 11:51:47.965455] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.129 [2024-11-28 11:51:47.965467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.129 [2024-11-28 11:51:47.965496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.129 qpair failed and we were unable to recover it. 00:27:28.129 [2024-11-28 11:51:47.975342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.129 [2024-11-28 11:51:47.975444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.129 [2024-11-28 11:51:47.975470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.129 [2024-11-28 11:51:47.975484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.129 [2024-11-28 11:51:47.975497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.129 [2024-11-28 11:51:47.975533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.129 qpair failed and we were unable to recover it. 00:27:28.129 [2024-11-28 11:51:47.985345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.129 [2024-11-28 11:51:47.985447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.129 [2024-11-28 11:51:47.985472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.129 [2024-11-28 11:51:47.985486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.129 [2024-11-28 11:51:47.985499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.129 [2024-11-28 11:51:47.985534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.129 qpair failed and we were unable to recover it. 00:27:28.129 [2024-11-28 11:51:47.995392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.129 [2024-11-28 11:51:47.995497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.129 [2024-11-28 11:51:47.995522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.129 [2024-11-28 11:51:47.995550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.129 [2024-11-28 11:51:47.995564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.129 [2024-11-28 11:51:47.995593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.129 qpair failed and we were unable to recover it. 00:27:28.129 [2024-11-28 11:51:48.005458] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.129 [2024-11-28 11:51:48.005576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.129 [2024-11-28 11:51:48.005601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.129 [2024-11-28 11:51:48.005615] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.129 [2024-11-28 11:51:48.005627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.129 [2024-11-28 11:51:48.005657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.129 qpair failed and we were unable to recover it. 00:27:28.129 [2024-11-28 11:51:48.015456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.129 [2024-11-28 11:51:48.015572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.129 [2024-11-28 11:51:48.015597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.129 [2024-11-28 11:51:48.015611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.129 [2024-11-28 11:51:48.015624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.129 [2024-11-28 11:51:48.015653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.129 qpair failed and we were unable to recover it. 00:27:28.129 [2024-11-28 11:51:48.025491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.129 [2024-11-28 11:51:48.025613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.129 [2024-11-28 11:51:48.025639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.129 [2024-11-28 11:51:48.025654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.129 [2024-11-28 11:51:48.025669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.129 [2024-11-28 11:51:48.025699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.129 qpair failed and we were unable to recover it. 00:27:28.129 [2024-11-28 11:51:48.035493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.129 [2024-11-28 11:51:48.035596] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.129 [2024-11-28 11:51:48.035622] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.129 [2024-11-28 11:51:48.035637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.129 [2024-11-28 11:51:48.035650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.129 [2024-11-28 11:51:48.035680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.129 qpair failed and we were unable to recover it. 00:27:28.129 [2024-11-28 11:51:48.045570] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.129 [2024-11-28 11:51:48.045681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.129 [2024-11-28 11:51:48.045706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.129 [2024-11-28 11:51:48.045720] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.129 [2024-11-28 11:51:48.045733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.129 [2024-11-28 11:51:48.045762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.129 qpair failed and we were unable to recover it. 00:27:28.129 [2024-11-28 11:51:48.055573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.129 [2024-11-28 11:51:48.055683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.129 [2024-11-28 11:51:48.055708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.129 [2024-11-28 11:51:48.055722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.129 [2024-11-28 11:51:48.055735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.129 [2024-11-28 11:51:48.055763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.129 qpair failed and we were unable to recover it. 00:27:28.129 [2024-11-28 11:51:48.065610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.129 [2024-11-28 11:51:48.065715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.129 [2024-11-28 11:51:48.065740] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.129 [2024-11-28 11:51:48.065755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.129 [2024-11-28 11:51:48.065768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.129 [2024-11-28 11:51:48.065795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.129 qpair failed and we were unable to recover it. 00:27:28.129 [2024-11-28 11:51:48.075626] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.129 [2024-11-28 11:51:48.075730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.129 [2024-11-28 11:51:48.075755] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.129 [2024-11-28 11:51:48.075770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.129 [2024-11-28 11:51:48.075782] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.129 [2024-11-28 11:51:48.075811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.129 qpair failed and we were unable to recover it. 00:27:28.129 [2024-11-28 11:51:48.085719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.129 [2024-11-28 11:51:48.085859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.129 [2024-11-28 11:51:48.085884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.129 [2024-11-28 11:51:48.085905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.129 [2024-11-28 11:51:48.085918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.129 [2024-11-28 11:51:48.085946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.129 qpair failed and we were unable to recover it. 00:27:28.129 [2024-11-28 11:51:48.095700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.129 [2024-11-28 11:51:48.095807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.129 [2024-11-28 11:51:48.095832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.129 [2024-11-28 11:51:48.095847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.129 [2024-11-28 11:51:48.095860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.129 [2024-11-28 11:51:48.095887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.129 qpair failed and we were unable to recover it. 00:27:28.130 [2024-11-28 11:51:48.105723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.130 [2024-11-28 11:51:48.105826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.130 [2024-11-28 11:51:48.105850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.130 [2024-11-28 11:51:48.105864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.130 [2024-11-28 11:51:48.105877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.130 [2024-11-28 11:51:48.105905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.130 qpair failed and we were unable to recover it. 00:27:28.130 [2024-11-28 11:51:48.115758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.130 [2024-11-28 11:51:48.115859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.130 [2024-11-28 11:51:48.115886] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.130 [2024-11-28 11:51:48.115900] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.130 [2024-11-28 11:51:48.115913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.130 [2024-11-28 11:51:48.115943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.130 qpair failed and we were unable to recover it. 00:27:28.130 [2024-11-28 11:51:48.125807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.130 [2024-11-28 11:51:48.125917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.130 [2024-11-28 11:51:48.125942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.130 [2024-11-28 11:51:48.125957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.130 [2024-11-28 11:51:48.125969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.130 [2024-11-28 11:51:48.125997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.130 qpair failed and we were unable to recover it. 00:27:28.130 [2024-11-28 11:51:48.135795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.130 [2024-11-28 11:51:48.135904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.130 [2024-11-28 11:51:48.135929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.130 [2024-11-28 11:51:48.135944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.130 [2024-11-28 11:51:48.135957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.130 [2024-11-28 11:51:48.135985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.130 qpair failed and we were unable to recover it. 00:27:28.130 [2024-11-28 11:51:48.145847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.130 [2024-11-28 11:51:48.145954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.130 [2024-11-28 11:51:48.145979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.130 [2024-11-28 11:51:48.145994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.130 [2024-11-28 11:51:48.146007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.130 [2024-11-28 11:51:48.146035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.130 qpair failed and we were unable to recover it. 00:27:28.130 [2024-11-28 11:51:48.155870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.130 [2024-11-28 11:51:48.155998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.130 [2024-11-28 11:51:48.156023] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.130 [2024-11-28 11:51:48.156037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.130 [2024-11-28 11:51:48.156050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.130 [2024-11-28 11:51:48.156077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.130 qpair failed and we were unable to recover it. 00:27:28.130 [2024-11-28 11:51:48.165895] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.130 [2024-11-28 11:51:48.166007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.130 [2024-11-28 11:51:48.166032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.130 [2024-11-28 11:51:48.166046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.130 [2024-11-28 11:51:48.166060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.130 [2024-11-28 11:51:48.166088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.130 qpair failed and we were unable to recover it. 00:27:28.130 [2024-11-28 11:51:48.175931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.130 [2024-11-28 11:51:48.176038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.130 [2024-11-28 11:51:48.176067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.130 [2024-11-28 11:51:48.176082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.130 [2024-11-28 11:51:48.176095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.130 [2024-11-28 11:51:48.176123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.130 qpair failed and we were unable to recover it. 00:27:28.389 [2024-11-28 11:51:48.185950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.389 [2024-11-28 11:51:48.186054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.389 [2024-11-28 11:51:48.186079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.389 [2024-11-28 11:51:48.186093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.389 [2024-11-28 11:51:48.186106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.389 [2024-11-28 11:51:48.186134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.389 qpair failed and we were unable to recover it. 00:27:28.389 [2024-11-28 11:51:48.196033] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.389 [2024-11-28 11:51:48.196141] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.389 [2024-11-28 11:51:48.196167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.389 [2024-11-28 11:51:48.196182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.389 [2024-11-28 11:51:48.196197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.389 [2024-11-28 11:51:48.196226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.389 qpair failed and we were unable to recover it. 00:27:28.389 [2024-11-28 11:51:48.206061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.389 [2024-11-28 11:51:48.206175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.389 [2024-11-28 11:51:48.206201] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.389 [2024-11-28 11:51:48.206215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.389 [2024-11-28 11:51:48.206228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.389 [2024-11-28 11:51:48.206256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.389 qpair failed and we were unable to recover it. 00:27:28.389 [2024-11-28 11:51:48.216070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.389 [2024-11-28 11:51:48.216180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.389 [2024-11-28 11:51:48.216205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.389 [2024-11-28 11:51:48.216219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.389 [2024-11-28 11:51:48.216232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.389 [2024-11-28 11:51:48.216261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.389 qpair failed and we were unable to recover it. 00:27:28.389 [2024-11-28 11:51:48.226068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.389 [2024-11-28 11:51:48.226174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.389 [2024-11-28 11:51:48.226199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.389 [2024-11-28 11:51:48.226213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.389 [2024-11-28 11:51:48.226226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.389 [2024-11-28 11:51:48.226254] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.389 qpair failed and we were unable to recover it. 00:27:28.389 [2024-11-28 11:51:48.236133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.389 [2024-11-28 11:51:48.236234] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.389 [2024-11-28 11:51:48.236259] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.389 [2024-11-28 11:51:48.236273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.389 [2024-11-28 11:51:48.236286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.389 [2024-11-28 11:51:48.236314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.389 qpair failed and we were unable to recover it. 00:27:28.389 [2024-11-28 11:51:48.246155] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.390 [2024-11-28 11:51:48.246268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.390 [2024-11-28 11:51:48.246292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.390 [2024-11-28 11:51:48.246307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.390 [2024-11-28 11:51:48.246320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.390 [2024-11-28 11:51:48.246348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.390 qpair failed and we were unable to recover it. 00:27:28.390 [2024-11-28 11:51:48.256154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.390 [2024-11-28 11:51:48.256257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.390 [2024-11-28 11:51:48.256282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.390 [2024-11-28 11:51:48.256296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.390 [2024-11-28 11:51:48.256310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.390 [2024-11-28 11:51:48.256337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.390 qpair failed and we were unable to recover it. 00:27:28.390 [2024-11-28 11:51:48.266220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.390 [2024-11-28 11:51:48.266334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.390 [2024-11-28 11:51:48.266367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.390 [2024-11-28 11:51:48.266382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.390 [2024-11-28 11:51:48.266395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.390 [2024-11-28 11:51:48.266423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.390 qpair failed and we were unable to recover it. 00:27:28.390 [2024-11-28 11:51:48.276247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.390 [2024-11-28 11:51:48.276359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.390 [2024-11-28 11:51:48.276384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.390 [2024-11-28 11:51:48.276399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.390 [2024-11-28 11:51:48.276415] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.390 [2024-11-28 11:51:48.276443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.390 qpair failed and we were unable to recover it. 00:27:28.390 [2024-11-28 11:51:48.286283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.390 [2024-11-28 11:51:48.286402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.390 [2024-11-28 11:51:48.286428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.390 [2024-11-28 11:51:48.286443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.390 [2024-11-28 11:51:48.286459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.390 [2024-11-28 11:51:48.286487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.390 qpair failed and we were unable to recover it. 00:27:28.390 [2024-11-28 11:51:48.296279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.390 [2024-11-28 11:51:48.296379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.390 [2024-11-28 11:51:48.296404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.390 [2024-11-28 11:51:48.296418] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.390 [2024-11-28 11:51:48.296430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.390 [2024-11-28 11:51:48.296458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.390 qpair failed and we were unable to recover it. 00:27:28.390 [2024-11-28 11:51:48.306297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.390 [2024-11-28 11:51:48.306399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.390 [2024-11-28 11:51:48.306425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.390 [2024-11-28 11:51:48.306439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.390 [2024-11-28 11:51:48.306452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.390 [2024-11-28 11:51:48.306480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.390 qpair failed and we were unable to recover it. 00:27:28.390 [2024-11-28 11:51:48.316336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.390 [2024-11-28 11:51:48.316450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.390 [2024-11-28 11:51:48.316475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.390 [2024-11-28 11:51:48.316490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.390 [2024-11-28 11:51:48.316503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.390 [2024-11-28 11:51:48.316538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.390 qpair failed and we were unable to recover it. 00:27:28.390 [2024-11-28 11:51:48.326400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.390 [2024-11-28 11:51:48.326508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.390 [2024-11-28 11:51:48.326542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.390 [2024-11-28 11:51:48.326558] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.390 [2024-11-28 11:51:48.326571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.390 [2024-11-28 11:51:48.326600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.390 qpair failed and we were unable to recover it. 00:27:28.390 [2024-11-28 11:51:48.336389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.390 [2024-11-28 11:51:48.336497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.390 [2024-11-28 11:51:48.336522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.390 [2024-11-28 11:51:48.336545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.390 [2024-11-28 11:51:48.336558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.390 [2024-11-28 11:51:48.336587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.390 qpair failed and we were unable to recover it. 00:27:28.390 [2024-11-28 11:51:48.346422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.390 [2024-11-28 11:51:48.346522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.390 [2024-11-28 11:51:48.346554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.390 [2024-11-28 11:51:48.346568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.390 [2024-11-28 11:51:48.346581] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.390 [2024-11-28 11:51:48.346612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.390 qpair failed and we were unable to recover it. 00:27:28.390 [2024-11-28 11:51:48.356454] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.390 [2024-11-28 11:51:48.356564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.390 [2024-11-28 11:51:48.356595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.390 [2024-11-28 11:51:48.356610] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.390 [2024-11-28 11:51:48.356623] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.390 [2024-11-28 11:51:48.356652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.390 qpair failed and we were unable to recover it. 00:27:28.390 [2024-11-28 11:51:48.366500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.390 [2024-11-28 11:51:48.366614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.390 [2024-11-28 11:51:48.366639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.390 [2024-11-28 11:51:48.366653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.390 [2024-11-28 11:51:48.366666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.390 [2024-11-28 11:51:48.366694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.390 qpair failed and we were unable to recover it. 00:27:28.390 [2024-11-28 11:51:48.376564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.390 [2024-11-28 11:51:48.376680] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.390 [2024-11-28 11:51:48.376705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.390 [2024-11-28 11:51:48.376720] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.390 [2024-11-28 11:51:48.376732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.391 [2024-11-28 11:51:48.376760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.391 qpair failed and we were unable to recover it. 00:27:28.391 [2024-11-28 11:51:48.386637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.391 [2024-11-28 11:51:48.386738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.391 [2024-11-28 11:51:48.386763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.391 [2024-11-28 11:51:48.386777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.391 [2024-11-28 11:51:48.386790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.391 [2024-11-28 11:51:48.386817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.391 qpair failed and we were unable to recover it. 00:27:28.391 [2024-11-28 11:51:48.396577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.391 [2024-11-28 11:51:48.396688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.391 [2024-11-28 11:51:48.396713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.391 [2024-11-28 11:51:48.396728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.391 [2024-11-28 11:51:48.396741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.391 [2024-11-28 11:51:48.396774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.391 qpair failed and we were unable to recover it. 00:27:28.391 [2024-11-28 11:51:48.406631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.391 [2024-11-28 11:51:48.406738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.391 [2024-11-28 11:51:48.406763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.391 [2024-11-28 11:51:48.406777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.391 [2024-11-28 11:51:48.406790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.391 [2024-11-28 11:51:48.406818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.391 qpair failed and we were unable to recover it. 00:27:28.391 [2024-11-28 11:51:48.416663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.391 [2024-11-28 11:51:48.416769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.391 [2024-11-28 11:51:48.416795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.391 [2024-11-28 11:51:48.416809] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.391 [2024-11-28 11:51:48.416822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.391 [2024-11-28 11:51:48.416850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.391 qpair failed and we were unable to recover it. 00:27:28.391 [2024-11-28 11:51:48.426673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.391 [2024-11-28 11:51:48.426799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.391 [2024-11-28 11:51:48.426824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.391 [2024-11-28 11:51:48.426838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.391 [2024-11-28 11:51:48.426851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.391 [2024-11-28 11:51:48.426879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.391 qpair failed and we were unable to recover it. 00:27:28.391 [2024-11-28 11:51:48.436717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.391 [2024-11-28 11:51:48.436833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.391 [2024-11-28 11:51:48.436861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.391 [2024-11-28 11:51:48.436876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.391 [2024-11-28 11:51:48.436889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.391 [2024-11-28 11:51:48.436918] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.391 qpair failed and we were unable to recover it. 00:27:28.650 [2024-11-28 11:51:48.446748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.650 [2024-11-28 11:51:48.446867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.650 [2024-11-28 11:51:48.446900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.650 [2024-11-28 11:51:48.446916] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.650 [2024-11-28 11:51:48.446928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.650 [2024-11-28 11:51:48.446957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.650 qpair failed and we were unable to recover it. 00:27:28.650 [2024-11-28 11:51:48.456762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.650 [2024-11-28 11:51:48.456872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.650 [2024-11-28 11:51:48.456897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.650 [2024-11-28 11:51:48.456912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.650 [2024-11-28 11:51:48.456926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.650 [2024-11-28 11:51:48.456953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.650 qpair failed and we were unable to recover it. 00:27:28.650 [2024-11-28 11:51:48.466778] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.650 [2024-11-28 11:51:48.466887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.650 [2024-11-28 11:51:48.466912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.650 [2024-11-28 11:51:48.466927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.650 [2024-11-28 11:51:48.466939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.650 [2024-11-28 11:51:48.466968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.650 qpair failed and we were unable to recover it. 00:27:28.650 [2024-11-28 11:51:48.476848] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.650 [2024-11-28 11:51:48.476951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.650 [2024-11-28 11:51:48.476976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.650 [2024-11-28 11:51:48.476990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.650 [2024-11-28 11:51:48.477004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.650 [2024-11-28 11:51:48.477032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.650 qpair failed and we were unable to recover it. 00:27:28.650 [2024-11-28 11:51:48.486856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.650 [2024-11-28 11:51:48.486965] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.650 [2024-11-28 11:51:48.486990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.650 [2024-11-28 11:51:48.487004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.650 [2024-11-28 11:51:48.487016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.650 [2024-11-28 11:51:48.487051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.650 qpair failed and we were unable to recover it. 00:27:28.650 [2024-11-28 11:51:48.496885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.650 [2024-11-28 11:51:48.497020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.650 [2024-11-28 11:51:48.497045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.650 [2024-11-28 11:51:48.497060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.650 [2024-11-28 11:51:48.497072] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.650 [2024-11-28 11:51:48.497100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.650 qpair failed and we were unable to recover it. 00:27:28.650 [2024-11-28 11:51:48.506979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.650 [2024-11-28 11:51:48.507081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.650 [2024-11-28 11:51:48.507106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.650 [2024-11-28 11:51:48.507120] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.650 [2024-11-28 11:51:48.507133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.650 [2024-11-28 11:51:48.507161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.650 qpair failed and we were unable to recover it. 00:27:28.650 [2024-11-28 11:51:48.516973] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.650 [2024-11-28 11:51:48.517091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.650 [2024-11-28 11:51:48.517116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.650 [2024-11-28 11:51:48.517131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.650 [2024-11-28 11:51:48.517144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.650 [2024-11-28 11:51:48.517173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.650 qpair failed and we were unable to recover it. 00:27:28.650 [2024-11-28 11:51:48.527008] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.650 [2024-11-28 11:51:48.527117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.650 [2024-11-28 11:51:48.527142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.650 [2024-11-28 11:51:48.527156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.650 [2024-11-28 11:51:48.527169] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.650 [2024-11-28 11:51:48.527197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.650 qpair failed and we were unable to recover it. 00:27:28.650 [2024-11-28 11:51:48.537021] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.650 [2024-11-28 11:51:48.537141] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.650 [2024-11-28 11:51:48.537172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.650 [2024-11-28 11:51:48.537188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.650 [2024-11-28 11:51:48.537201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.650 [2024-11-28 11:51:48.537230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.650 qpair failed and we were unable to recover it. 00:27:28.650 [2024-11-28 11:51:48.547151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.650 [2024-11-28 11:51:48.547259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.650 [2024-11-28 11:51:48.547285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.650 [2024-11-28 11:51:48.547299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.650 [2024-11-28 11:51:48.547312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.650 [2024-11-28 11:51:48.547339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.650 qpair failed and we were unable to recover it. 00:27:28.650 [2024-11-28 11:51:48.557168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.650 [2024-11-28 11:51:48.557271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.557296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.557310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.557323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.557351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.651 [2024-11-28 11:51:48.567095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.651 [2024-11-28 11:51:48.567206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.567231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.567246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.567259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.567286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.651 [2024-11-28 11:51:48.577146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.651 [2024-11-28 11:51:48.577257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.577282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.577297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.577310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.577343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.651 [2024-11-28 11:51:48.587169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.651 [2024-11-28 11:51:48.587276] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.587301] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.587315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.587328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.587356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.651 [2024-11-28 11:51:48.597230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.651 [2024-11-28 11:51:48.597338] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.597364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.597378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.597391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.597419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.651 [2024-11-28 11:51:48.607221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.651 [2024-11-28 11:51:48.607351] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.607377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.607391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.607403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.607431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.651 [2024-11-28 11:51:48.617253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.651 [2024-11-28 11:51:48.617359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.617384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.617399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.617412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.617440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.651 [2024-11-28 11:51:48.627257] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.651 [2024-11-28 11:51:48.627382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.627414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.627434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.627449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.627478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.651 [2024-11-28 11:51:48.637342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.651 [2024-11-28 11:51:48.637447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.637472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.637487] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.637499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.637535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.651 [2024-11-28 11:51:48.647342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.651 [2024-11-28 11:51:48.647465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.647492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.647507] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.647522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.647565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.651 [2024-11-28 11:51:48.657372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.651 [2024-11-28 11:51:48.657493] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.657531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.657548] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.657562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.657590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.651 [2024-11-28 11:51:48.667404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.651 [2024-11-28 11:51:48.667505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.667548] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.667563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.667581] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.667610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.651 [2024-11-28 11:51:48.677385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.651 [2024-11-28 11:51:48.677492] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.677538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.677555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.677568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.677596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.651 [2024-11-28 11:51:48.687452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.651 [2024-11-28 11:51:48.687573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.687598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.687613] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.687626] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.687654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.651 [2024-11-28 11:51:48.697454] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.651 [2024-11-28 11:51:48.697576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.651 [2024-11-28 11:51:48.697602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.651 [2024-11-28 11:51:48.697616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.651 [2024-11-28 11:51:48.697630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.651 [2024-11-28 11:51:48.697657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.651 qpair failed and we were unable to recover it. 00:27:28.910 [2024-11-28 11:51:48.707551] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.910 [2024-11-28 11:51:48.707659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.910 [2024-11-28 11:51:48.707684] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.910 [2024-11-28 11:51:48.707699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.910 [2024-11-28 11:51:48.707711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.910 [2024-11-28 11:51:48.707740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.910 qpair failed and we were unable to recover it. 00:27:28.910 [2024-11-28 11:51:48.717564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.910 [2024-11-28 11:51:48.717677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.910 [2024-11-28 11:51:48.717703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.910 [2024-11-28 11:51:48.717717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.910 [2024-11-28 11:51:48.717729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.910 [2024-11-28 11:51:48.717756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.910 qpair failed and we were unable to recover it. 00:27:28.910 [2024-11-28 11:51:48.727575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.910 [2024-11-28 11:51:48.727682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.910 [2024-11-28 11:51:48.727707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.910 [2024-11-28 11:51:48.727722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.910 [2024-11-28 11:51:48.727734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.910 [2024-11-28 11:51:48.727762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.910 qpair failed and we were unable to recover it. 00:27:28.910 [2024-11-28 11:51:48.737604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.910 [2024-11-28 11:51:48.737709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.910 [2024-11-28 11:51:48.737733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.910 [2024-11-28 11:51:48.737748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.910 [2024-11-28 11:51:48.737761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.910 [2024-11-28 11:51:48.737788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.910 qpair failed and we were unable to recover it. 00:27:28.910 [2024-11-28 11:51:48.747631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.910 [2024-11-28 11:51:48.747738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.910 [2024-11-28 11:51:48.747763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.910 [2024-11-28 11:51:48.747777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.910 [2024-11-28 11:51:48.747790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.910 [2024-11-28 11:51:48.747818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.910 qpair failed and we were unable to recover it. 00:27:28.910 [2024-11-28 11:51:48.757666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.910 [2024-11-28 11:51:48.757770] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.910 [2024-11-28 11:51:48.757795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.910 [2024-11-28 11:51:48.757810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.910 [2024-11-28 11:51:48.757828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.910 [2024-11-28 11:51:48.757857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.910 qpair failed and we were unable to recover it. 00:27:28.910 [2024-11-28 11:51:48.767759] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.910 [2024-11-28 11:51:48.767868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.910 [2024-11-28 11:51:48.767892] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.910 [2024-11-28 11:51:48.767907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.910 [2024-11-28 11:51:48.767919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.910 [2024-11-28 11:51:48.767947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.910 qpair failed and we were unable to recover it. 00:27:28.910 [2024-11-28 11:51:48.777699] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.910 [2024-11-28 11:51:48.777806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.910 [2024-11-28 11:51:48.777831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.910 [2024-11-28 11:51:48.777845] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.910 [2024-11-28 11:51:48.777857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.910 [2024-11-28 11:51:48.777886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.910 qpair failed and we were unable to recover it. 00:27:28.911 [2024-11-28 11:51:48.787740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.911 [2024-11-28 11:51:48.787870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.911 [2024-11-28 11:51:48.787895] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.911 [2024-11-28 11:51:48.787910] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.911 [2024-11-28 11:51:48.787922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.911 [2024-11-28 11:51:48.787952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.911 qpair failed and we were unable to recover it. 00:27:28.911 [2024-11-28 11:51:48.797797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.911 [2024-11-28 11:51:48.797918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.911 [2024-11-28 11:51:48.797943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.911 [2024-11-28 11:51:48.797957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.911 [2024-11-28 11:51:48.797971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.911 [2024-11-28 11:51:48.797998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.911 qpair failed and we were unable to recover it. 00:27:28.911 [2024-11-28 11:51:48.807786] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.911 [2024-11-28 11:51:48.807942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.911 [2024-11-28 11:51:48.807967] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.911 [2024-11-28 11:51:48.807981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.911 [2024-11-28 11:51:48.807993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.911 [2024-11-28 11:51:48.808021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.911 qpair failed and we were unable to recover it. 00:27:28.911 [2024-11-28 11:51:48.817820] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.911 [2024-11-28 11:51:48.817930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.911 [2024-11-28 11:51:48.817955] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.911 [2024-11-28 11:51:48.817970] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.911 [2024-11-28 11:51:48.817983] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.911 [2024-11-28 11:51:48.818013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.911 qpair failed and we were unable to recover it. 00:27:28.911 [2024-11-28 11:51:48.827872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.911 [2024-11-28 11:51:48.827986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.911 [2024-11-28 11:51:48.828010] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.911 [2024-11-28 11:51:48.828024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.911 [2024-11-28 11:51:48.828036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.911 [2024-11-28 11:51:48.828063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.911 qpair failed and we were unable to recover it. 00:27:28.911 [2024-11-28 11:51:48.837878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.911 [2024-11-28 11:51:48.837983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.911 [2024-11-28 11:51:48.838008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.911 [2024-11-28 11:51:48.838022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.911 [2024-11-28 11:51:48.838035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.911 [2024-11-28 11:51:48.838064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.911 qpair failed and we were unable to recover it. 00:27:28.911 [2024-11-28 11:51:48.847896] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.911 [2024-11-28 11:51:48.848006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.911 [2024-11-28 11:51:48.848031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.911 [2024-11-28 11:51:48.848045] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.911 [2024-11-28 11:51:48.848064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.911 [2024-11-28 11:51:48.848092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.911 qpair failed and we were unable to recover it. 00:27:28.911 [2024-11-28 11:51:48.857916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.911 [2024-11-28 11:51:48.858023] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.911 [2024-11-28 11:51:48.858048] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.911 [2024-11-28 11:51:48.858063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.911 [2024-11-28 11:51:48.858075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.911 [2024-11-28 11:51:48.858103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.911 qpair failed and we were unable to recover it. 00:27:28.911 [2024-11-28 11:51:48.867935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.911 [2024-11-28 11:51:48.868035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.911 [2024-11-28 11:51:48.868060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.911 [2024-11-28 11:51:48.868075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.911 [2024-11-28 11:51:48.868088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.911 [2024-11-28 11:51:48.868115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.911 qpair failed and we were unable to recover it. 00:27:28.911 [2024-11-28 11:51:48.877970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.911 [2024-11-28 11:51:48.878090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.911 [2024-11-28 11:51:48.878115] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.911 [2024-11-28 11:51:48.878129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.911 [2024-11-28 11:51:48.878142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.911 [2024-11-28 11:51:48.878170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.911 qpair failed and we were unable to recover it. 00:27:28.911 [2024-11-28 11:51:48.888040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.911 [2024-11-28 11:51:48.888166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.911 [2024-11-28 11:51:48.888190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.911 [2024-11-28 11:51:48.888204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.911 [2024-11-28 11:51:48.888217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.911 [2024-11-28 11:51:48.888247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.911 qpair failed and we were unable to recover it. 00:27:28.911 [2024-11-28 11:51:48.898076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.911 [2024-11-28 11:51:48.898191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.911 [2024-11-28 11:51:48.898217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.911 [2024-11-28 11:51:48.898231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.911 [2024-11-28 11:51:48.898244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.911 [2024-11-28 11:51:48.898271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.911 qpair failed and we were unable to recover it. 00:27:28.911 [2024-11-28 11:51:48.908053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.911 [2024-11-28 11:51:48.908199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.911 [2024-11-28 11:51:48.908224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.911 [2024-11-28 11:51:48.908238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.911 [2024-11-28 11:51:48.908251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.911 [2024-11-28 11:51:48.908279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.911 qpair failed and we were unable to recover it. 00:27:28.911 [2024-11-28 11:51:48.918074] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.911 [2024-11-28 11:51:48.918183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.911 [2024-11-28 11:51:48.918209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.912 [2024-11-28 11:51:48.918223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.912 [2024-11-28 11:51:48.918236] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.912 [2024-11-28 11:51:48.918264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.912 qpair failed and we were unable to recover it. 00:27:28.912 [2024-11-28 11:51:48.928211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.912 [2024-11-28 11:51:48.928323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.912 [2024-11-28 11:51:48.928348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.912 [2024-11-28 11:51:48.928362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.912 [2024-11-28 11:51:48.928375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.912 [2024-11-28 11:51:48.928403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.912 qpair failed and we were unable to recover it. 00:27:28.912 [2024-11-28 11:51:48.938160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.912 [2024-11-28 11:51:48.938278] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.912 [2024-11-28 11:51:48.938303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.912 [2024-11-28 11:51:48.938317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.912 [2024-11-28 11:51:48.938336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.912 [2024-11-28 11:51:48.938365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.912 qpair failed and we were unable to recover it. 00:27:28.912 [2024-11-28 11:51:48.948177] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.912 [2024-11-28 11:51:48.948279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.912 [2024-11-28 11:51:48.948305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.912 [2024-11-28 11:51:48.948319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.912 [2024-11-28 11:51:48.948332] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.912 [2024-11-28 11:51:48.948361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.912 qpair failed and we were unable to recover it. 00:27:28.912 [2024-11-28 11:51:48.958217] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.912 [2024-11-28 11:51:48.958323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.912 [2024-11-28 11:51:48.958348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.912 [2024-11-28 11:51:48.958362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.912 [2024-11-28 11:51:48.958375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:28.912 [2024-11-28 11:51:48.958403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.912 qpair failed and we were unable to recover it. 00:27:29.170 [2024-11-28 11:51:48.968258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.170 [2024-11-28 11:51:48.968374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.170 [2024-11-28 11:51:48.968398] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.170 [2024-11-28 11:51:48.968412] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.170 [2024-11-28 11:51:48.968425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:29.170 [2024-11-28 11:51:48.968453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-11-28 11:51:48.978274] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.170 [2024-11-28 11:51:48.978389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.171 [2024-11-28 11:51:48.978415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.171 [2024-11-28 11:51:48.978429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.171 [2024-11-28 11:51:48.978442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:29.171 [2024-11-28 11:51:48.978470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-11-28 11:51:48.988279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.171 [2024-11-28 11:51:48.988378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.171 [2024-11-28 11:51:48.988402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.171 [2024-11-28 11:51:48.988417] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.171 [2024-11-28 11:51:48.988429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:29.171 [2024-11-28 11:51:48.988457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-11-28 11:51:48.998341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.171 [2024-11-28 11:51:48.998441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.171 [2024-11-28 11:51:48.998467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.171 [2024-11-28 11:51:48.998480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.171 [2024-11-28 11:51:48.998493] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:29.171 [2024-11-28 11:51:48.998521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-11-28 11:51:49.008357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.171 [2024-11-28 11:51:49.008468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.171 [2024-11-28 11:51:49.008493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.171 [2024-11-28 11:51:49.008507] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.171 [2024-11-28 11:51:49.008520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:29.171 [2024-11-28 11:51:49.008558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-11-28 11:51:49.018403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.171 [2024-11-28 11:51:49.018537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.171 [2024-11-28 11:51:49.018563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.171 [2024-11-28 11:51:49.018577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.171 [2024-11-28 11:51:49.018590] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:29.171 [2024-11-28 11:51:49.018618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-11-28 11:51:49.028463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.171 [2024-11-28 11:51:49.028568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.171 [2024-11-28 11:51:49.028594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.171 [2024-11-28 11:51:49.028614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.171 [2024-11-28 11:51:49.028628] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:29.171 [2024-11-28 11:51:49.028658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-11-28 11:51:49.038439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.171 [2024-11-28 11:51:49.038548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.171 [2024-11-28 11:51:49.038573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.171 [2024-11-28 11:51:49.038587] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.171 [2024-11-28 11:51:49.038600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:29.171 [2024-11-28 11:51:49.038628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-11-28 11:51:49.048587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.171 [2024-11-28 11:51:49.048749] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.171 [2024-11-28 11:51:49.048775] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.171 [2024-11-28 11:51:49.048788] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.171 [2024-11-28 11:51:49.048800] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:29.171 [2024-11-28 11:51:49.048829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-11-28 11:51:49.058547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.171 [2024-11-28 11:51:49.058655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.171 [2024-11-28 11:51:49.058679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.171 [2024-11-28 11:51:49.058694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.171 [2024-11-28 11:51:49.058707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:29.171 [2024-11-28 11:51:49.058734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-11-28 11:51:49.068545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.171 [2024-11-28 11:51:49.068655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.171 [2024-11-28 11:51:49.068679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.171 [2024-11-28 11:51:49.068694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.171 [2024-11-28 11:51:49.068707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x183ecb0 00:27:29.171 [2024-11-28 11:51:49.068736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-11-28 11:51:49.078580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.171 [2024-11-28 11:51:49.078690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.171 [2024-11-28 11:51:49.078722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.171 [2024-11-28 11:51:49.078739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.171 [2024-11-28 11:51:49.078753] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.171 [2024-11-28 11:51:49.078783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-11-28 11:51:49.088635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.171 [2024-11-28 11:51:49.088752] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.171 [2024-11-28 11:51:49.088779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.171 [2024-11-28 11:51:49.088794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.171 [2024-11-28 11:51:49.088808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.171 [2024-11-28 11:51:49.088845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-11-28 11:51:49.098623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.171 [2024-11-28 11:51:49.098727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.171 [2024-11-28 11:51:49.098753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.171 [2024-11-28 11:51:49.098768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.171 [2024-11-28 11:51:49.098781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.171 [2024-11-28 11:51:49.098810] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-11-28 11:51:49.108738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.171 [2024-11-28 11:51:49.108843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.172 [2024-11-28 11:51:49.108870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.172 [2024-11-28 11:51:49.108885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.172 [2024-11-28 11:51:49.108899] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.172 [2024-11-28 11:51:49.108928] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-11-28 11:51:49.118677] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.172 [2024-11-28 11:51:49.118775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.172 [2024-11-28 11:51:49.118802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.172 [2024-11-28 11:51:49.118824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.172 [2024-11-28 11:51:49.118837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.172 [2024-11-28 11:51:49.118880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-11-28 11:51:49.128763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.172 [2024-11-28 11:51:49.128876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.172 [2024-11-28 11:51:49.128903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.172 [2024-11-28 11:51:49.128918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.172 [2024-11-28 11:51:49.128931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.172 [2024-11-28 11:51:49.128961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-11-28 11:51:49.138861] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.172 [2024-11-28 11:51:49.138996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.172 [2024-11-28 11:51:49.139024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.172 [2024-11-28 11:51:49.139039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.172 [2024-11-28 11:51:49.139052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.172 [2024-11-28 11:51:49.139083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-11-28 11:51:49.148790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.172 [2024-11-28 11:51:49.148907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.172 [2024-11-28 11:51:49.148934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.172 [2024-11-28 11:51:49.148949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.172 [2024-11-28 11:51:49.148961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.172 [2024-11-28 11:51:49.148991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-11-28 11:51:49.158791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.172 [2024-11-28 11:51:49.158896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.172 [2024-11-28 11:51:49.158923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.172 [2024-11-28 11:51:49.158938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.172 [2024-11-28 11:51:49.158951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.172 [2024-11-28 11:51:49.158979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-11-28 11:51:49.168879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.172 [2024-11-28 11:51:49.169008] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.172 [2024-11-28 11:51:49.169035] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.172 [2024-11-28 11:51:49.169050] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.172 [2024-11-28 11:51:49.169063] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.172 [2024-11-28 11:51:49.169093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-11-28 11:51:49.178869] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.172 [2024-11-28 11:51:49.178992] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.172 [2024-11-28 11:51:49.179020] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.172 [2024-11-28 11:51:49.179035] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.172 [2024-11-28 11:51:49.179048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.172 [2024-11-28 11:51:49.179077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-11-28 11:51:49.188897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.172 [2024-11-28 11:51:49.189001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.172 [2024-11-28 11:51:49.189028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.172 [2024-11-28 11:51:49.189043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.172 [2024-11-28 11:51:49.189056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.172 [2024-11-28 11:51:49.189085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-11-28 11:51:49.198908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.172 [2024-11-28 11:51:49.199009] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.172 [2024-11-28 11:51:49.199037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.172 [2024-11-28 11:51:49.199052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.172 [2024-11-28 11:51:49.199066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.172 [2024-11-28 11:51:49.199094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-11-28 11:51:49.208954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.172 [2024-11-28 11:51:49.209057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.172 [2024-11-28 11:51:49.209088] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.172 [2024-11-28 11:51:49.209104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.172 [2024-11-28 11:51:49.209117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.172 [2024-11-28 11:51:49.209146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-11-28 11:51:49.218967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.172 [2024-11-28 11:51:49.219117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.172 [2024-11-28 11:51:49.219143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.172 [2024-11-28 11:51:49.219157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.172 [2024-11-28 11:51:49.219170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.172 [2024-11-28 11:51:49.219199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.431 [2024-11-28 11:51:49.229145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.431 [2024-11-28 11:51:49.229248] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.431 [2024-11-28 11:51:49.229274] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.431 [2024-11-28 11:51:49.229288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.431 [2024-11-28 11:51:49.229301] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.431 [2024-11-28 11:51:49.229331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.431 qpair failed and we were unable to recover it. 00:27:29.431 [2024-11-28 11:51:49.239074] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.431 [2024-11-28 11:51:49.239183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.431 [2024-11-28 11:51:49.239209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.431 [2024-11-28 11:51:49.239224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.431 [2024-11-28 11:51:49.239237] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.431 [2024-11-28 11:51:49.239267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.431 qpair failed and we were unable to recover it. 00:27:29.431 [2024-11-28 11:51:49.249106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.431 [2024-11-28 11:51:49.249221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.431 [2024-11-28 11:51:49.249248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.431 [2024-11-28 11:51:49.249263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.431 [2024-11-28 11:51:49.249276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.431 [2024-11-28 11:51:49.249305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.431 qpair failed and we were unable to recover it. 00:27:29.431 [2024-11-28 11:51:49.259104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.431 [2024-11-28 11:51:49.259211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.431 [2024-11-28 11:51:49.259238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.431 [2024-11-28 11:51:49.259253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.431 [2024-11-28 11:51:49.259266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.431 [2024-11-28 11:51:49.259297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.431 qpair failed and we were unable to recover it. 00:27:29.431 [2024-11-28 11:51:49.269122] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.432 [2024-11-28 11:51:49.269229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.432 [2024-11-28 11:51:49.269255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.432 [2024-11-28 11:51:49.269270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.432 [2024-11-28 11:51:49.269283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.432 [2024-11-28 11:51:49.269312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.432 qpair failed and we were unable to recover it. 00:27:29.432 [2024-11-28 11:51:49.279145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.432 [2024-11-28 11:51:49.279252] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.432 [2024-11-28 11:51:49.279278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.432 [2024-11-28 11:51:49.279293] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.432 [2024-11-28 11:51:49.279306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.432 [2024-11-28 11:51:49.279336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.432 qpair failed and we were unable to recover it. 00:27:29.432 [2024-11-28 11:51:49.289218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.432 [2024-11-28 11:51:49.289352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.432 [2024-11-28 11:51:49.289378] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.432 [2024-11-28 11:51:49.289393] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.432 [2024-11-28 11:51:49.289405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.432 [2024-11-28 11:51:49.289434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.432 qpair failed and we were unable to recover it. 00:27:29.432 [2024-11-28 11:51:49.299221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.432 [2024-11-28 11:51:49.299322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.432 [2024-11-28 11:51:49.299353] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.432 [2024-11-28 11:51:49.299369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.432 [2024-11-28 11:51:49.299382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.432 [2024-11-28 11:51:49.299411] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.432 qpair failed and we were unable to recover it. 00:27:29.432 [2024-11-28 11:51:49.309252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.432 [2024-11-28 11:51:49.309362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.432 [2024-11-28 11:51:49.309387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.432 [2024-11-28 11:51:49.309402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.432 [2024-11-28 11:51:49.309415] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.432 [2024-11-28 11:51:49.309445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.432 qpair failed and we were unable to recover it. 00:27:29.432 [2024-11-28 11:51:49.319288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.432 [2024-11-28 11:51:49.319416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.432 [2024-11-28 11:51:49.319441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.432 [2024-11-28 11:51:49.319456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.432 [2024-11-28 11:51:49.319468] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.432 [2024-11-28 11:51:49.319497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.432 qpair failed and we were unable to recover it. 00:27:29.432 [2024-11-28 11:51:49.329312] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.432 [2024-11-28 11:51:49.329420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.432 [2024-11-28 11:51:49.329445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.432 [2024-11-28 11:51:49.329460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.432 [2024-11-28 11:51:49.329473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.432 [2024-11-28 11:51:49.329504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.432 qpair failed and we were unable to recover it. 00:27:29.432 [2024-11-28 11:51:49.339381] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.432 [2024-11-28 11:51:49.339500] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.432 [2024-11-28 11:51:49.339532] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.432 [2024-11-28 11:51:49.339549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.432 [2024-11-28 11:51:49.339562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.432 [2024-11-28 11:51:49.339598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.432 qpair failed and we were unable to recover it. 00:27:29.432 [2024-11-28 11:51:49.349400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.432 [2024-11-28 11:51:49.349518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.432 [2024-11-28 11:51:49.349551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.432 [2024-11-28 11:51:49.349566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.432 [2024-11-28 11:51:49.349579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.432 [2024-11-28 11:51:49.349608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.432 qpair failed and we were unable to recover it. 00:27:29.432 [2024-11-28 11:51:49.359472] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.432 [2024-11-28 11:51:49.359581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.432 [2024-11-28 11:51:49.359609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.432 [2024-11-28 11:51:49.359624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.432 [2024-11-28 11:51:49.359637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.432 [2024-11-28 11:51:49.359668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.432 qpair failed and we were unable to recover it. 00:27:29.432 [2024-11-28 11:51:49.369446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.432 [2024-11-28 11:51:49.369558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.432 [2024-11-28 11:51:49.369586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.432 [2024-11-28 11:51:49.369601] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.432 [2024-11-28 11:51:49.369613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.432 [2024-11-28 11:51:49.369643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.432 qpair failed and we were unable to recover it. 00:27:29.432 [2024-11-28 11:51:49.379496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.432 [2024-11-28 11:51:49.379614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.432 [2024-11-28 11:51:49.379641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.432 [2024-11-28 11:51:49.379656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.432 [2024-11-28 11:51:49.379668] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.432 [2024-11-28 11:51:49.379697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.432 qpair failed and we were unable to recover it. 00:27:29.432 [2024-11-28 11:51:49.389487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.432 [2024-11-28 11:51:49.389606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.432 [2024-11-28 11:51:49.389642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.432 [2024-11-28 11:51:49.389657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.432 [2024-11-28 11:51:49.389671] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.432 [2024-11-28 11:51:49.389699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.432 qpair failed and we were unable to recover it. 00:27:29.432 [2024-11-28 11:51:49.399543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.432 [2024-11-28 11:51:49.399670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.432 [2024-11-28 11:51:49.399697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.433 [2024-11-28 11:51:49.399711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.433 [2024-11-28 11:51:49.399723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.433 [2024-11-28 11:51:49.399753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.433 qpair failed and we were unable to recover it. 00:27:29.433 [2024-11-28 11:51:49.409593] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.433 [2024-11-28 11:51:49.409743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.433 [2024-11-28 11:51:49.409770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.433 [2024-11-28 11:51:49.409784] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.433 [2024-11-28 11:51:49.409797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.433 [2024-11-28 11:51:49.409826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.433 qpair failed and we were unable to recover it. 00:27:29.433 [2024-11-28 11:51:49.419657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.433 [2024-11-28 11:51:49.419759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.433 [2024-11-28 11:51:49.419786] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.433 [2024-11-28 11:51:49.419801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.433 [2024-11-28 11:51:49.419814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.433 [2024-11-28 11:51:49.419843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.433 qpair failed and we were unable to recover it. 00:27:29.433 [2024-11-28 11:51:49.429622] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.433 [2024-11-28 11:51:49.429727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.433 [2024-11-28 11:51:49.429754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.433 [2024-11-28 11:51:49.429769] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.433 [2024-11-28 11:51:49.429787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.433 [2024-11-28 11:51:49.429829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.433 qpair failed and we were unable to recover it. 00:27:29.433 [2024-11-28 11:51:49.439620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.433 [2024-11-28 11:51:49.439719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.433 [2024-11-28 11:51:49.439747] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.433 [2024-11-28 11:51:49.439762] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.433 [2024-11-28 11:51:49.439774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.433 [2024-11-28 11:51:49.439804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.433 qpair failed and we were unable to recover it. 00:27:29.433 [2024-11-28 11:51:49.449725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.433 [2024-11-28 11:51:49.449882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.433 [2024-11-28 11:51:49.449911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.433 [2024-11-28 11:51:49.449926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.433 [2024-11-28 11:51:49.449944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.433 [2024-11-28 11:51:49.449974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.433 qpair failed and we were unable to recover it. 00:27:29.433 [2024-11-28 11:51:49.459688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.433 [2024-11-28 11:51:49.459795] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.433 [2024-11-28 11:51:49.459822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.433 [2024-11-28 11:51:49.459837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.433 [2024-11-28 11:51:49.459850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.433 [2024-11-28 11:51:49.459880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.433 qpair failed and we were unable to recover it. 00:27:29.433 [2024-11-28 11:51:49.469722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.433 [2024-11-28 11:51:49.469837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.433 [2024-11-28 11:51:49.469863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.433 [2024-11-28 11:51:49.469878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.433 [2024-11-28 11:51:49.469890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.433 [2024-11-28 11:51:49.469920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.433 qpair failed and we were unable to recover it. 00:27:29.433 [2024-11-28 11:51:49.479828] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.433 [2024-11-28 11:51:49.479949] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.433 [2024-11-28 11:51:49.479976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.433 [2024-11-28 11:51:49.479990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.433 [2024-11-28 11:51:49.480004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.433 [2024-11-28 11:51:49.480033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.433 qpair failed and we were unable to recover it. 00:27:29.692 [2024-11-28 11:51:49.489765] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.692 [2024-11-28 11:51:49.489873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.692 [2024-11-28 11:51:49.489900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.692 [2024-11-28 11:51:49.489914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.692 [2024-11-28 11:51:49.489927] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.692 [2024-11-28 11:51:49.489957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.692 qpair failed and we were unable to recover it. 00:27:29.692 [2024-11-28 11:51:49.499810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.692 [2024-11-28 11:51:49.499928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.693 [2024-11-28 11:51:49.499955] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.693 [2024-11-28 11:51:49.499969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.693 [2024-11-28 11:51:49.499982] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.693 [2024-11-28 11:51:49.500011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.693 qpair failed and we were unable to recover it. 00:27:29.693 [2024-11-28 11:51:49.509894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.693 [2024-11-28 11:51:49.510006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.693 [2024-11-28 11:51:49.510033] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.693 [2024-11-28 11:51:49.510048] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.693 [2024-11-28 11:51:49.510061] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.693 [2024-11-28 11:51:49.510090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.693 qpair failed and we were unable to recover it. 00:27:29.693 [2024-11-28 11:51:49.519840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.693 [2024-11-28 11:51:49.519996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.693 [2024-11-28 11:51:49.520024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.693 [2024-11-28 11:51:49.520039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.693 [2024-11-28 11:51:49.520058] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.693 [2024-11-28 11:51:49.520089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.693 qpair failed and we were unable to recover it. 00:27:29.693 [2024-11-28 11:51:49.529882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.693 [2024-11-28 11:51:49.530001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.693 [2024-11-28 11:51:49.530027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.693 [2024-11-28 11:51:49.530041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.693 [2024-11-28 11:51:49.530054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.693 [2024-11-28 11:51:49.530084] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.693 qpair failed and we were unable to recover it. 00:27:29.693 [2024-11-28 11:51:49.539949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.693 [2024-11-28 11:51:49.540089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.693 [2024-11-28 11:51:49.540114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.693 [2024-11-28 11:51:49.540129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.693 [2024-11-28 11:51:49.540141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.693 [2024-11-28 11:51:49.540171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.693 qpair failed and we were unable to recover it. 00:27:29.693 [2024-11-28 11:51:49.549976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.693 [2024-11-28 11:51:49.550131] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.693 [2024-11-28 11:51:49.550158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.693 [2024-11-28 11:51:49.550174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.693 [2024-11-28 11:51:49.550191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.693 [2024-11-28 11:51:49.550221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.693 qpair failed and we were unable to recover it. 00:27:29.693 [2024-11-28 11:51:49.560012] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.693 [2024-11-28 11:51:49.560120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.693 [2024-11-28 11:51:49.560147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.693 [2024-11-28 11:51:49.560165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.693 [2024-11-28 11:51:49.560180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.693 [2024-11-28 11:51:49.560210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.693 qpair failed and we were unable to recover it. 00:27:29.693 [2024-11-28 11:51:49.569979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.693 [2024-11-28 11:51:49.570087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.693 [2024-11-28 11:51:49.570113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.693 [2024-11-28 11:51:49.570128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.693 [2024-11-28 11:51:49.570141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.693 [2024-11-28 11:51:49.570170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.693 qpair failed and we were unable to recover it. 00:27:29.693 [2024-11-28 11:51:49.579995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.693 [2024-11-28 11:51:49.580149] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.693 [2024-11-28 11:51:49.580175] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.693 [2024-11-28 11:51:49.580189] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.693 [2024-11-28 11:51:49.580202] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.693 [2024-11-28 11:51:49.580232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.693 qpair failed and we were unable to recover it. 00:27:29.693 [2024-11-28 11:51:49.590127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.693 [2024-11-28 11:51:49.590235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.693 [2024-11-28 11:51:49.590261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.693 [2024-11-28 11:51:49.590276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.693 [2024-11-28 11:51:49.590289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.693 [2024-11-28 11:51:49.590319] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.693 qpair failed and we were unable to recover it. 00:27:29.693 [2024-11-28 11:51:49.600080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.693 [2024-11-28 11:51:49.600176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.693 [2024-11-28 11:51:49.600202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.693 [2024-11-28 11:51:49.600216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.693 [2024-11-28 11:51:49.600230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.693 [2024-11-28 11:51:49.600271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.693 qpair failed and we were unable to recover it. 00:27:29.693 [2024-11-28 11:51:49.610154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.693 [2024-11-28 11:51:49.610311] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.693 [2024-11-28 11:51:49.610337] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.693 [2024-11-28 11:51:49.610358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.693 [2024-11-28 11:51:49.610372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.693 [2024-11-28 11:51:49.610402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.693 qpair failed and we were unable to recover it. 00:27:29.693 [2024-11-28 11:51:49.620112] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.693 [2024-11-28 11:51:49.620226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.693 [2024-11-28 11:51:49.620252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.693 [2024-11-28 11:51:49.620266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.693 [2024-11-28 11:51:49.620279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.693 [2024-11-28 11:51:49.620309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.693 qpair failed and we were unable to recover it. 00:27:29.693 [2024-11-28 11:51:49.630146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.693 [2024-11-28 11:51:49.630248] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.693 [2024-11-28 11:51:49.630274] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.693 [2024-11-28 11:51:49.630289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.694 [2024-11-28 11:51:49.630302] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.694 [2024-11-28 11:51:49.630332] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.694 qpair failed and we were unable to recover it. 00:27:29.694 [2024-11-28 11:51:49.640174] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.694 [2024-11-28 11:51:49.640275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.694 [2024-11-28 11:51:49.640301] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.694 [2024-11-28 11:51:49.640315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.694 [2024-11-28 11:51:49.640328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.694 [2024-11-28 11:51:49.640357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.694 qpair failed and we were unable to recover it. 00:27:29.694 [2024-11-28 11:51:49.650332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.694 [2024-11-28 11:51:49.650444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.694 [2024-11-28 11:51:49.650470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.694 [2024-11-28 11:51:49.650485] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.694 [2024-11-28 11:51:49.650499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.694 [2024-11-28 11:51:49.650538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.694 qpair failed and we were unable to recover it. 00:27:29.694 [2024-11-28 11:51:49.660239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.694 [2024-11-28 11:51:49.660348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.694 [2024-11-28 11:51:49.660374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.694 [2024-11-28 11:51:49.660388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.694 [2024-11-28 11:51:49.660401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.694 [2024-11-28 11:51:49.660431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.694 qpair failed and we were unable to recover it. 00:27:29.694 [2024-11-28 11:51:49.670286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.694 [2024-11-28 11:51:49.670390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.694 [2024-11-28 11:51:49.670416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.694 [2024-11-28 11:51:49.670431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.694 [2024-11-28 11:51:49.670443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.694 [2024-11-28 11:51:49.670471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.694 qpair failed and we were unable to recover it. 00:27:29.694 [2024-11-28 11:51:49.680283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.694 [2024-11-28 11:51:49.680387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.694 [2024-11-28 11:51:49.680413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.694 [2024-11-28 11:51:49.680427] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.694 [2024-11-28 11:51:49.680440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.694 [2024-11-28 11:51:49.680470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.694 qpair failed and we were unable to recover it. 00:27:29.694 [2024-11-28 11:51:49.690358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.694 [2024-11-28 11:51:49.690518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.694 [2024-11-28 11:51:49.690555] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.694 [2024-11-28 11:51:49.690570] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.694 [2024-11-28 11:51:49.690583] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.694 [2024-11-28 11:51:49.690613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.694 qpair failed and we were unable to recover it. 00:27:29.694 [2024-11-28 11:51:49.700395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.694 [2024-11-28 11:51:49.700506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.694 [2024-11-28 11:51:49.700539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.694 [2024-11-28 11:51:49.700561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.694 [2024-11-28 11:51:49.700575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.694 [2024-11-28 11:51:49.700605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.694 qpair failed and we were unable to recover it. 00:27:29.694 [2024-11-28 11:51:49.710387] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.694 [2024-11-28 11:51:49.710495] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.694 [2024-11-28 11:51:49.710520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.694 [2024-11-28 11:51:49.710544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.694 [2024-11-28 11:51:49.710558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.694 [2024-11-28 11:51:49.710587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.694 qpair failed and we were unable to recover it. 00:27:29.694 [2024-11-28 11:51:49.720416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.694 [2024-11-28 11:51:49.720522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.694 [2024-11-28 11:51:49.720556] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.694 [2024-11-28 11:51:49.720571] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.694 [2024-11-28 11:51:49.720583] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.694 [2024-11-28 11:51:49.720613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.694 qpair failed and we were unable to recover it. 00:27:29.694 [2024-11-28 11:51:49.730441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.694 [2024-11-28 11:51:49.730556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.694 [2024-11-28 11:51:49.730582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.694 [2024-11-28 11:51:49.730596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.694 [2024-11-28 11:51:49.730608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.694 [2024-11-28 11:51:49.730638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.694 qpair failed and we were unable to recover it. 00:27:29.694 [2024-11-28 11:51:49.740502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.694 [2024-11-28 11:51:49.740626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.694 [2024-11-28 11:51:49.740653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.694 [2024-11-28 11:51:49.740667] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.694 [2024-11-28 11:51:49.740680] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.694 [2024-11-28 11:51:49.740708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.694 qpair failed and we were unable to recover it. 00:27:29.953 [2024-11-28 11:51:49.750593] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.953 [2024-11-28 11:51:49.750699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.954 [2024-11-28 11:51:49.750725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.954 [2024-11-28 11:51:49.750739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.954 [2024-11-28 11:51:49.750752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.954 [2024-11-28 11:51:49.750783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.954 qpair failed and we were unable to recover it. 00:27:29.954 [2024-11-28 11:51:49.760550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.954 [2024-11-28 11:51:49.760678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.954 [2024-11-28 11:51:49.760703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.954 [2024-11-28 11:51:49.760718] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.954 [2024-11-28 11:51:49.760731] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.954 [2024-11-28 11:51:49.760761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.954 qpair failed and we were unable to recover it. 00:27:29.954 [2024-11-28 11:51:49.770600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.954 [2024-11-28 11:51:49.770741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.954 [2024-11-28 11:51:49.770767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.954 [2024-11-28 11:51:49.770790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.954 [2024-11-28 11:51:49.770803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.954 [2024-11-28 11:51:49.770833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.954 qpair failed and we were unable to recover it. 00:27:29.954 [2024-11-28 11:51:49.780632] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.954 [2024-11-28 11:51:49.780777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.954 [2024-11-28 11:51:49.780803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.954 [2024-11-28 11:51:49.780818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.954 [2024-11-28 11:51:49.780830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.954 [2024-11-28 11:51:49.780861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.954 qpair failed and we were unable to recover it. 00:27:29.954 [2024-11-28 11:51:49.790649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.954 [2024-11-28 11:51:49.790752] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.954 [2024-11-28 11:51:49.790783] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.954 [2024-11-28 11:51:49.790798] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.954 [2024-11-28 11:51:49.790811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.954 [2024-11-28 11:51:49.790841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.954 qpair failed and we were unable to recover it. 00:27:29.954 [2024-11-28 11:51:49.800668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.954 [2024-11-28 11:51:49.800765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.954 [2024-11-28 11:51:49.800803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.954 [2024-11-28 11:51:49.800817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.954 [2024-11-28 11:51:49.800830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.954 [2024-11-28 11:51:49.800859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.954 qpair failed and we were unable to recover it. 00:27:29.954 [2024-11-28 11:51:49.810696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.954 [2024-11-28 11:51:49.810803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.954 [2024-11-28 11:51:49.810829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.954 [2024-11-28 11:51:49.810843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.954 [2024-11-28 11:51:49.810856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.954 [2024-11-28 11:51:49.810887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.954 qpair failed and we were unable to recover it. 00:27:29.954 [2024-11-28 11:51:49.820823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.954 [2024-11-28 11:51:49.820932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.954 [2024-11-28 11:51:49.820957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.954 [2024-11-28 11:51:49.820972] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.954 [2024-11-28 11:51:49.820984] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.954 [2024-11-28 11:51:49.821015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.954 qpair failed and we were unable to recover it. 00:27:29.954 [2024-11-28 11:51:49.830747] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.954 [2024-11-28 11:51:49.830863] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.954 [2024-11-28 11:51:49.830887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.954 [2024-11-28 11:51:49.830901] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.954 [2024-11-28 11:51:49.830913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.954 [2024-11-28 11:51:49.830947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.954 qpair failed and we were unable to recover it. 00:27:29.954 [2024-11-28 11:51:49.840791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.954 [2024-11-28 11:51:49.840905] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.954 [2024-11-28 11:51:49.840931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.954 [2024-11-28 11:51:49.840946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.954 [2024-11-28 11:51:49.840958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.954 [2024-11-28 11:51:49.840989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.954 qpair failed and we were unable to recover it. 00:27:29.954 [2024-11-28 11:51:49.850838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.954 [2024-11-28 11:51:49.850953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.954 [2024-11-28 11:51:49.850979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.954 [2024-11-28 11:51:49.850994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.954 [2024-11-28 11:51:49.851007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.954 [2024-11-28 11:51:49.851035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.954 qpair failed and we were unable to recover it. 00:27:29.954 [2024-11-28 11:51:49.860923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.954 [2024-11-28 11:51:49.861034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.954 [2024-11-28 11:51:49.861061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.954 [2024-11-28 11:51:49.861076] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.954 [2024-11-28 11:51:49.861092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.954 [2024-11-28 11:51:49.861122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.954 qpair failed and we were unable to recover it. 00:27:29.954 [2024-11-28 11:51:49.870891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.954 [2024-11-28 11:51:49.870991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.954 [2024-11-28 11:51:49.871017] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.954 [2024-11-28 11:51:49.871032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.954 [2024-11-28 11:51:49.871045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.954 [2024-11-28 11:51:49.871087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.954 qpair failed and we were unable to recover it. 00:27:29.954 [2024-11-28 11:51:49.880924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.954 [2024-11-28 11:51:49.881034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.954 [2024-11-28 11:51:49.881065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.955 [2024-11-28 11:51:49.881081] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.955 [2024-11-28 11:51:49.881093] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.955 [2024-11-28 11:51:49.881122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.955 qpair failed and we were unable to recover it. 00:27:29.955 [2024-11-28 11:51:49.890979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.955 [2024-11-28 11:51:49.891092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.955 [2024-11-28 11:51:49.891118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.955 [2024-11-28 11:51:49.891133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.955 [2024-11-28 11:51:49.891145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.955 [2024-11-28 11:51:49.891175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.955 qpair failed and we were unable to recover it. 00:27:29.955 [2024-11-28 11:51:49.901020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.955 [2024-11-28 11:51:49.901143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.955 [2024-11-28 11:51:49.901169] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.955 [2024-11-28 11:51:49.901184] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.955 [2024-11-28 11:51:49.901197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.955 [2024-11-28 11:51:49.901227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.955 qpair failed and we were unable to recover it. 00:27:29.955 [2024-11-28 11:51:49.911032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.955 [2024-11-28 11:51:49.911189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.955 [2024-11-28 11:51:49.911214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.955 [2024-11-28 11:51:49.911228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.955 [2024-11-28 11:51:49.911241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.955 [2024-11-28 11:51:49.911270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.955 qpair failed and we were unable to recover it. 00:27:29.955 [2024-11-28 11:51:49.920998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.955 [2024-11-28 11:51:49.921102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.955 [2024-11-28 11:51:49.921128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.955 [2024-11-28 11:51:49.921143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.955 [2024-11-28 11:51:49.921156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.955 [2024-11-28 11:51:49.921191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.955 qpair failed and we were unable to recover it. 00:27:29.955 [2024-11-28 11:51:49.931069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.955 [2024-11-28 11:51:49.931188] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.955 [2024-11-28 11:51:49.931213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.955 [2024-11-28 11:51:49.931228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.955 [2024-11-28 11:51:49.931241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.955 [2024-11-28 11:51:49.931270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.955 qpair failed and we were unable to recover it. 00:27:29.955 [2024-11-28 11:51:49.941096] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.955 [2024-11-28 11:51:49.941209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.955 [2024-11-28 11:51:49.941234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.955 [2024-11-28 11:51:49.941249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.955 [2024-11-28 11:51:49.941261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.955 [2024-11-28 11:51:49.941292] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.955 qpair failed and we were unable to recover it. 00:27:29.955 [2024-11-28 11:51:49.951081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.955 [2024-11-28 11:51:49.951185] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.955 [2024-11-28 11:51:49.951211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.955 [2024-11-28 11:51:49.951226] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.955 [2024-11-28 11:51:49.951239] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.955 [2024-11-28 11:51:49.951269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.955 qpair failed and we were unable to recover it. 00:27:29.955 [2024-11-28 11:51:49.961142] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.955 [2024-11-28 11:51:49.961250] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.955 [2024-11-28 11:51:49.961276] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.955 [2024-11-28 11:51:49.961290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.955 [2024-11-28 11:51:49.961304] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.955 [2024-11-28 11:51:49.961333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.955 qpair failed and we were unable to recover it. 00:27:29.955 [2024-11-28 11:51:49.971183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.955 [2024-11-28 11:51:49.971300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.955 [2024-11-28 11:51:49.971325] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.955 [2024-11-28 11:51:49.971340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.955 [2024-11-28 11:51:49.971353] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.955 [2024-11-28 11:51:49.971382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.955 qpair failed and we were unable to recover it. 00:27:29.955 [2024-11-28 11:51:49.981244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.955 [2024-11-28 11:51:49.981357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.955 [2024-11-28 11:51:49.981383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.955 [2024-11-28 11:51:49.981398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.955 [2024-11-28 11:51:49.981410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.955 [2024-11-28 11:51:49.981439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.955 qpair failed and we were unable to recover it. 00:27:29.955 [2024-11-28 11:51:49.991223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.955 [2024-11-28 11:51:49.991322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.955 [2024-11-28 11:51:49.991348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.955 [2024-11-28 11:51:49.991363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.955 [2024-11-28 11:51:49.991391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.955 [2024-11-28 11:51:49.991421] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.955 qpair failed and we were unable to recover it. 00:27:29.955 [2024-11-28 11:51:50.001247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.955 [2024-11-28 11:51:50.001391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.955 [2024-11-28 11:51:50.001418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.955 [2024-11-28 11:51:50.001432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.955 [2024-11-28 11:51:50.001444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:29.955 [2024-11-28 11:51:50.001472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.955 qpair failed and we were unable to recover it. 00:27:30.215 [2024-11-28 11:51:50.011304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.215 [2024-11-28 11:51:50.011417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.215 [2024-11-28 11:51:50.011443] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.215 [2024-11-28 11:51:50.011459] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.215 [2024-11-28 11:51:50.011477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.215 [2024-11-28 11:51:50.011511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.215 qpair failed and we were unable to recover it. 00:27:30.215 [2024-11-28 11:51:50.021319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.215 [2024-11-28 11:51:50.021427] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.215 [2024-11-28 11:51:50.021453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.215 [2024-11-28 11:51:50.021468] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.215 [2024-11-28 11:51:50.021481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.215 [2024-11-28 11:51:50.021509] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.215 qpair failed and we were unable to recover it. 00:27:30.215 [2024-11-28 11:51:50.031463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.215 [2024-11-28 11:51:50.031591] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.215 [2024-11-28 11:51:50.031619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.215 [2024-11-28 11:51:50.031635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.215 [2024-11-28 11:51:50.031648] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.215 [2024-11-28 11:51:50.031695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.215 qpair failed and we were unable to recover it. 00:27:30.215 [2024-11-28 11:51:50.041404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.215 [2024-11-28 11:51:50.041512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.215 [2024-11-28 11:51:50.041549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.215 [2024-11-28 11:51:50.041565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.215 [2024-11-28 11:51:50.041579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.215 [2024-11-28 11:51:50.041611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.215 qpair failed and we were unable to recover it. 00:27:30.215 [2024-11-28 11:51:50.051448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.215 [2024-11-28 11:51:50.051576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.215 [2024-11-28 11:51:50.051603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.215 [2024-11-28 11:51:50.051618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.215 [2024-11-28 11:51:50.051631] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.215 [2024-11-28 11:51:50.051662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.215 qpair failed and we were unable to recover it. 00:27:30.215 [2024-11-28 11:51:50.061451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.215 [2024-11-28 11:51:50.061565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.215 [2024-11-28 11:51:50.061592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.215 [2024-11-28 11:51:50.061607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.215 [2024-11-28 11:51:50.061620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.215 [2024-11-28 11:51:50.061652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.215 qpair failed and we were unable to recover it. 00:27:30.215 [2024-11-28 11:51:50.071620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.215 [2024-11-28 11:51:50.071788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.215 [2024-11-28 11:51:50.071814] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.215 [2024-11-28 11:51:50.071829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.215 [2024-11-28 11:51:50.071842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.215 [2024-11-28 11:51:50.071872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.215 qpair failed and we were unable to recover it. 00:27:30.215 [2024-11-28 11:51:50.081505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.215 [2024-11-28 11:51:50.081631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.215 [2024-11-28 11:51:50.081659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.215 [2024-11-28 11:51:50.081675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.215 [2024-11-28 11:51:50.081689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.215 [2024-11-28 11:51:50.081718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.215 qpair failed and we were unable to recover it. 00:27:30.215 [2024-11-28 11:51:50.091537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.215 [2024-11-28 11:51:50.091654] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.215 [2024-11-28 11:51:50.091680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.215 [2024-11-28 11:51:50.091695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.215 [2024-11-28 11:51:50.091707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.215 [2024-11-28 11:51:50.091738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.215 qpair failed and we were unable to recover it. 00:27:30.216 [2024-11-28 11:51:50.101637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.216 [2024-11-28 11:51:50.101746] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.216 [2024-11-28 11:51:50.101772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.216 [2024-11-28 11:51:50.101793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.216 [2024-11-28 11:51:50.101807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.216 [2024-11-28 11:51:50.101836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.216 qpair failed and we were unable to recover it. 00:27:30.216 [2024-11-28 11:51:50.111649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.216 [2024-11-28 11:51:50.111757] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.216 [2024-11-28 11:51:50.111784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.216 [2024-11-28 11:51:50.111799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.216 [2024-11-28 11:51:50.111811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.216 [2024-11-28 11:51:50.111840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.216 qpair failed and we were unable to recover it. 00:27:30.216 [2024-11-28 11:51:50.121640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.216 [2024-11-28 11:51:50.121764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.216 [2024-11-28 11:51:50.121790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.216 [2024-11-28 11:51:50.121804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.216 [2024-11-28 11:51:50.121817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.216 [2024-11-28 11:51:50.121846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.216 qpair failed and we were unable to recover it. 00:27:30.216 [2024-11-28 11:51:50.131671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.216 [2024-11-28 11:51:50.131802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.216 [2024-11-28 11:51:50.131830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.216 [2024-11-28 11:51:50.131845] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.216 [2024-11-28 11:51:50.131861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.216 [2024-11-28 11:51:50.131894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.216 qpair failed and we were unable to recover it. 00:27:30.216 [2024-11-28 11:51:50.141716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.216 [2024-11-28 11:51:50.141829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.216 [2024-11-28 11:51:50.141856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.216 [2024-11-28 11:51:50.141871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.216 [2024-11-28 11:51:50.141884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.216 [2024-11-28 11:51:50.141912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.216 qpair failed and we were unable to recover it. 00:27:30.216 [2024-11-28 11:51:50.151726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.216 [2024-11-28 11:51:50.151836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.216 [2024-11-28 11:51:50.151863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.216 [2024-11-28 11:51:50.151877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.216 [2024-11-28 11:51:50.151891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.216 [2024-11-28 11:51:50.151919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.216 qpair failed and we were unable to recover it. 00:27:30.216 [2024-11-28 11:51:50.161745] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.216 [2024-11-28 11:51:50.161853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.216 [2024-11-28 11:51:50.161879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.216 [2024-11-28 11:51:50.161894] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.216 [2024-11-28 11:51:50.161906] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.216 [2024-11-28 11:51:50.161949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.216 qpair failed and we were unable to recover it. 00:27:30.216 [2024-11-28 11:51:50.171794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.216 [2024-11-28 11:51:50.171919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.216 [2024-11-28 11:51:50.171945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.216 [2024-11-28 11:51:50.171959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.216 [2024-11-28 11:51:50.171972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.216 [2024-11-28 11:51:50.172002] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.216 qpair failed and we were unable to recover it. 00:27:30.216 [2024-11-28 11:51:50.181788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.216 [2024-11-28 11:51:50.181892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.216 [2024-11-28 11:51:50.181918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.216 [2024-11-28 11:51:50.181933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.216 [2024-11-28 11:51:50.181946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.216 [2024-11-28 11:51:50.181976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.216 qpair failed and we were unable to recover it. 00:27:30.216 [2024-11-28 11:51:50.191896] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.216 [2024-11-28 11:51:50.192006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.216 [2024-11-28 11:51:50.192031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.216 [2024-11-28 11:51:50.192055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.216 [2024-11-28 11:51:50.192070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.216 [2024-11-28 11:51:50.192101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.216 qpair failed and we were unable to recover it. 00:27:30.216 [2024-11-28 11:51:50.201866] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.216 [2024-11-28 11:51:50.201985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.216 [2024-11-28 11:51:50.202011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.216 [2024-11-28 11:51:50.202026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.216 [2024-11-28 11:51:50.202039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.216 [2024-11-28 11:51:50.202068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.216 qpair failed and we were unable to recover it. 00:27:30.216 [2024-11-28 11:51:50.211897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.216 [2024-11-28 11:51:50.212057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.216 [2024-11-28 11:51:50.212083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.216 [2024-11-28 11:51:50.212098] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.216 [2024-11-28 11:51:50.212111] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.216 [2024-11-28 11:51:50.212142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.216 qpair failed and we were unable to recover it. 00:27:30.216 [2024-11-28 11:51:50.221896] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.216 [2024-11-28 11:51:50.222006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.216 [2024-11-28 11:51:50.222032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.216 [2024-11-28 11:51:50.222047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.216 [2024-11-28 11:51:50.222060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.216 [2024-11-28 11:51:50.222089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.216 qpair failed and we were unable to recover it. 00:27:30.216 [2024-11-28 11:51:50.231980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.216 [2024-11-28 11:51:50.232128] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.216 [2024-11-28 11:51:50.232154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.217 [2024-11-28 11:51:50.232169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.217 [2024-11-28 11:51:50.232182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.217 [2024-11-28 11:51:50.232211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.217 qpair failed and we were unable to recover it. 00:27:30.217 [2024-11-28 11:51:50.242007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.217 [2024-11-28 11:51:50.242116] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.217 [2024-11-28 11:51:50.242141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.217 [2024-11-28 11:51:50.242156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.217 [2024-11-28 11:51:50.242169] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.217 [2024-11-28 11:51:50.242198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.217 qpair failed and we were unable to recover it. 00:27:30.217 [2024-11-28 11:51:50.252091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.217 [2024-11-28 11:51:50.252195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.217 [2024-11-28 11:51:50.252222] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.217 [2024-11-28 11:51:50.252237] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.217 [2024-11-28 11:51:50.252250] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa28000b90 00:27:30.217 [2024-11-28 11:51:50.252279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:30.217 qpair failed and we were unable to recover it. 00:27:30.217 [2024-11-28 11:51:50.262074] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.217 [2024-11-28 11:51:50.262183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.217 [2024-11-28 11:51:50.262216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.217 [2024-11-28 11:51:50.262231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.217 [2024-11-28 11:51:50.262245] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.217 [2024-11-28 11:51:50.262275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.217 qpair failed and we were unable to recover it. 00:27:30.476 [2024-11-28 11:51:50.272075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.476 [2024-11-28 11:51:50.272191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.476 [2024-11-28 11:51:50.272218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.476 [2024-11-28 11:51:50.272233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.476 [2024-11-28 11:51:50.272247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.476 [2024-11-28 11:51:50.272277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.476 qpair failed and we were unable to recover it. 00:27:30.476 [2024-11-28 11:51:50.282093] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.476 [2024-11-28 11:51:50.282200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.476 [2024-11-28 11:51:50.282232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.476 [2024-11-28 11:51:50.282248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.476 [2024-11-28 11:51:50.282261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.476 [2024-11-28 11:51:50.282291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.476 qpair failed and we were unable to recover it. 00:27:30.476 [2024-11-28 11:51:50.292206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.476 [2024-11-28 11:51:50.292313] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.476 [2024-11-28 11:51:50.292341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.476 [2024-11-28 11:51:50.292356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.476 [2024-11-28 11:51:50.292369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.476 [2024-11-28 11:51:50.292399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.476 qpair failed and we were unable to recover it. 00:27:30.476 [2024-11-28 11:51:50.302169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.476 [2024-11-28 11:51:50.302290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.476 [2024-11-28 11:51:50.302316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.476 [2024-11-28 11:51:50.302331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.476 [2024-11-28 11:51:50.302344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.476 [2024-11-28 11:51:50.302373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.476 qpair failed and we were unable to recover it. 00:27:30.476 [2024-11-28 11:51:50.312261] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.476 [2024-11-28 11:51:50.312360] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.476 [2024-11-28 11:51:50.312387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.476 [2024-11-28 11:51:50.312401] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.476 [2024-11-28 11:51:50.312414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.476 [2024-11-28 11:51:50.312444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.476 qpair failed and we were unable to recover it. 00:27:30.476 [2024-11-28 11:51:50.322218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.476 [2024-11-28 11:51:50.322322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.476 [2024-11-28 11:51:50.322347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.476 [2024-11-28 11:51:50.322361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.476 [2024-11-28 11:51:50.322374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.476 [2024-11-28 11:51:50.322410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.476 qpair failed and we were unable to recover it. 00:27:30.476 [2024-11-28 11:51:50.332262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.476 [2024-11-28 11:51:50.332386] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.477 [2024-11-28 11:51:50.332412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.477 [2024-11-28 11:51:50.332426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.477 [2024-11-28 11:51:50.332439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.477 [2024-11-28 11:51:50.332468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.477 qpair failed and we were unable to recover it. 00:27:30.477 [2024-11-28 11:51:50.342260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.477 [2024-11-28 11:51:50.342366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.477 [2024-11-28 11:51:50.342392] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.477 [2024-11-28 11:51:50.342407] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.477 [2024-11-28 11:51:50.342420] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.477 [2024-11-28 11:51:50.342451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.477 qpair failed and we were unable to recover it. 00:27:30.477 [2024-11-28 11:51:50.352291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.477 [2024-11-28 11:51:50.352399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.477 [2024-11-28 11:51:50.352428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.477 [2024-11-28 11:51:50.352443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.477 [2024-11-28 11:51:50.352457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.477 [2024-11-28 11:51:50.352488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.477 qpair failed and we were unable to recover it. 00:27:30.477 [2024-11-28 11:51:50.362340] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.477 [2024-11-28 11:51:50.362446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.477 [2024-11-28 11:51:50.362472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.477 [2024-11-28 11:51:50.362486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.477 [2024-11-28 11:51:50.362499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.477 [2024-11-28 11:51:50.362536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.477 qpair failed and we were unable to recover it. 00:27:30.477 [2024-11-28 11:51:50.372354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.477 [2024-11-28 11:51:50.372462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.477 [2024-11-28 11:51:50.372493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.477 [2024-11-28 11:51:50.372509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.477 [2024-11-28 11:51:50.372522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.477 [2024-11-28 11:51:50.372562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.477 qpair failed and we were unable to recover it. 00:27:30.477 [2024-11-28 11:51:50.382418] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.477 [2024-11-28 11:51:50.382537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.477 [2024-11-28 11:51:50.382564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.477 [2024-11-28 11:51:50.382579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.477 [2024-11-28 11:51:50.382592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.477 [2024-11-28 11:51:50.382634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.477 qpair failed and we were unable to recover it. 00:27:30.477 [2024-11-28 11:51:50.392400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.477 [2024-11-28 11:51:50.392554] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.477 [2024-11-28 11:51:50.392581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.477 [2024-11-28 11:51:50.392595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.477 [2024-11-28 11:51:50.392608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.477 [2024-11-28 11:51:50.392638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.477 qpair failed and we were unable to recover it. 00:27:30.477 [2024-11-28 11:51:50.402503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.477 [2024-11-28 11:51:50.402662] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.477 [2024-11-28 11:51:50.402690] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.477 [2024-11-28 11:51:50.402705] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.477 [2024-11-28 11:51:50.402718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.477 [2024-11-28 11:51:50.402747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.477 qpair failed and we were unable to recover it. 00:27:30.477 [2024-11-28 11:51:50.412468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.477 [2024-11-28 11:51:50.412585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.477 [2024-11-28 11:51:50.412611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.477 [2024-11-28 11:51:50.412626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.477 [2024-11-28 11:51:50.412639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.477 [2024-11-28 11:51:50.412674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.477 qpair failed and we were unable to recover it. 00:27:30.477 [2024-11-28 11:51:50.422610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.477 [2024-11-28 11:51:50.422719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.477 [2024-11-28 11:51:50.422745] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.477 [2024-11-28 11:51:50.422759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.477 [2024-11-28 11:51:50.422772] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.477 [2024-11-28 11:51:50.422802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.477 qpair failed and we were unable to recover it. 00:27:30.477 [2024-11-28 11:51:50.432538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.477 [2024-11-28 11:51:50.432642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.477 [2024-11-28 11:51:50.432668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.477 [2024-11-28 11:51:50.432683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.477 [2024-11-28 11:51:50.432696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.477 [2024-11-28 11:51:50.432727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.477 qpair failed and we were unable to recover it. 00:27:30.477 [2024-11-28 11:51:50.442545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.477 [2024-11-28 11:51:50.442652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.477 [2024-11-28 11:51:50.442678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.477 [2024-11-28 11:51:50.442693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.477 [2024-11-28 11:51:50.442706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.477 [2024-11-28 11:51:50.442736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.477 qpair failed and we were unable to recover it. 00:27:30.477 [2024-11-28 11:51:50.452596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.477 [2024-11-28 11:51:50.452705] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.477 [2024-11-28 11:51:50.452731] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.477 [2024-11-28 11:51:50.452745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.477 [2024-11-28 11:51:50.452758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.477 [2024-11-28 11:51:50.452799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.477 qpair failed and we were unable to recover it. 00:27:30.477 [2024-11-28 11:51:50.462612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.477 [2024-11-28 11:51:50.462715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.477 [2024-11-28 11:51:50.462746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.477 [2024-11-28 11:51:50.462761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.478 [2024-11-28 11:51:50.462775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.478 [2024-11-28 11:51:50.462804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.478 qpair failed and we were unable to recover it. 00:27:30.478 [2024-11-28 11:51:50.472618] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.478 [2024-11-28 11:51:50.472717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.478 [2024-11-28 11:51:50.472742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.478 [2024-11-28 11:51:50.472756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.478 [2024-11-28 11:51:50.472770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.478 [2024-11-28 11:51:50.472799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.478 qpair failed and we were unable to recover it. 00:27:30.478 [2024-11-28 11:51:50.482660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.478 [2024-11-28 11:51:50.482784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.478 [2024-11-28 11:51:50.482810] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.478 [2024-11-28 11:51:50.482824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.478 [2024-11-28 11:51:50.482838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.478 [2024-11-28 11:51:50.482866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.478 qpair failed and we were unable to recover it. 00:27:30.478 [2024-11-28 11:51:50.492805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.478 [2024-11-28 11:51:50.492932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.478 [2024-11-28 11:51:50.492958] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.478 [2024-11-28 11:51:50.492972] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.478 [2024-11-28 11:51:50.492985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.478 [2024-11-28 11:51:50.493014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.478 qpair failed and we were unable to recover it. 00:27:30.478 [2024-11-28 11:51:50.502786] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.478 [2024-11-28 11:51:50.502913] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.478 [2024-11-28 11:51:50.502938] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.478 [2024-11-28 11:51:50.502953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.478 [2024-11-28 11:51:50.502972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.478 [2024-11-28 11:51:50.503004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.478 qpair failed and we were unable to recover it. 00:27:30.478 [2024-11-28 11:51:50.512838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.478 [2024-11-28 11:51:50.512972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.478 [2024-11-28 11:51:50.512998] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.478 [2024-11-28 11:51:50.513011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.478 [2024-11-28 11:51:50.513024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.478 [2024-11-28 11:51:50.513054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.478 qpair failed and we were unable to recover it. 00:27:30.478 [2024-11-28 11:51:50.522775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.478 [2024-11-28 11:51:50.522877] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.478 [2024-11-28 11:51:50.522903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.478 [2024-11-28 11:51:50.522917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.478 [2024-11-28 11:51:50.522930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.478 [2024-11-28 11:51:50.522959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.478 qpair failed and we were unable to recover it. 00:27:30.737 [2024-11-28 11:51:50.532810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.737 [2024-11-28 11:51:50.532922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.737 [2024-11-28 11:51:50.532946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.737 [2024-11-28 11:51:50.532961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.737 [2024-11-28 11:51:50.532974] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.737 [2024-11-28 11:51:50.533004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.737 qpair failed and we were unable to recover it. 00:27:30.737 [2024-11-28 11:51:50.542833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.737 [2024-11-28 11:51:50.542980] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.737 [2024-11-28 11:51:50.543006] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.737 [2024-11-28 11:51:50.543020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.737 [2024-11-28 11:51:50.543034] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.737 [2024-11-28 11:51:50.543063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.737 qpair failed and we were unable to recover it. 00:27:30.737 [2024-11-28 11:51:50.552948] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.737 [2024-11-28 11:51:50.553062] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.737 [2024-11-28 11:51:50.553088] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.737 [2024-11-28 11:51:50.553103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.737 [2024-11-28 11:51:50.553116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.737 [2024-11-28 11:51:50.553145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.737 qpair failed and we were unable to recover it. 00:27:30.737 [2024-11-28 11:51:50.562895] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.737 [2024-11-28 11:51:50.563000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.737 [2024-11-28 11:51:50.563025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.737 [2024-11-28 11:51:50.563039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.737 [2024-11-28 11:51:50.563053] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.737 [2024-11-28 11:51:50.563083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.737 qpair failed and we were unable to recover it. 00:27:30.737 [2024-11-28 11:51:50.573017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.737 [2024-11-28 11:51:50.573125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.737 [2024-11-28 11:51:50.573151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.737 [2024-11-28 11:51:50.573166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.737 [2024-11-28 11:51:50.573179] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.737 [2024-11-28 11:51:50.573207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.737 qpair failed and we were unable to recover it. 00:27:30.737 [2024-11-28 11:51:50.582971] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.737 [2024-11-28 11:51:50.583074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.737 [2024-11-28 11:51:50.583099] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.737 [2024-11-28 11:51:50.583114] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.737 [2024-11-28 11:51:50.583127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.737 [2024-11-28 11:51:50.583157] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.737 qpair failed and we were unable to recover it. 00:27:30.737 [2024-11-28 11:51:50.593059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.737 [2024-11-28 11:51:50.593168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.737 [2024-11-28 11:51:50.593194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.738 [2024-11-28 11:51:50.593208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.738 [2024-11-28 11:51:50.593227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.738 [2024-11-28 11:51:50.593257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.738 qpair failed and we were unable to recover it. 00:27:30.738 [2024-11-28 11:51:50.603095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.738 [2024-11-28 11:51:50.603197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.738 [2024-11-28 11:51:50.603223] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.738 [2024-11-28 11:51:50.603237] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.738 [2024-11-28 11:51:50.603250] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.738 [2024-11-28 11:51:50.603279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.738 qpair failed and we were unable to recover it. 00:27:30.738 [2024-11-28 11:51:50.613169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.738 [2024-11-28 11:51:50.613276] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.738 [2024-11-28 11:51:50.613301] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.738 [2024-11-28 11:51:50.613316] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.738 [2024-11-28 11:51:50.613329] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.738 [2024-11-28 11:51:50.613358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.738 qpair failed and we were unable to recover it. 00:27:30.738 [2024-11-28 11:51:50.623177] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.738 [2024-11-28 11:51:50.623291] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.738 [2024-11-28 11:51:50.623317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.738 [2024-11-28 11:51:50.623331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.738 [2024-11-28 11:51:50.623344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.738 [2024-11-28 11:51:50.623373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.738 qpair failed and we were unable to recover it. 00:27:30.738 [2024-11-28 11:51:50.633148] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.738 [2024-11-28 11:51:50.633292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.738 [2024-11-28 11:51:50.633317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.738 [2024-11-28 11:51:50.633331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.738 [2024-11-28 11:51:50.633344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.738 [2024-11-28 11:51:50.633373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.738 qpair failed and we were unable to recover it. 00:27:30.738 [2024-11-28 11:51:50.643121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.738 [2024-11-28 11:51:50.643218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.738 [2024-11-28 11:51:50.643244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.738 [2024-11-28 11:51:50.643259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.738 [2024-11-28 11:51:50.643272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.738 [2024-11-28 11:51:50.643300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.738 qpair failed and we were unable to recover it. 00:27:30.738 [2024-11-28 11:51:50.653186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.738 [2024-11-28 11:51:50.653305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.738 [2024-11-28 11:51:50.653330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.738 [2024-11-28 11:51:50.653345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.738 [2024-11-28 11:51:50.653359] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.738 [2024-11-28 11:51:50.653388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.738 qpair failed and we were unable to recover it. 00:27:30.738 [2024-11-28 11:51:50.663215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.738 [2024-11-28 11:51:50.663314] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.738 [2024-11-28 11:51:50.663340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.738 [2024-11-28 11:51:50.663354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.738 [2024-11-28 11:51:50.663367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.738 [2024-11-28 11:51:50.663396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.738 qpair failed and we were unable to recover it. 00:27:30.738 [2024-11-28 11:51:50.673302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.738 [2024-11-28 11:51:50.673416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.738 [2024-11-28 11:51:50.673443] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.738 [2024-11-28 11:51:50.673457] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.738 [2024-11-28 11:51:50.673469] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.738 [2024-11-28 11:51:50.673497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.738 qpair failed and we were unable to recover it. 00:27:30.738 [2024-11-28 11:51:50.683283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.738 [2024-11-28 11:51:50.683406] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.738 [2024-11-28 11:51:50.683434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.738 [2024-11-28 11:51:50.683458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.738 [2024-11-28 11:51:50.683475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.738 [2024-11-28 11:51:50.683518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.738 qpair failed and we were unable to recover it. 00:27:30.738 [2024-11-28 11:51:50.693319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.738 [2024-11-28 11:51:50.693437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.738 [2024-11-28 11:51:50.693464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.738 [2024-11-28 11:51:50.693479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.738 [2024-11-28 11:51:50.693492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.738 [2024-11-28 11:51:50.693522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.738 qpair failed and we were unable to recover it. 00:27:30.738 [2024-11-28 11:51:50.703316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.738 [2024-11-28 11:51:50.703464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.738 [2024-11-28 11:51:50.703490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.738 [2024-11-28 11:51:50.703505] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.738 [2024-11-28 11:51:50.703518] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.738 [2024-11-28 11:51:50.703556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.738 qpair failed and we were unable to recover it. 00:27:30.738 [2024-11-28 11:51:50.713355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.738 [2024-11-28 11:51:50.713463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.738 [2024-11-28 11:51:50.713489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.738 [2024-11-28 11:51:50.713504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.738 [2024-11-28 11:51:50.713517] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.738 [2024-11-28 11:51:50.713554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.738 qpair failed and we were unable to recover it. 00:27:30.738 [2024-11-28 11:51:50.723354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.738 [2024-11-28 11:51:50.723458] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.738 [2024-11-28 11:51:50.723484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.738 [2024-11-28 11:51:50.723498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.738 [2024-11-28 11:51:50.723512] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.738 [2024-11-28 11:51:50.723548] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.738 qpair failed and we were unable to recover it. 00:27:30.739 [2024-11-28 11:51:50.733429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.739 [2024-11-28 11:51:50.733542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.739 [2024-11-28 11:51:50.733568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.739 [2024-11-28 11:51:50.733582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.739 [2024-11-28 11:51:50.733595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.739 [2024-11-28 11:51:50.733624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.739 qpair failed and we were unable to recover it. 00:27:30.739 [2024-11-28 11:51:50.743417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.739 [2024-11-28 11:51:50.743534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.739 [2024-11-28 11:51:50.743561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.739 [2024-11-28 11:51:50.743576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.739 [2024-11-28 11:51:50.743589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.739 [2024-11-28 11:51:50.743618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.739 qpair failed and we were unable to recover it. 00:27:30.739 [2024-11-28 11:51:50.753464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.739 [2024-11-28 11:51:50.753575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.739 [2024-11-28 11:51:50.753602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.739 [2024-11-28 11:51:50.753616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.739 [2024-11-28 11:51:50.753630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.739 [2024-11-28 11:51:50.753672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.739 qpair failed and we were unable to recover it. 00:27:30.739 [2024-11-28 11:51:50.763480] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.739 [2024-11-28 11:51:50.763631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.739 [2024-11-28 11:51:50.763657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.739 [2024-11-28 11:51:50.763671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.739 [2024-11-28 11:51:50.763685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.739 [2024-11-28 11:51:50.763714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.739 qpair failed and we were unable to recover it. 00:27:30.739 [2024-11-28 11:51:50.773657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.739 [2024-11-28 11:51:50.773795] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.739 [2024-11-28 11:51:50.773835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.739 [2024-11-28 11:51:50.773850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.739 [2024-11-28 11:51:50.773863] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.739 [2024-11-28 11:51:50.773892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.739 qpair failed and we were unable to recover it. 00:27:30.739 [2024-11-28 11:51:50.783580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.739 [2024-11-28 11:51:50.783686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.739 [2024-11-28 11:51:50.783712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.739 [2024-11-28 11:51:50.783727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.739 [2024-11-28 11:51:50.783740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.739 [2024-11-28 11:51:50.783770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.739 qpair failed and we were unable to recover it. 00:27:30.998 [2024-11-28 11:51:50.793665] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.998 [2024-11-28 11:51:50.793801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.998 [2024-11-28 11:51:50.793827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.998 [2024-11-28 11:51:50.793841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.998 [2024-11-28 11:51:50.793854] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.998 [2024-11-28 11:51:50.793884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.998 qpair failed and we were unable to recover it. 00:27:30.998 [2024-11-28 11:51:50.803671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.998 [2024-11-28 11:51:50.803814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.998 [2024-11-28 11:51:50.803841] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.998 [2024-11-28 11:51:50.803856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.998 [2024-11-28 11:51:50.803869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.998 [2024-11-28 11:51:50.803901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.998 qpair failed and we were unable to recover it. 00:27:30.998 [2024-11-28 11:51:50.813692] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.998 [2024-11-28 11:51:50.813811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.998 [2024-11-28 11:51:50.813842] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.998 [2024-11-28 11:51:50.813857] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.998 [2024-11-28 11:51:50.813871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.998 [2024-11-28 11:51:50.813901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.998 qpair failed and we were unable to recover it. 00:27:30.998 [2024-11-28 11:51:50.823718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.998 [2024-11-28 11:51:50.823826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.998 [2024-11-28 11:51:50.823851] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.998 [2024-11-28 11:51:50.823866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.998 [2024-11-28 11:51:50.823880] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.998 [2024-11-28 11:51:50.823910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.998 qpair failed and we were unable to recover it. 00:27:30.998 [2024-11-28 11:51:50.833815] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.998 [2024-11-28 11:51:50.833935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.998 [2024-11-28 11:51:50.833961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.998 [2024-11-28 11:51:50.833976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.998 [2024-11-28 11:51:50.833992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.998 [2024-11-28 11:51:50.834022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.998 qpair failed and we were unable to recover it. 00:27:30.998 [2024-11-28 11:51:50.843717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.998 [2024-11-28 11:51:50.843836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.998 [2024-11-28 11:51:50.843862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.998 [2024-11-28 11:51:50.843877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.998 [2024-11-28 11:51:50.843890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.998 [2024-11-28 11:51:50.843920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.998 qpair failed and we were unable to recover it. 00:27:30.998 [2024-11-28 11:51:50.853797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.998 [2024-11-28 11:51:50.853937] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.998 [2024-11-28 11:51:50.853962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.998 [2024-11-28 11:51:50.853977] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.998 [2024-11-28 11:51:50.853990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.998 [2024-11-28 11:51:50.854019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.998 qpair failed and we were unable to recover it. 00:27:30.998 [2024-11-28 11:51:50.863821] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.998 [2024-11-28 11:51:50.863939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.998 [2024-11-28 11:51:50.863970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.998 [2024-11-28 11:51:50.863986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.998 [2024-11-28 11:51:50.863999] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.998 [2024-11-28 11:51:50.864028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.998 qpair failed and we were unable to recover it. 00:27:30.998 [2024-11-28 11:51:50.873840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.998 [2024-11-28 11:51:50.873955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.998 [2024-11-28 11:51:50.873983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.998 [2024-11-28 11:51:50.873998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.998 [2024-11-28 11:51:50.874013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.998 [2024-11-28 11:51:50.874046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.998 qpair failed and we were unable to recover it. 00:27:30.998 [2024-11-28 11:51:50.883878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.999 [2024-11-28 11:51:50.883985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.999 [2024-11-28 11:51:50.884011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.999 [2024-11-28 11:51:50.884026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.999 [2024-11-28 11:51:50.884040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.999 [2024-11-28 11:51:50.884070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.999 qpair failed and we were unable to recover it. 00:27:30.999 [2024-11-28 11:51:50.893938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.999 [2024-11-28 11:51:50.894046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.999 [2024-11-28 11:51:50.894075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.999 [2024-11-28 11:51:50.894090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.999 [2024-11-28 11:51:50.894103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.999 [2024-11-28 11:51:50.894132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.999 qpair failed and we were unable to recover it. 00:27:30.999 [2024-11-28 11:51:50.903964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.999 [2024-11-28 11:51:50.904076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.999 [2024-11-28 11:51:50.904102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.999 [2024-11-28 11:51:50.904117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.999 [2024-11-28 11:51:50.904129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.999 [2024-11-28 11:51:50.904167] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.999 qpair failed and we were unable to recover it. 00:27:30.999 [2024-11-28 11:51:50.913992] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.999 [2024-11-28 11:51:50.914100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.999 [2024-11-28 11:51:50.914126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.999 [2024-11-28 11:51:50.914141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.999 [2024-11-28 11:51:50.914154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.999 [2024-11-28 11:51:50.914184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.999 qpair failed and we were unable to recover it. 00:27:30.999 [2024-11-28 11:51:50.923987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.999 [2024-11-28 11:51:50.924086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.999 [2024-11-28 11:51:50.924112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.999 [2024-11-28 11:51:50.924127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.999 [2024-11-28 11:51:50.924140] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.999 [2024-11-28 11:51:50.924170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.999 qpair failed and we were unable to recover it. 00:27:30.999 [2024-11-28 11:51:50.934005] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.999 [2024-11-28 11:51:50.934131] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.999 [2024-11-28 11:51:50.934156] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.999 [2024-11-28 11:51:50.934171] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.999 [2024-11-28 11:51:50.934184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.999 [2024-11-28 11:51:50.934212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.999 qpair failed and we were unable to recover it. 00:27:30.999 [2024-11-28 11:51:50.944053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.999 [2024-11-28 11:51:50.944173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.999 [2024-11-28 11:51:50.944199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.999 [2024-11-28 11:51:50.944213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.999 [2024-11-28 11:51:50.944227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.999 [2024-11-28 11:51:50.944257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.999 qpair failed and we were unable to recover it. 00:27:30.999 [2024-11-28 11:51:50.954093] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.999 [2024-11-28 11:51:50.954202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.999 [2024-11-28 11:51:50.954232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.999 [2024-11-28 11:51:50.954248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.999 [2024-11-28 11:51:50.954261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.999 [2024-11-28 11:51:50.954290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.999 qpair failed and we were unable to recover it. 00:27:30.999 [2024-11-28 11:51:50.964200] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.999 [2024-11-28 11:51:50.964304] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.999 [2024-11-28 11:51:50.964330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.999 [2024-11-28 11:51:50.964344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.999 [2024-11-28 11:51:50.964357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.999 [2024-11-28 11:51:50.964386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.999 qpair failed and we were unable to recover it. 00:27:30.999 [2024-11-28 11:51:50.974208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.999 [2024-11-28 11:51:50.974316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.999 [2024-11-28 11:51:50.974341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.999 [2024-11-28 11:51:50.974356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.999 [2024-11-28 11:51:50.974369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.999 [2024-11-28 11:51:50.974398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.999 qpair failed and we were unable to recover it. 00:27:30.999 [2024-11-28 11:51:50.984145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.999 [2024-11-28 11:51:50.984252] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.999 [2024-11-28 11:51:50.984277] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.999 [2024-11-28 11:51:50.984291] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.999 [2024-11-28 11:51:50.984305] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.999 [2024-11-28 11:51:50.984334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.999 qpair failed and we were unable to recover it. 00:27:30.999 [2024-11-28 11:51:50.994238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.999 [2024-11-28 11:51:50.994388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.999 [2024-11-28 11:51:50.994413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.999 [2024-11-28 11:51:50.994428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.999 [2024-11-28 11:51:50.994447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.999 [2024-11-28 11:51:50.994479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.999 qpair failed and we were unable to recover it. 00:27:30.999 [2024-11-28 11:51:51.004218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.999 [2024-11-28 11:51:51.004321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.999 [2024-11-28 11:51:51.004346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.999 [2024-11-28 11:51:51.004361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.999 [2024-11-28 11:51:51.004373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:30.999 [2024-11-28 11:51:51.004404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:30.999 qpair failed and we were unable to recover it. 00:27:30.999 [2024-11-28 11:51:51.014245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.999 [2024-11-28 11:51:51.014362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.999 [2024-11-28 11:51:51.014387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.000 [2024-11-28 11:51:51.014402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.000 [2024-11-28 11:51:51.014415] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.000 [2024-11-28 11:51:51.014445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.000 qpair failed and we were unable to recover it. 00:27:31.000 [2024-11-28 11:51:51.024254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.000 [2024-11-28 11:51:51.024356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.000 [2024-11-28 11:51:51.024381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.000 [2024-11-28 11:51:51.024395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.000 [2024-11-28 11:51:51.024408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.000 [2024-11-28 11:51:51.024437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.000 qpair failed and we were unable to recover it. 00:27:31.000 [2024-11-28 11:51:51.034317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.000 [2024-11-28 11:51:51.034425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.000 [2024-11-28 11:51:51.034451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.000 [2024-11-28 11:51:51.034466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.000 [2024-11-28 11:51:51.034479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.000 [2024-11-28 11:51:51.034521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.000 qpair failed and we were unable to recover it. 00:27:31.000 [2024-11-28 11:51:51.044354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.000 [2024-11-28 11:51:51.044468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.000 [2024-11-28 11:51:51.044494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.000 [2024-11-28 11:51:51.044509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.000 [2024-11-28 11:51:51.044521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.000 [2024-11-28 11:51:51.044560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.000 qpair failed and we were unable to recover it. 00:27:31.259 [2024-11-28 11:51:51.054366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.259 [2024-11-28 11:51:51.054477] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.259 [2024-11-28 11:51:51.054503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.259 [2024-11-28 11:51:51.054517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.259 [2024-11-28 11:51:51.054539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.259 [2024-11-28 11:51:51.054571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.259 qpair failed and we were unable to recover it. 00:27:31.259 [2024-11-28 11:51:51.064408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.259 [2024-11-28 11:51:51.064539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.259 [2024-11-28 11:51:51.064565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.259 [2024-11-28 11:51:51.064579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.259 [2024-11-28 11:51:51.064592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.259 [2024-11-28 11:51:51.064622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.259 qpair failed and we were unable to recover it. 00:27:31.259 [2024-11-28 11:51:51.074438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.259 [2024-11-28 11:51:51.074547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.259 [2024-11-28 11:51:51.074573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.259 [2024-11-28 11:51:51.074588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.259 [2024-11-28 11:51:51.074601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.259 [2024-11-28 11:51:51.074632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.259 qpair failed and we were unable to recover it. 00:27:31.259 [2024-11-28 11:51:51.084455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.259 [2024-11-28 11:51:51.084563] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.259 [2024-11-28 11:51:51.084588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.259 [2024-11-28 11:51:51.084603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.259 [2024-11-28 11:51:51.084622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.259 [2024-11-28 11:51:51.084652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.259 qpair failed and we were unable to recover it. 00:27:31.259 [2024-11-28 11:51:51.094504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.259 [2024-11-28 11:51:51.094672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.259 [2024-11-28 11:51:51.094698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.259 [2024-11-28 11:51:51.094712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.259 [2024-11-28 11:51:51.094726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.259 [2024-11-28 11:51:51.094755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.259 qpair failed and we were unable to recover it. 00:27:31.259 [2024-11-28 11:51:51.104589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.259 [2024-11-28 11:51:51.104693] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.259 [2024-11-28 11:51:51.104718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.259 [2024-11-28 11:51:51.104732] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.259 [2024-11-28 11:51:51.104745] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.259 [2024-11-28 11:51:51.104775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.259 qpair failed and we were unable to recover it. 00:27:31.259 [2024-11-28 11:51:51.114520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.259 [2024-11-28 11:51:51.114633] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.259 [2024-11-28 11:51:51.114659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.259 [2024-11-28 11:51:51.114673] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.259 [2024-11-28 11:51:51.114686] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.259 [2024-11-28 11:51:51.114716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.259 qpair failed and we were unable to recover it. 00:27:31.259 [2024-11-28 11:51:51.124562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.259 [2024-11-28 11:51:51.124705] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.259 [2024-11-28 11:51:51.124730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.259 [2024-11-28 11:51:51.124745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.259 [2024-11-28 11:51:51.124758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.259 [2024-11-28 11:51:51.124788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.259 qpair failed and we were unable to recover it. 00:27:31.259 [2024-11-28 11:51:51.134616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.259 [2024-11-28 11:51:51.134726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.259 [2024-11-28 11:51:51.134751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.259 [2024-11-28 11:51:51.134766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.259 [2024-11-28 11:51:51.134779] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.259 [2024-11-28 11:51:51.134809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.259 qpair failed and we were unable to recover it. 00:27:31.259 [2024-11-28 11:51:51.144624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.259 [2024-11-28 11:51:51.144733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.259 [2024-11-28 11:51:51.144759] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.259 [2024-11-28 11:51:51.144774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.259 [2024-11-28 11:51:51.144787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.259 [2024-11-28 11:51:51.144827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.259 qpair failed and we were unable to recover it. 00:27:31.259 [2024-11-28 11:51:51.154634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.259 [2024-11-28 11:51:51.154751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.259 [2024-11-28 11:51:51.154777] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.259 [2024-11-28 11:51:51.154792] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.259 [2024-11-28 11:51:51.154805] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.259 [2024-11-28 11:51:51.154836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.259 qpair failed and we were unable to recover it. 00:27:31.259 [2024-11-28 11:51:51.164689] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.259 [2024-11-28 11:51:51.164792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.259 [2024-11-28 11:51:51.164818] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.259 [2024-11-28 11:51:51.164832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.259 [2024-11-28 11:51:51.164846] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.259 [2024-11-28 11:51:51.164886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.259 qpair failed and we were unable to recover it. 00:27:31.259 [2024-11-28 11:51:51.174716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.259 [2024-11-28 11:51:51.174831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.259 [2024-11-28 11:51:51.174856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.260 [2024-11-28 11:51:51.174877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.260 [2024-11-28 11:51:51.174891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.260 [2024-11-28 11:51:51.174920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.260 qpair failed and we were unable to recover it. 00:27:31.260 [2024-11-28 11:51:51.184809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.260 [2024-11-28 11:51:51.184916] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.260 [2024-11-28 11:51:51.184942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.260 [2024-11-28 11:51:51.184956] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.260 [2024-11-28 11:51:51.184969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.260 [2024-11-28 11:51:51.184998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.260 qpair failed and we were unable to recover it. 00:27:31.260 [2024-11-28 11:51:51.194745] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.260 [2024-11-28 11:51:51.194878] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.260 [2024-11-28 11:51:51.194904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.260 [2024-11-28 11:51:51.194919] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.260 [2024-11-28 11:51:51.194933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.260 [2024-11-28 11:51:51.194962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.260 qpair failed and we were unable to recover it. 00:27:31.260 [2024-11-28 11:51:51.204757] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.260 [2024-11-28 11:51:51.204863] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.260 [2024-11-28 11:51:51.204889] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.260 [2024-11-28 11:51:51.204903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.260 [2024-11-28 11:51:51.204917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.260 [2024-11-28 11:51:51.204946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.260 qpair failed and we were unable to recover it. 00:27:31.260 [2024-11-28 11:51:51.214902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.260 [2024-11-28 11:51:51.215039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.260 [2024-11-28 11:51:51.215064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.260 [2024-11-28 11:51:51.215079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.260 [2024-11-28 11:51:51.215092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.260 [2024-11-28 11:51:51.215122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.260 qpair failed and we were unable to recover it. 00:27:31.260 [2024-11-28 11:51:51.224877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.260 [2024-11-28 11:51:51.225033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.260 [2024-11-28 11:51:51.225059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.260 [2024-11-28 11:51:51.225074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.260 [2024-11-28 11:51:51.225090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.260 [2024-11-28 11:51:51.225119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.260 qpair failed and we were unable to recover it. 00:27:31.260 [2024-11-28 11:51:51.234887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.260 [2024-11-28 11:51:51.234989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.260 [2024-11-28 11:51:51.235018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.260 [2024-11-28 11:51:51.235034] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.260 [2024-11-28 11:51:51.235047] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.260 [2024-11-28 11:51:51.235076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.260 qpair failed and we were unable to recover it. 00:27:31.260 [2024-11-28 11:51:51.244882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.260 [2024-11-28 11:51:51.244987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.260 [2024-11-28 11:51:51.245013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.260 [2024-11-28 11:51:51.245028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.260 [2024-11-28 11:51:51.245041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.260 [2024-11-28 11:51:51.245070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.260 qpair failed and we were unable to recover it. 00:27:31.260 [2024-11-28 11:51:51.254917] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.260 [2024-11-28 11:51:51.255029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.260 [2024-11-28 11:51:51.255054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.260 [2024-11-28 11:51:51.255069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.260 [2024-11-28 11:51:51.255082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.260 [2024-11-28 11:51:51.255113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.260 qpair failed and we were unable to recover it. 00:27:31.260 [2024-11-28 11:51:51.264936] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.260 [2024-11-28 11:51:51.265054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.260 [2024-11-28 11:51:51.265081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.260 [2024-11-28 11:51:51.265103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.260 [2024-11-28 11:51:51.265117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.260 [2024-11-28 11:51:51.265148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.260 qpair failed and we were unable to recover it. 00:27:31.260 [2024-11-28 11:51:51.274965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.260 [2024-11-28 11:51:51.275086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.260 [2024-11-28 11:51:51.275112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.260 [2024-11-28 11:51:51.275127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.260 [2024-11-28 11:51:51.275140] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.260 [2024-11-28 11:51:51.275171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.260 qpair failed and we were unable to recover it. 00:27:31.260 [2024-11-28 11:51:51.285038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.260 [2024-11-28 11:51:51.285169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.260 [2024-11-28 11:51:51.285194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.260 [2024-11-28 11:51:51.285209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.260 [2024-11-28 11:51:51.285221] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.260 [2024-11-28 11:51:51.285250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.260 qpair failed and we were unable to recover it. 00:27:31.260 [2024-11-28 11:51:51.295031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.260 [2024-11-28 11:51:51.295145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.260 [2024-11-28 11:51:51.295170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.260 [2024-11-28 11:51:51.295185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.260 [2024-11-28 11:51:51.295198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.260 [2024-11-28 11:51:51.295228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.260 qpair failed and we were unable to recover it. 00:27:31.260 [2024-11-28 11:51:51.305089] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.260 [2024-11-28 11:51:51.305194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.260 [2024-11-28 11:51:51.305219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.260 [2024-11-28 11:51:51.305233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.261 [2024-11-28 11:51:51.305246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.261 [2024-11-28 11:51:51.305275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.261 qpair failed and we were unable to recover it. 00:27:31.520 [2024-11-28 11:51:51.315130] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.520 [2024-11-28 11:51:51.315254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.520 [2024-11-28 11:51:51.315280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.520 [2024-11-28 11:51:51.315294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.520 [2024-11-28 11:51:51.315308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.520 [2024-11-28 11:51:51.315348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.520 qpair failed and we were unable to recover it. 00:27:31.520 [2024-11-28 11:51:51.325118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.520 [2024-11-28 11:51:51.325247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.520 [2024-11-28 11:51:51.325272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.520 [2024-11-28 11:51:51.325286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.520 [2024-11-28 11:51:51.325299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.520 [2024-11-28 11:51:51.325328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.520 qpair failed and we were unable to recover it. 00:27:31.520 [2024-11-28 11:51:51.335162] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.520 [2024-11-28 11:51:51.335268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.520 [2024-11-28 11:51:51.335294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.520 [2024-11-28 11:51:51.335309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.520 [2024-11-28 11:51:51.335322] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.520 [2024-11-28 11:51:51.335351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.520 qpair failed and we were unable to recover it. 00:27:31.521 [2024-11-28 11:51:51.345163] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.521 [2024-11-28 11:51:51.345273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.521 [2024-11-28 11:51:51.345298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.521 [2024-11-28 11:51:51.345313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.521 [2024-11-28 11:51:51.345326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.521 [2024-11-28 11:51:51.345356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.521 qpair failed and we were unable to recover it. 00:27:31.521 [2024-11-28 11:51:51.355277] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.521 [2024-11-28 11:51:51.355384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.521 [2024-11-28 11:51:51.355414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.521 [2024-11-28 11:51:51.355429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.521 [2024-11-28 11:51:51.355442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.521 [2024-11-28 11:51:51.355472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.521 qpair failed and we were unable to recover it. 00:27:31.521 [2024-11-28 11:51:51.365226] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.521 [2024-11-28 11:51:51.365329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.521 [2024-11-28 11:51:51.365355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.521 [2024-11-28 11:51:51.365372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.521 [2024-11-28 11:51:51.365385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.521 [2024-11-28 11:51:51.365415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.521 qpair failed and we were unable to recover it. 00:27:31.521 [2024-11-28 11:51:51.375268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.521 [2024-11-28 11:51:51.375430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.521 [2024-11-28 11:51:51.375456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.521 [2024-11-28 11:51:51.375471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.521 [2024-11-28 11:51:51.375487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.521 [2024-11-28 11:51:51.375516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.521 qpair failed and we were unable to recover it. 00:27:31.521 [2024-11-28 11:51:51.385298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.521 [2024-11-28 11:51:51.385418] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.521 [2024-11-28 11:51:51.385444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.521 [2024-11-28 11:51:51.385458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.521 [2024-11-28 11:51:51.385471] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.521 [2024-11-28 11:51:51.385501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.521 qpair failed and we were unable to recover it. 00:27:31.521 [2024-11-28 11:51:51.395346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.521 [2024-11-28 11:51:51.395458] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.521 [2024-11-28 11:51:51.395484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.521 [2024-11-28 11:51:51.395498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.521 [2024-11-28 11:51:51.395511] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.521 [2024-11-28 11:51:51.395553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.521 qpair failed and we were unable to recover it. 00:27:31.521 [2024-11-28 11:51:51.405329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.521 [2024-11-28 11:51:51.405440] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.521 [2024-11-28 11:51:51.405466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.521 [2024-11-28 11:51:51.405480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.521 [2024-11-28 11:51:51.405493] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.521 [2024-11-28 11:51:51.405522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.521 qpair failed and we were unable to recover it. 00:27:31.521 [2024-11-28 11:51:51.415401] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.521 [2024-11-28 11:51:51.415512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.521 [2024-11-28 11:51:51.415544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.521 [2024-11-28 11:51:51.415560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.521 [2024-11-28 11:51:51.415573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.521 [2024-11-28 11:51:51.415602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.521 qpair failed and we were unable to recover it. 00:27:31.521 [2024-11-28 11:51:51.425416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.521 [2024-11-28 11:51:51.425520] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.521 [2024-11-28 11:51:51.425551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.521 [2024-11-28 11:51:51.425565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.521 [2024-11-28 11:51:51.425579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.521 [2024-11-28 11:51:51.425608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.521 qpair failed and we were unable to recover it. 00:27:31.521 [2024-11-28 11:51:51.435448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.521 [2024-11-28 11:51:51.435583] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.521 [2024-11-28 11:51:51.435608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.521 [2024-11-28 11:51:51.435623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.521 [2024-11-28 11:51:51.435636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.521 [2024-11-28 11:51:51.435667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.521 qpair failed and we were unable to recover it. 00:27:31.521 [2024-11-28 11:51:51.445465] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.521 [2024-11-28 11:51:51.445579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.521 [2024-11-28 11:51:51.445610] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.521 [2024-11-28 11:51:51.445625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.521 [2024-11-28 11:51:51.445638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.521 [2024-11-28 11:51:51.445667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.521 qpair failed and we were unable to recover it. 00:27:31.521 [2024-11-28 11:51:51.455550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.521 [2024-11-28 11:51:51.455691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.521 [2024-11-28 11:51:51.455716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.521 [2024-11-28 11:51:51.455731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.521 [2024-11-28 11:51:51.455743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.521 [2024-11-28 11:51:51.455773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.521 qpair failed and we were unable to recover it. 00:27:31.521 [2024-11-28 11:51:51.465518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.521 [2024-11-28 11:51:51.465630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.521 [2024-11-28 11:51:51.465658] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.521 [2024-11-28 11:51:51.465673] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.521 [2024-11-28 11:51:51.465686] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.521 [2024-11-28 11:51:51.465715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.521 qpair failed and we were unable to recover it. 00:27:31.521 [2024-11-28 11:51:51.475550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.521 [2024-11-28 11:51:51.475653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.521 [2024-11-28 11:51:51.475679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.522 [2024-11-28 11:51:51.475694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.522 [2024-11-28 11:51:51.475707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.522 [2024-11-28 11:51:51.475735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.522 qpair failed and we were unable to recover it. 00:27:31.522 [2024-11-28 11:51:51.485609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.522 [2024-11-28 11:51:51.485710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.522 [2024-11-28 11:51:51.485736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.522 [2024-11-28 11:51:51.485751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.522 [2024-11-28 11:51:51.485764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.522 [2024-11-28 11:51:51.485811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.522 qpair failed and we were unable to recover it. 00:27:31.522 [2024-11-28 11:51:51.495646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.522 [2024-11-28 11:51:51.495759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.522 [2024-11-28 11:51:51.495784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.522 [2024-11-28 11:51:51.495799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.522 [2024-11-28 11:51:51.495813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.522 [2024-11-28 11:51:51.495842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.522 qpair failed and we were unable to recover it. 00:27:31.522 [2024-11-28 11:51:51.505641] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.522 [2024-11-28 11:51:51.505771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.522 [2024-11-28 11:51:51.505797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.522 [2024-11-28 11:51:51.505811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.522 [2024-11-28 11:51:51.505824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.522 [2024-11-28 11:51:51.505854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.522 qpair failed and we were unable to recover it. 00:27:31.522 [2024-11-28 11:51:51.515711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.522 [2024-11-28 11:51:51.515825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.522 [2024-11-28 11:51:51.515850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.522 [2024-11-28 11:51:51.515865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.522 [2024-11-28 11:51:51.515878] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.522 [2024-11-28 11:51:51.515907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.522 qpair failed and we were unable to recover it. 00:27:31.522 [2024-11-28 11:51:51.525739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.522 [2024-11-28 11:51:51.525853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.522 [2024-11-28 11:51:51.525879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.522 [2024-11-28 11:51:51.525894] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.522 [2024-11-28 11:51:51.525907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.522 [2024-11-28 11:51:51.525948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.522 qpair failed and we were unable to recover it. 00:27:31.522 [2024-11-28 11:51:51.535757] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.522 [2024-11-28 11:51:51.535920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.522 [2024-11-28 11:51:51.535945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.522 [2024-11-28 11:51:51.535960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.522 [2024-11-28 11:51:51.535973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.522 [2024-11-28 11:51:51.536002] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.522 qpair failed and we were unable to recover it. 00:27:31.522 [2024-11-28 11:51:51.545776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.522 [2024-11-28 11:51:51.545894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.522 [2024-11-28 11:51:51.545919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.522 [2024-11-28 11:51:51.545934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.522 [2024-11-28 11:51:51.545947] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.522 [2024-11-28 11:51:51.545976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.522 qpair failed and we were unable to recover it. 00:27:31.522 [2024-11-28 11:51:51.555867] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.522 [2024-11-28 11:51:51.555975] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.522 [2024-11-28 11:51:51.555999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.522 [2024-11-28 11:51:51.556014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.522 [2024-11-28 11:51:51.556027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.522 [2024-11-28 11:51:51.556057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.522 qpair failed and we were unable to recover it. 00:27:31.522 [2024-11-28 11:51:51.565847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.522 [2024-11-28 11:51:51.565952] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.522 [2024-11-28 11:51:51.565978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.522 [2024-11-28 11:51:51.565993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.522 [2024-11-28 11:51:51.566006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.522 [2024-11-28 11:51:51.566035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.522 qpair failed and we were unable to recover it. 00:27:31.782 [2024-11-28 11:51:51.575867] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.782 [2024-11-28 11:51:51.575981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.782 [2024-11-28 11:51:51.576006] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.782 [2024-11-28 11:51:51.576021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.782 [2024-11-28 11:51:51.576040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.782 [2024-11-28 11:51:51.576070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.782 qpair failed and we were unable to recover it. 00:27:31.782 [2024-11-28 11:51:51.585893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.782 [2024-11-28 11:51:51.586015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.782 [2024-11-28 11:51:51.586041] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.782 [2024-11-28 11:51:51.586056] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.782 [2024-11-28 11:51:51.586069] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.782 [2024-11-28 11:51:51.586099] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.782 qpair failed and we were unable to recover it. 00:27:31.782 [2024-11-28 11:51:51.595940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.782 [2024-11-28 11:51:51.596053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.782 [2024-11-28 11:51:51.596078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.782 [2024-11-28 11:51:51.596092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.782 [2024-11-28 11:51:51.596105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.782 [2024-11-28 11:51:51.596135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.782 qpair failed and we were unable to recover it. 00:27:31.782 [2024-11-28 11:51:51.606020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.782 [2024-11-28 11:51:51.606156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.782 [2024-11-28 11:51:51.606182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.782 [2024-11-28 11:51:51.606197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.782 [2024-11-28 11:51:51.606209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.782 [2024-11-28 11:51:51.606241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.782 qpair failed and we were unable to recover it. 00:27:31.782 [2024-11-28 11:51:51.615973] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.782 [2024-11-28 11:51:51.616082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.782 [2024-11-28 11:51:51.616108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.782 [2024-11-28 11:51:51.616122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.782 [2024-11-28 11:51:51.616135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.782 [2024-11-28 11:51:51.616164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.782 qpair failed and we were unable to recover it. 00:27:31.782 [2024-11-28 11:51:51.625982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.782 [2024-11-28 11:51:51.626129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.782 [2024-11-28 11:51:51.626154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.782 [2024-11-28 11:51:51.626169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.782 [2024-11-28 11:51:51.626182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.782 [2024-11-28 11:51:51.626210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.782 qpair failed and we were unable to recover it. 00:27:31.782 [2024-11-28 11:51:51.636000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.782 [2024-11-28 11:51:51.636107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.782 [2024-11-28 11:51:51.636132] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.782 [2024-11-28 11:51:51.636146] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.782 [2024-11-28 11:51:51.636160] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.782 [2024-11-28 11:51:51.636189] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.782 qpair failed and we were unable to recover it. 00:27:31.782 [2024-11-28 11:51:51.646026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.782 [2024-11-28 11:51:51.646124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.782 [2024-11-28 11:51:51.646149] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.782 [2024-11-28 11:51:51.646164] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.782 [2024-11-28 11:51:51.646178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.782 [2024-11-28 11:51:51.646218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.782 qpair failed and we were unable to recover it. 00:27:31.782 [2024-11-28 11:51:51.656109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.782 [2024-11-28 11:51:51.656218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.782 [2024-11-28 11:51:51.656243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.782 [2024-11-28 11:51:51.656258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.782 [2024-11-28 11:51:51.656271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.782 [2024-11-28 11:51:51.656300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.782 qpair failed and we were unable to recover it. 00:27:31.782 [2024-11-28 11:51:51.666097] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.782 [2024-11-28 11:51:51.666199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.782 [2024-11-28 11:51:51.666225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.782 [2024-11-28 11:51:51.666246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.782 [2024-11-28 11:51:51.666260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.782 [2024-11-28 11:51:51.666290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.782 qpair failed and we were unable to recover it. 00:27:31.782 [2024-11-28 11:51:51.676112] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.782 [2024-11-28 11:51:51.676207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.782 [2024-11-28 11:51:51.676232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.782 [2024-11-28 11:51:51.676247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.782 [2024-11-28 11:51:51.676259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.782 [2024-11-28 11:51:51.676287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.782 qpair failed and we were unable to recover it. 00:27:31.782 [2024-11-28 11:51:51.686157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.782 [2024-11-28 11:51:51.686259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.782 [2024-11-28 11:51:51.686285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.783 [2024-11-28 11:51:51.686299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.783 [2024-11-28 11:51:51.686312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.783 [2024-11-28 11:51:51.686342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.783 qpair failed and we were unable to recover it. 00:27:31.783 [2024-11-28 11:51:51.696267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.783 [2024-11-28 11:51:51.696376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.783 [2024-11-28 11:51:51.696401] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.783 [2024-11-28 11:51:51.696416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.783 [2024-11-28 11:51:51.696429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.783 [2024-11-28 11:51:51.696458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.783 qpair failed and we were unable to recover it. 00:27:31.783 [2024-11-28 11:51:51.706245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.783 [2024-11-28 11:51:51.706354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.783 [2024-11-28 11:51:51.706379] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.783 [2024-11-28 11:51:51.706394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.783 [2024-11-28 11:51:51.706407] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.783 [2024-11-28 11:51:51.706437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.783 qpair failed and we were unable to recover it. 00:27:31.783 [2024-11-28 11:51:51.716248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.783 [2024-11-28 11:51:51.716350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.783 [2024-11-28 11:51:51.716376] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.783 [2024-11-28 11:51:51.716390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.783 [2024-11-28 11:51:51.716403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.783 [2024-11-28 11:51:51.716432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.783 qpair failed and we were unable to recover it. 00:27:31.783 [2024-11-28 11:51:51.726254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.783 [2024-11-28 11:51:51.726357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.783 [2024-11-28 11:51:51.726382] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.783 [2024-11-28 11:51:51.726398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.783 [2024-11-28 11:51:51.726412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.783 [2024-11-28 11:51:51.726442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.783 qpair failed and we were unable to recover it. 00:27:31.783 [2024-11-28 11:51:51.736321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.783 [2024-11-28 11:51:51.736446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.783 [2024-11-28 11:51:51.736472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.783 [2024-11-28 11:51:51.736486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.783 [2024-11-28 11:51:51.736500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.783 [2024-11-28 11:51:51.736535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.783 qpair failed and we were unable to recover it. 00:27:31.783 [2024-11-28 11:51:51.746306] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.783 [2024-11-28 11:51:51.746410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.783 [2024-11-28 11:51:51.746435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.783 [2024-11-28 11:51:51.746449] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.783 [2024-11-28 11:51:51.746462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.783 [2024-11-28 11:51:51.746492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.783 qpair failed and we were unable to recover it. 00:27:31.783 [2024-11-28 11:51:51.756339] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.783 [2024-11-28 11:51:51.756447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.783 [2024-11-28 11:51:51.756472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.783 [2024-11-28 11:51:51.756493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.783 [2024-11-28 11:51:51.756508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.783 [2024-11-28 11:51:51.756546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.783 qpair failed and we were unable to recover it. 00:27:31.783 [2024-11-28 11:51:51.766459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.783 [2024-11-28 11:51:51.766571] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.783 [2024-11-28 11:51:51.766597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.783 [2024-11-28 11:51:51.766612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.783 [2024-11-28 11:51:51.766625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.783 [2024-11-28 11:51:51.766654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.783 qpair failed and we were unable to recover it. 00:27:31.783 [2024-11-28 11:51:51.776411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.783 [2024-11-28 11:51:51.776520] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.783 [2024-11-28 11:51:51.776553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.783 [2024-11-28 11:51:51.776567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.783 [2024-11-28 11:51:51.776581] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.783 [2024-11-28 11:51:51.776611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.783 qpair failed and we were unable to recover it. 00:27:31.783 [2024-11-28 11:51:51.786436] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.783 [2024-11-28 11:51:51.786549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.783 [2024-11-28 11:51:51.786575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.783 [2024-11-28 11:51:51.786590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.783 [2024-11-28 11:51:51.786603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.783 [2024-11-28 11:51:51.786645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.783 qpair failed and we were unable to recover it. 00:27:31.783 [2024-11-28 11:51:51.796474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.783 [2024-11-28 11:51:51.796573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.783 [2024-11-28 11:51:51.796599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.783 [2024-11-28 11:51:51.796614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.783 [2024-11-28 11:51:51.796626] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.783 [2024-11-28 11:51:51.796656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.783 qpair failed and we were unable to recover it. 00:27:31.783 [2024-11-28 11:51:51.806577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.783 [2024-11-28 11:51:51.806676] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.783 [2024-11-28 11:51:51.806701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.783 [2024-11-28 11:51:51.806716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.783 [2024-11-28 11:51:51.806729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.783 [2024-11-28 11:51:51.806758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.783 qpair failed and we were unable to recover it. 00:27:31.783 [2024-11-28 11:51:51.816537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.783 [2024-11-28 11:51:51.816642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.783 [2024-11-28 11:51:51.816667] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.783 [2024-11-28 11:51:51.816682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.783 [2024-11-28 11:51:51.816695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.783 [2024-11-28 11:51:51.816725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.783 qpair failed and we were unable to recover it. 00:27:31.784 [2024-11-28 11:51:51.826562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.784 [2024-11-28 11:51:51.826713] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.784 [2024-11-28 11:51:51.826739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.784 [2024-11-28 11:51:51.826754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.784 [2024-11-28 11:51:51.826767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:31.784 [2024-11-28 11:51:51.826808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:31.784 qpair failed and we were unable to recover it. 00:27:32.043 [2024-11-28 11:51:51.836576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.043 [2024-11-28 11:51:51.836683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.043 [2024-11-28 11:51:51.836707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.043 [2024-11-28 11:51:51.836721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.043 [2024-11-28 11:51:51.836733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.043 [2024-11-28 11:51:51.836762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.043 qpair failed and we were unable to recover it. 00:27:32.043 [2024-11-28 11:51:51.846654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.043 [2024-11-28 11:51:51.846754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.043 [2024-11-28 11:51:51.846785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.043 [2024-11-28 11:51:51.846801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.043 [2024-11-28 11:51:51.846814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.043 [2024-11-28 11:51:51.846843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.043 qpair failed and we were unable to recover it. 00:27:32.043 [2024-11-28 11:51:51.856649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.043 [2024-11-28 11:51:51.856788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.043 [2024-11-28 11:51:51.856813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.043 [2024-11-28 11:51:51.856827] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.043 [2024-11-28 11:51:51.856840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.043 [2024-11-28 11:51:51.856868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.043 qpair failed and we were unable to recover it. 00:27:32.043 [2024-11-28 11:51:51.866709] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.043 [2024-11-28 11:51:51.866810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.043 [2024-11-28 11:51:51.866836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.043 [2024-11-28 11:51:51.866850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.043 [2024-11-28 11:51:51.866863] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.043 [2024-11-28 11:51:51.866893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.043 qpair failed and we were unable to recover it. 00:27:32.043 [2024-11-28 11:51:51.876697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.043 [2024-11-28 11:51:51.876797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.043 [2024-11-28 11:51:51.876822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.043 [2024-11-28 11:51:51.876836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.043 [2024-11-28 11:51:51.876849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.043 [2024-11-28 11:51:51.876878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.043 qpair failed and we were unable to recover it. 00:27:32.043 [2024-11-28 11:51:51.886731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.043 [2024-11-28 11:51:51.886860] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.043 [2024-11-28 11:51:51.886885] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.043 [2024-11-28 11:51:51.886900] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.043 [2024-11-28 11:51:51.886913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.043 [2024-11-28 11:51:51.886948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.043 qpair failed and we were unable to recover it. 00:27:32.043 [2024-11-28 11:51:51.896789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.043 [2024-11-28 11:51:51.896904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.043 [2024-11-28 11:51:51.896929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.043 [2024-11-28 11:51:51.896943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.043 [2024-11-28 11:51:51.896956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.043 [2024-11-28 11:51:51.896986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.043 qpair failed and we were unable to recover it. 00:27:32.043 [2024-11-28 11:51:51.906780] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.043 [2024-11-28 11:51:51.906915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.043 [2024-11-28 11:51:51.906941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.043 [2024-11-28 11:51:51.906955] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.043 [2024-11-28 11:51:51.906969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.043 [2024-11-28 11:51:51.906997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.043 qpair failed and we were unable to recover it. 00:27:32.043 [2024-11-28 11:51:51.916818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.043 [2024-11-28 11:51:51.916938] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.043 [2024-11-28 11:51:51.916963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.043 [2024-11-28 11:51:51.916978] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.043 [2024-11-28 11:51:51.916991] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.043 [2024-11-28 11:51:51.917033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.043 qpair failed and we were unable to recover it. 00:27:32.043 [2024-11-28 11:51:51.926849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.043 [2024-11-28 11:51:51.926990] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.043 [2024-11-28 11:51:51.927016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.043 [2024-11-28 11:51:51.927030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.044 [2024-11-28 11:51:51.927043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.044 [2024-11-28 11:51:51.927073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.044 qpair failed and we were unable to recover it. 00:27:32.044 [2024-11-28 11:51:51.936890] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.044 [2024-11-28 11:51:51.937006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.044 [2024-11-28 11:51:51.937038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.044 [2024-11-28 11:51:51.937053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.044 [2024-11-28 11:51:51.937066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.044 [2024-11-28 11:51:51.937096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.044 qpair failed and we were unable to recover it. 00:27:32.044 [2024-11-28 11:51:51.946915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.044 [2024-11-28 11:51:51.947039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.044 [2024-11-28 11:51:51.947064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.044 [2024-11-28 11:51:51.947079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.044 [2024-11-28 11:51:51.947092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.044 [2024-11-28 11:51:51.947121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.044 qpair failed and we were unable to recover it. 00:27:32.044 [2024-11-28 11:51:51.956989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.044 [2024-11-28 11:51:51.957141] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.044 [2024-11-28 11:51:51.957166] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.044 [2024-11-28 11:51:51.957181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.044 [2024-11-28 11:51:51.957194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.044 [2024-11-28 11:51:51.957224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.044 qpair failed and we were unable to recover it. 00:27:32.044 [2024-11-28 11:51:51.967027] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.044 [2024-11-28 11:51:51.967178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.044 [2024-11-28 11:51:51.967203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.044 [2024-11-28 11:51:51.967219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.044 [2024-11-28 11:51:51.967232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.044 [2024-11-28 11:51:51.967261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.044 qpair failed and we were unable to recover it. 00:27:32.044 [2024-11-28 11:51:51.977005] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.044 [2024-11-28 11:51:51.977116] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.044 [2024-11-28 11:51:51.977143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.044 [2024-11-28 11:51:51.977158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.044 [2024-11-28 11:51:51.977172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.044 [2024-11-28 11:51:51.977219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.044 qpair failed and we were unable to recover it. 00:27:32.044 [2024-11-28 11:51:51.987058] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.044 [2024-11-28 11:51:51.987180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.044 [2024-11-28 11:51:51.987206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.044 [2024-11-28 11:51:51.987222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.044 [2024-11-28 11:51:51.987236] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.044 [2024-11-28 11:51:51.987265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.044 qpair failed and we were unable to recover it. 00:27:32.044 [2024-11-28 11:51:51.997071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.044 [2024-11-28 11:51:51.997199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.044 [2024-11-28 11:51:51.997224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.044 [2024-11-28 11:51:51.997240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.044 [2024-11-28 11:51:51.997253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.044 [2024-11-28 11:51:51.997283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.044 qpair failed and we were unable to recover it. 00:27:32.044 [2024-11-28 11:51:52.007091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.044 [2024-11-28 11:51:52.007209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.044 [2024-11-28 11:51:52.007234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.044 [2024-11-28 11:51:52.007249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.044 [2024-11-28 11:51:52.007263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.044 [2024-11-28 11:51:52.007292] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.044 qpair failed and we were unable to recover it. 00:27:32.044 [2024-11-28 11:51:52.017154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.044 [2024-11-28 11:51:52.017263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.044 [2024-11-28 11:51:52.017288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.044 [2024-11-28 11:51:52.017302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.044 [2024-11-28 11:51:52.017315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.044 [2024-11-28 11:51:52.017344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.044 qpair failed and we were unable to recover it. 00:27:32.044 [2024-11-28 11:51:52.027170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.044 [2024-11-28 11:51:52.027284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.044 [2024-11-28 11:51:52.027315] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.044 [2024-11-28 11:51:52.027330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.044 [2024-11-28 11:51:52.027343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.044 [2024-11-28 11:51:52.027372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.044 qpair failed and we were unable to recover it. 00:27:32.044 [2024-11-28 11:51:52.037273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.044 [2024-11-28 11:51:52.037383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.044 [2024-11-28 11:51:52.037408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.044 [2024-11-28 11:51:52.037422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.044 [2024-11-28 11:51:52.037435] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.044 [2024-11-28 11:51:52.037465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.044 qpair failed and we were unable to recover it. 00:27:32.044 [2024-11-28 11:51:52.047199] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.044 [2024-11-28 11:51:52.047330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.044 [2024-11-28 11:51:52.047355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.044 [2024-11-28 11:51:52.047370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.044 [2024-11-28 11:51:52.047384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.044 [2024-11-28 11:51:52.047413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.044 qpair failed and we were unable to recover it. 00:27:32.044 [2024-11-28 11:51:52.057290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.044 [2024-11-28 11:51:52.057407] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.044 [2024-11-28 11:51:52.057431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.044 [2024-11-28 11:51:52.057446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.044 [2024-11-28 11:51:52.057459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.044 [2024-11-28 11:51:52.057489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.045 qpair failed and we were unable to recover it. 00:27:32.045 [2024-11-28 11:51:52.067244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.045 [2024-11-28 11:51:52.067350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.045 [2024-11-28 11:51:52.067375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.045 [2024-11-28 11:51:52.067389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.045 [2024-11-28 11:51:52.067409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.045 [2024-11-28 11:51:52.067440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.045 qpair failed and we were unable to recover it. 00:27:32.045 [2024-11-28 11:51:52.077322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.045 [2024-11-28 11:51:52.077427] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.045 [2024-11-28 11:51:52.077453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.045 [2024-11-28 11:51:52.077467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.045 [2024-11-28 11:51:52.077480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.045 [2024-11-28 11:51:52.077510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.045 qpair failed and we were unable to recover it. 00:27:32.045 [2024-11-28 11:51:52.087320] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.045 [2024-11-28 11:51:52.087467] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.045 [2024-11-28 11:51:52.087493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.045 [2024-11-28 11:51:52.087508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.045 [2024-11-28 11:51:52.087521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.045 [2024-11-28 11:51:52.087560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.045 qpair failed and we were unable to recover it. 00:27:32.304 [2024-11-28 11:51:52.097336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.304 [2024-11-28 11:51:52.097444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.304 [2024-11-28 11:51:52.097470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.304 [2024-11-28 11:51:52.097484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.304 [2024-11-28 11:51:52.097497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.304 [2024-11-28 11:51:52.097535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.304 qpair failed and we were unable to recover it. 00:27:32.304 [2024-11-28 11:51:52.107379] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.304 [2024-11-28 11:51:52.107488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.304 [2024-11-28 11:51:52.107515] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.304 [2024-11-28 11:51:52.107540] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.304 [2024-11-28 11:51:52.107555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.304 [2024-11-28 11:51:52.107585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.304 qpair failed and we were unable to recover it. 00:27:32.304 [2024-11-28 11:51:52.117434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.304 [2024-11-28 11:51:52.117563] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.304 [2024-11-28 11:51:52.117589] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.304 [2024-11-28 11:51:52.117604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.304 [2024-11-28 11:51:52.117617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.304 [2024-11-28 11:51:52.117647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.304 qpair failed and we were unable to recover it. 00:27:32.304 [2024-11-28 11:51:52.127508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.304 [2024-11-28 11:51:52.127615] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.304 [2024-11-28 11:51:52.127641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.304 [2024-11-28 11:51:52.127655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.304 [2024-11-28 11:51:52.127669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.304 [2024-11-28 11:51:52.127697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.304 qpair failed and we were unable to recover it. 00:27:32.304 [2024-11-28 11:51:52.137447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.304 [2024-11-28 11:51:52.137559] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.304 [2024-11-28 11:51:52.137584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.304 [2024-11-28 11:51:52.137598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.304 [2024-11-28 11:51:52.137611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.304 [2024-11-28 11:51:52.137640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.304 qpair failed and we were unable to recover it. 00:27:32.304 [2024-11-28 11:51:52.147515] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.304 [2024-11-28 11:51:52.147691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.304 [2024-11-28 11:51:52.147718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.304 [2024-11-28 11:51:52.147733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.304 [2024-11-28 11:51:52.147750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.305 [2024-11-28 11:51:52.147782] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.305 qpair failed and we were unable to recover it. 00:27:32.305 [2024-11-28 11:51:52.157568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.305 [2024-11-28 11:51:52.157671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.305 [2024-11-28 11:51:52.157696] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.305 [2024-11-28 11:51:52.157711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.305 [2024-11-28 11:51:52.157730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.305 [2024-11-28 11:51:52.157773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.305 qpair failed and we were unable to recover it. 00:27:32.305 [2024-11-28 11:51:52.167541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.305 [2024-11-28 11:51:52.167660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.305 [2024-11-28 11:51:52.167686] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.305 [2024-11-28 11:51:52.167700] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.305 [2024-11-28 11:51:52.167714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.305 [2024-11-28 11:51:52.167742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.305 qpair failed and we were unable to recover it. 00:27:32.305 [2024-11-28 11:51:52.177600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.305 [2024-11-28 11:51:52.177717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.305 [2024-11-28 11:51:52.177741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.305 [2024-11-28 11:51:52.177756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.305 [2024-11-28 11:51:52.177770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.305 [2024-11-28 11:51:52.177800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.305 qpair failed and we were unable to recover it. 00:27:32.305 [2024-11-28 11:51:52.187609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.305 [2024-11-28 11:51:52.187717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.305 [2024-11-28 11:51:52.187743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.305 [2024-11-28 11:51:52.187757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.305 [2024-11-28 11:51:52.187771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.305 [2024-11-28 11:51:52.187812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.305 qpair failed and we were unable to recover it. 00:27:32.305 [2024-11-28 11:51:52.197647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.305 [2024-11-28 11:51:52.197772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.305 [2024-11-28 11:51:52.197797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.305 [2024-11-28 11:51:52.197811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.305 [2024-11-28 11:51:52.197824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.305 [2024-11-28 11:51:52.197853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.305 qpair failed and we were unable to recover it. 00:27:32.305 [2024-11-28 11:51:52.207660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.305 [2024-11-28 11:51:52.207761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.305 [2024-11-28 11:51:52.207787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.305 [2024-11-28 11:51:52.207802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.305 [2024-11-28 11:51:52.207815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.305 [2024-11-28 11:51:52.207843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.305 qpair failed and we were unable to recover it. 00:27:32.305 [2024-11-28 11:51:52.217819] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.305 [2024-11-28 11:51:52.217954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.305 [2024-11-28 11:51:52.217980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.305 [2024-11-28 11:51:52.217995] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.305 [2024-11-28 11:51:52.218008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.305 [2024-11-28 11:51:52.218038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.305 qpair failed and we were unable to recover it. 00:27:32.305 [2024-11-28 11:51:52.227811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.305 [2024-11-28 11:51:52.227916] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.305 [2024-11-28 11:51:52.227941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.305 [2024-11-28 11:51:52.227956] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.305 [2024-11-28 11:51:52.227969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.305 [2024-11-28 11:51:52.227998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.305 qpair failed and we were unable to recover it. 00:27:32.305 [2024-11-28 11:51:52.237796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.305 [2024-11-28 11:51:52.237945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.305 [2024-11-28 11:51:52.237970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.305 [2024-11-28 11:51:52.237985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.305 [2024-11-28 11:51:52.237998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.305 [2024-11-28 11:51:52.238026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.305 qpair failed and we were unable to recover it. 00:27:32.305 [2024-11-28 11:51:52.247791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.305 [2024-11-28 11:51:52.247897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.305 [2024-11-28 11:51:52.247923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.305 [2024-11-28 11:51:52.247945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.305 [2024-11-28 11:51:52.247959] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.305 [2024-11-28 11:51:52.247989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.305 qpair failed and we were unable to recover it. 00:27:32.305 [2024-11-28 11:51:52.257827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.305 [2024-11-28 11:51:52.257940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.305 [2024-11-28 11:51:52.257966] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.305 [2024-11-28 11:51:52.257981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.305 [2024-11-28 11:51:52.257994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.305 [2024-11-28 11:51:52.258023] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.305 qpair failed and we were unable to recover it. 00:27:32.305 [2024-11-28 11:51:52.267822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.305 [2024-11-28 11:51:52.267933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.305 [2024-11-28 11:51:52.267959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.305 [2024-11-28 11:51:52.267973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.305 [2024-11-28 11:51:52.267990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.305 [2024-11-28 11:51:52.268019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.305 qpair failed and we were unable to recover it. 00:27:32.305 [2024-11-28 11:51:52.277930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.305 [2024-11-28 11:51:52.278035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.305 [2024-11-28 11:51:52.278061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.305 [2024-11-28 11:51:52.278075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.305 [2024-11-28 11:51:52.278088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.305 [2024-11-28 11:51:52.278118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.305 qpair failed and we were unable to recover it. 00:27:32.305 [2024-11-28 11:51:52.287885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.306 [2024-11-28 11:51:52.287989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.306 [2024-11-28 11:51:52.288014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.306 [2024-11-28 11:51:52.288028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.306 [2024-11-28 11:51:52.288041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.306 [2024-11-28 11:51:52.288070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.306 qpair failed and we were unable to recover it. 00:27:32.306 [2024-11-28 11:51:52.297925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.306 [2024-11-28 11:51:52.298037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.306 [2024-11-28 11:51:52.298062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.306 [2024-11-28 11:51:52.298077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.306 [2024-11-28 11:51:52.298090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.306 [2024-11-28 11:51:52.298119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.306 qpair failed and we were unable to recover it. 00:27:32.306 [2024-11-28 11:51:52.307999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.306 [2024-11-28 11:51:52.308150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.306 [2024-11-28 11:51:52.308175] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.306 [2024-11-28 11:51:52.308190] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.306 [2024-11-28 11:51:52.308203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.306 [2024-11-28 11:51:52.308232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.306 qpair failed and we were unable to recover it. 00:27:32.306 [2024-11-28 11:51:52.318060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.306 [2024-11-28 11:51:52.318165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.306 [2024-11-28 11:51:52.318190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.306 [2024-11-28 11:51:52.318204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.306 [2024-11-28 11:51:52.318217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.306 [2024-11-28 11:51:52.318247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.306 qpair failed and we were unable to recover it. 00:27:32.306 [2024-11-28 11:51:52.328051] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.306 [2024-11-28 11:51:52.328155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.306 [2024-11-28 11:51:52.328180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.306 [2024-11-28 11:51:52.328195] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.306 [2024-11-28 11:51:52.328208] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.306 [2024-11-28 11:51:52.328237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.306 qpair failed and we were unable to recover it. 00:27:32.306 [2024-11-28 11:51:52.338074] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.306 [2024-11-28 11:51:52.338186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.306 [2024-11-28 11:51:52.338216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.306 [2024-11-28 11:51:52.338232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.306 [2024-11-28 11:51:52.338245] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.306 [2024-11-28 11:51:52.338274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.306 qpair failed and we were unable to recover it. 00:27:32.306 [2024-11-28 11:51:52.348152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.306 [2024-11-28 11:51:52.348255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.306 [2024-11-28 11:51:52.348280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.306 [2024-11-28 11:51:52.348294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.306 [2024-11-28 11:51:52.348308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.306 [2024-11-28 11:51:52.348336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.306 qpair failed and we were unable to recover it. 00:27:32.306 [2024-11-28 11:51:52.358115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.306 [2024-11-28 11:51:52.358243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.306 [2024-11-28 11:51:52.358268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.306 [2024-11-28 11:51:52.358282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.306 [2024-11-28 11:51:52.358295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.306 [2024-11-28 11:51:52.358324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.565 qpair failed and we were unable to recover it. 00:27:32.565 [2024-11-28 11:51:52.368175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.565 [2024-11-28 11:51:52.368323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.565 [2024-11-28 11:51:52.368348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.565 [2024-11-28 11:51:52.368362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.565 [2024-11-28 11:51:52.368375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.565 [2024-11-28 11:51:52.368404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.565 qpair failed and we were unable to recover it. 00:27:32.565 [2024-11-28 11:51:52.378134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.565 [2024-11-28 11:51:52.378275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.565 [2024-11-28 11:51:52.378300] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.565 [2024-11-28 11:51:52.378315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.565 [2024-11-28 11:51:52.378328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.565 [2024-11-28 11:51:52.378356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.565 qpair failed and we were unable to recover it. 00:27:32.565 [2024-11-28 11:51:52.388253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.565 [2024-11-28 11:51:52.388356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.565 [2024-11-28 11:51:52.388381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.565 [2024-11-28 11:51:52.388395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.565 [2024-11-28 11:51:52.388409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.565 [2024-11-28 11:51:52.388438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.565 qpair failed and we were unable to recover it. 00:27:32.565 [2024-11-28 11:51:52.398278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.565 [2024-11-28 11:51:52.398377] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.565 [2024-11-28 11:51:52.398403] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.565 [2024-11-28 11:51:52.398417] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.565 [2024-11-28 11:51:52.398430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.565 [2024-11-28 11:51:52.398460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.565 qpair failed and we were unable to recover it. 00:27:32.565 [2024-11-28 11:51:52.408197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.565 [2024-11-28 11:51:52.408295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.565 [2024-11-28 11:51:52.408320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.565 [2024-11-28 11:51:52.408334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.565 [2024-11-28 11:51:52.408347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.565 [2024-11-28 11:51:52.408376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.565 qpair failed and we were unable to recover it. 00:27:32.565 [2024-11-28 11:51:52.418340] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.565 [2024-11-28 11:51:52.418440] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.565 [2024-11-28 11:51:52.418465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.565 [2024-11-28 11:51:52.418479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.565 [2024-11-28 11:51:52.418492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.565 [2024-11-28 11:51:52.418521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.565 qpair failed and we were unable to recover it. 00:27:32.566 [2024-11-28 11:51:52.428332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.566 [2024-11-28 11:51:52.428448] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.566 [2024-11-28 11:51:52.428481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.566 [2024-11-28 11:51:52.428496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.566 [2024-11-28 11:51:52.428509] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.566 [2024-11-28 11:51:52.428547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.566 qpair failed and we were unable to recover it. 00:27:32.566 [2024-11-28 11:51:52.438345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.566 [2024-11-28 11:51:52.438460] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.566 [2024-11-28 11:51:52.438485] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.566 [2024-11-28 11:51:52.438500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.566 [2024-11-28 11:51:52.438513] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.566 [2024-11-28 11:51:52.438549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.566 qpair failed and we were unable to recover it. 00:27:32.566 [2024-11-28 11:51:52.448330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.566 [2024-11-28 11:51:52.448432] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.566 [2024-11-28 11:51:52.448457] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.566 [2024-11-28 11:51:52.448471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.566 [2024-11-28 11:51:52.448485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.566 [2024-11-28 11:51:52.448514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.566 qpair failed and we were unable to recover it. 00:27:32.566 [2024-11-28 11:51:52.458370] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.566 [2024-11-28 11:51:52.458476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.566 [2024-11-28 11:51:52.458500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.566 [2024-11-28 11:51:52.458515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.566 [2024-11-28 11:51:52.458536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.566 [2024-11-28 11:51:52.458577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.566 qpair failed and we were unable to recover it. 00:27:32.566 [2024-11-28 11:51:52.468384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.566 [2024-11-28 11:51:52.468486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.566 [2024-11-28 11:51:52.468511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.566 [2024-11-28 11:51:52.468532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.566 [2024-11-28 11:51:52.468547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.566 [2024-11-28 11:51:52.468583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.566 qpair failed and we were unable to recover it. 00:27:32.566 [2024-11-28 11:51:52.478412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.566 [2024-11-28 11:51:52.478514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.566 [2024-11-28 11:51:52.478547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.566 [2024-11-28 11:51:52.478562] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.566 [2024-11-28 11:51:52.478575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.566 [2024-11-28 11:51:52.478604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.566 qpair failed and we were unable to recover it. 00:27:32.566 [2024-11-28 11:51:52.488449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.566 [2024-11-28 11:51:52.488560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.566 [2024-11-28 11:51:52.488586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.566 [2024-11-28 11:51:52.488601] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.566 [2024-11-28 11:51:52.488614] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.566 [2024-11-28 11:51:52.488643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.566 qpair failed and we were unable to recover it. 00:27:32.566 [2024-11-28 11:51:52.498489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.566 [2024-11-28 11:51:52.498651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.566 [2024-11-28 11:51:52.498679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.566 [2024-11-28 11:51:52.498694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.566 [2024-11-28 11:51:52.498708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.566 [2024-11-28 11:51:52.498737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.566 qpair failed and we were unable to recover it. 00:27:32.566 [2024-11-28 11:51:52.508563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.566 [2024-11-28 11:51:52.508697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.566 [2024-11-28 11:51:52.508723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.566 [2024-11-28 11:51:52.508738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.566 [2024-11-28 11:51:52.508750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.566 [2024-11-28 11:51:52.508780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.566 qpair failed and we were unable to recover it. 00:27:32.566 [2024-11-28 11:51:52.518554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.566 [2024-11-28 11:51:52.518656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.566 [2024-11-28 11:51:52.518687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.566 [2024-11-28 11:51:52.518702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.566 [2024-11-28 11:51:52.518716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.566 [2024-11-28 11:51:52.518744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.566 qpair failed and we were unable to recover it. 00:27:32.566 [2024-11-28 11:51:52.528658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.566 [2024-11-28 11:51:52.528758] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.566 [2024-11-28 11:51:52.528783] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.566 [2024-11-28 11:51:52.528797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.566 [2024-11-28 11:51:52.528811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.566 [2024-11-28 11:51:52.528839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.566 qpair failed and we were unable to recover it. 00:27:32.566 [2024-11-28 11:51:52.538643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.566 [2024-11-28 11:51:52.538750] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.566 [2024-11-28 11:51:52.538776] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.566 [2024-11-28 11:51:52.538790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.566 [2024-11-28 11:51:52.538803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.566 [2024-11-28 11:51:52.538833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.566 qpair failed and we were unable to recover it. 00:27:32.566 [2024-11-28 11:51:52.548615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.566 [2024-11-28 11:51:52.548716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.566 [2024-11-28 11:51:52.548741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.566 [2024-11-28 11:51:52.548756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.566 [2024-11-28 11:51:52.548768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.566 [2024-11-28 11:51:52.548799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.566 qpair failed and we were unable to recover it. 00:27:32.566 [2024-11-28 11:51:52.558659] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.566 [2024-11-28 11:51:52.558778] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.567 [2024-11-28 11:51:52.558804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.567 [2024-11-28 11:51:52.558819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.567 [2024-11-28 11:51:52.558837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.567 [2024-11-28 11:51:52.558869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.567 qpair failed and we were unable to recover it. 00:27:32.567 [2024-11-28 11:51:52.568712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.567 [2024-11-28 11:51:52.568819] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.567 [2024-11-28 11:51:52.568853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.567 [2024-11-28 11:51:52.568867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.567 [2024-11-28 11:51:52.568880] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.567 [2024-11-28 11:51:52.568911] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.567 qpair failed and we were unable to recover it. 00:27:32.567 [2024-11-28 11:51:52.578849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.567 [2024-11-28 11:51:52.578983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.567 [2024-11-28 11:51:52.579009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.567 [2024-11-28 11:51:52.579023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.567 [2024-11-28 11:51:52.579036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.567 [2024-11-28 11:51:52.579065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.567 qpair failed and we were unable to recover it. 00:27:32.567 [2024-11-28 11:51:52.588747] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.567 [2024-11-28 11:51:52.588851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.567 [2024-11-28 11:51:52.588876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.567 [2024-11-28 11:51:52.588890] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.567 [2024-11-28 11:51:52.588902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.567 [2024-11-28 11:51:52.588933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.567 qpair failed and we were unable to recover it. 00:27:32.567 [2024-11-28 11:51:52.598872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.567 [2024-11-28 11:51:52.598999] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.567 [2024-11-28 11:51:52.599025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.567 [2024-11-28 11:51:52.599039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.567 [2024-11-28 11:51:52.599052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.567 [2024-11-28 11:51:52.599081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.567 qpair failed and we were unable to recover it. 00:27:32.567 [2024-11-28 11:51:52.608854] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.567 [2024-11-28 11:51:52.608967] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.567 [2024-11-28 11:51:52.608993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.567 [2024-11-28 11:51:52.609007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.567 [2024-11-28 11:51:52.609021] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.567 [2024-11-28 11:51:52.609051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.567 qpair failed and we were unable to recover it. 00:27:32.567 [2024-11-28 11:51:52.618868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.567 [2024-11-28 11:51:52.619026] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.567 [2024-11-28 11:51:52.619052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.567 [2024-11-28 11:51:52.619067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.567 [2024-11-28 11:51:52.619080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.567 [2024-11-28 11:51:52.619109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.567 qpair failed and we were unable to recover it. 00:27:32.827 [2024-11-28 11:51:52.628910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.827 [2024-11-28 11:51:52.629011] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.827 [2024-11-28 11:51:52.629038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.827 [2024-11-28 11:51:52.629052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.827 [2024-11-28 11:51:52.629065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.827 [2024-11-28 11:51:52.629094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.827 qpair failed and we were unable to recover it. 00:27:32.827 [2024-11-28 11:51:52.638905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.827 [2024-11-28 11:51:52.639036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.827 [2024-11-28 11:51:52.639062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.827 [2024-11-28 11:51:52.639076] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.827 [2024-11-28 11:51:52.639089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.827 [2024-11-28 11:51:52.639118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.827 qpair failed and we were unable to recover it. 00:27:32.827 [2024-11-28 11:51:52.648983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.827 [2024-11-28 11:51:52.649086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.827 [2024-11-28 11:51:52.649111] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.827 [2024-11-28 11:51:52.649126] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.827 [2024-11-28 11:51:52.649145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.827 [2024-11-28 11:51:52.649177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.827 qpair failed and we were unable to recover it. 00:27:32.827 [2024-11-28 11:51:52.658947] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.827 [2024-11-28 11:51:52.659056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.827 [2024-11-28 11:51:52.659082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.827 [2024-11-28 11:51:52.659096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.827 [2024-11-28 11:51:52.659109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.827 [2024-11-28 11:51:52.659138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.827 qpair failed and we were unable to recover it. 00:27:32.827 [2024-11-28 11:51:52.668992] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.827 [2024-11-28 11:51:52.669097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.827 [2024-11-28 11:51:52.669123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.827 [2024-11-28 11:51:52.669137] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.827 [2024-11-28 11:51:52.669150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.827 [2024-11-28 11:51:52.669191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.827 qpair failed and we were unable to recover it. 00:27:32.827 [2024-11-28 11:51:52.679040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.827 [2024-11-28 11:51:52.679148] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.827 [2024-11-28 11:51:52.679173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.827 [2024-11-28 11:51:52.679188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.827 [2024-11-28 11:51:52.679200] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.827 [2024-11-28 11:51:52.679228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.827 qpair failed and we were unable to recover it. 00:27:32.827 [2024-11-28 11:51:52.689047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.827 [2024-11-28 11:51:52.689180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.827 [2024-11-28 11:51:52.689205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.827 [2024-11-28 11:51:52.689220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.827 [2024-11-28 11:51:52.689233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.827 [2024-11-28 11:51:52.689263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.827 qpair failed and we were unable to recover it. 00:27:32.827 [2024-11-28 11:51:52.699185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.827 [2024-11-28 11:51:52.699316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.827 [2024-11-28 11:51:52.699342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.827 [2024-11-28 11:51:52.699356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.827 [2024-11-28 11:51:52.699369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.827 [2024-11-28 11:51:52.699398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.827 qpair failed and we were unable to recover it. 00:27:32.827 [2024-11-28 11:51:52.709113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.827 [2024-11-28 11:51:52.709257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.827 [2024-11-28 11:51:52.709283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.827 [2024-11-28 11:51:52.709297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.827 [2024-11-28 11:51:52.709311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.827 [2024-11-28 11:51:52.709340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.827 qpair failed and we were unable to recover it. 00:27:32.827 [2024-11-28 11:51:52.719123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.827 [2024-11-28 11:51:52.719221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.827 [2024-11-28 11:51:52.719246] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.827 [2024-11-28 11:51:52.719261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.827 [2024-11-28 11:51:52.719273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.827 [2024-11-28 11:51:52.719303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.827 qpair failed and we were unable to recover it. 00:27:32.827 [2024-11-28 11:51:52.729137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.827 [2024-11-28 11:51:52.729237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.827 [2024-11-28 11:51:52.729262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.827 [2024-11-28 11:51:52.729277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.827 [2024-11-28 11:51:52.729290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.827 [2024-11-28 11:51:52.729318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.827 qpair failed and we were unable to recover it. 00:27:32.828 [2024-11-28 11:51:52.739179] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.828 [2024-11-28 11:51:52.739287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.828 [2024-11-28 11:51:52.739313] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.828 [2024-11-28 11:51:52.739333] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.828 [2024-11-28 11:51:52.739347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.828 [2024-11-28 11:51:52.739377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.828 qpair failed and we were unable to recover it. 00:27:32.828 [2024-11-28 11:51:52.749259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.828 [2024-11-28 11:51:52.749377] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.828 [2024-11-28 11:51:52.749405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.828 [2024-11-28 11:51:52.749420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.828 [2024-11-28 11:51:52.749438] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.828 [2024-11-28 11:51:52.749483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.828 qpair failed and we were unable to recover it. 00:27:32.828 [2024-11-28 11:51:52.759252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.828 [2024-11-28 11:51:52.759403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.828 [2024-11-28 11:51:52.759429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.828 [2024-11-28 11:51:52.759443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.828 [2024-11-28 11:51:52.759457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.828 [2024-11-28 11:51:52.759488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.828 qpair failed and we were unable to recover it. 00:27:32.828 [2024-11-28 11:51:52.769379] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.828 [2024-11-28 11:51:52.769516] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.828 [2024-11-28 11:51:52.769550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.828 [2024-11-28 11:51:52.769566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.828 [2024-11-28 11:51:52.769579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.828 [2024-11-28 11:51:52.769610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.828 qpair failed and we were unable to recover it. 00:27:32.828 [2024-11-28 11:51:52.779289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.828 [2024-11-28 11:51:52.779392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.828 [2024-11-28 11:51:52.779418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.828 [2024-11-28 11:51:52.779432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.828 [2024-11-28 11:51:52.779445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.828 [2024-11-28 11:51:52.779485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.828 qpair failed and we were unable to recover it. 00:27:32.828 [2024-11-28 11:51:52.789305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.828 [2024-11-28 11:51:52.789430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.828 [2024-11-28 11:51:52.789455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.828 [2024-11-28 11:51:52.789470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.828 [2024-11-28 11:51:52.789483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.828 [2024-11-28 11:51:52.789512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.828 qpair failed and we were unable to recover it. 00:27:32.828 [2024-11-28 11:51:52.799374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.828 [2024-11-28 11:51:52.799483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.828 [2024-11-28 11:51:52.799510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.828 [2024-11-28 11:51:52.799531] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.828 [2024-11-28 11:51:52.799550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.828 [2024-11-28 11:51:52.799581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.828 qpair failed and we were unable to recover it. 00:27:32.828 [2024-11-28 11:51:52.809390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.828 [2024-11-28 11:51:52.809499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.828 [2024-11-28 11:51:52.809531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.828 [2024-11-28 11:51:52.809548] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.828 [2024-11-28 11:51:52.809561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.828 [2024-11-28 11:51:52.809590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.828 qpair failed and we were unable to recover it. 00:27:32.828 [2024-11-28 11:51:52.819503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.828 [2024-11-28 11:51:52.819638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.828 [2024-11-28 11:51:52.819663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.828 [2024-11-28 11:51:52.819678] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.828 [2024-11-28 11:51:52.819691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.828 [2024-11-28 11:51:52.819720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.828 qpair failed and we were unable to recover it. 00:27:32.828 [2024-11-28 11:51:52.829446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.828 [2024-11-28 11:51:52.829569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.828 [2024-11-28 11:51:52.829595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.828 [2024-11-28 11:51:52.829617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.828 [2024-11-28 11:51:52.829631] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.828 [2024-11-28 11:51:52.829673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.828 qpair failed and we were unable to recover it. 00:27:32.828 [2024-11-28 11:51:52.839512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.828 [2024-11-28 11:51:52.839633] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.828 [2024-11-28 11:51:52.839657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.828 [2024-11-28 11:51:52.839671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.828 [2024-11-28 11:51:52.839687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.828 [2024-11-28 11:51:52.839716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.828 qpair failed and we were unable to recover it. 00:27:32.828 [2024-11-28 11:51:52.849586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.828 [2024-11-28 11:51:52.849720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.828 [2024-11-28 11:51:52.849746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.828 [2024-11-28 11:51:52.849761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.828 [2024-11-28 11:51:52.849773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.828 [2024-11-28 11:51:52.849802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.828 qpair failed and we were unable to recover it. 00:27:32.828 [2024-11-28 11:51:52.859575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.828 [2024-11-28 11:51:52.859697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.828 [2024-11-28 11:51:52.859723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.828 [2024-11-28 11:51:52.859737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.828 [2024-11-28 11:51:52.859750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.828 [2024-11-28 11:51:52.859781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.828 qpair failed and we were unable to recover it. 00:27:32.828 [2024-11-28 11:51:52.869566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.828 [2024-11-28 11:51:52.869674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.828 [2024-11-28 11:51:52.869699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.829 [2024-11-28 11:51:52.869713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.829 [2024-11-28 11:51:52.869727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.829 [2024-11-28 11:51:52.869756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.829 qpair failed and we were unable to recover it. 00:27:32.829 [2024-11-28 11:51:52.879573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.829 [2024-11-28 11:51:52.879681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.829 [2024-11-28 11:51:52.879706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.829 [2024-11-28 11:51:52.879721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.829 [2024-11-28 11:51:52.879734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:32.829 [2024-11-28 11:51:52.879763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:32.829 qpair failed and we were unable to recover it. 00:27:33.087 [2024-11-28 11:51:52.889611] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.087 [2024-11-28 11:51:52.889714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.087 [2024-11-28 11:51:52.889740] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.087 [2024-11-28 11:51:52.889754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.087 [2024-11-28 11:51:52.889767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:33.087 [2024-11-28 11:51:52.889798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:33.087 qpair failed and we were unable to recover it. 00:27:33.087 [2024-11-28 11:51:52.899673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.087 [2024-11-28 11:51:52.899790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.087 [2024-11-28 11:51:52.899815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.087 [2024-11-28 11:51:52.899829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.087 [2024-11-28 11:51:52.899843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:33.087 [2024-11-28 11:51:52.899872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:33.087 qpair failed and we were unable to recover it. 00:27:33.087 [2024-11-28 11:51:52.909714] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.087 [2024-11-28 11:51:52.909831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.087 [2024-11-28 11:51:52.909856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.087 [2024-11-28 11:51:52.909870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.087 [2024-11-28 11:51:52.909884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:33.087 [2024-11-28 11:51:52.909925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:33.087 qpair failed and we were unable to recover it. 00:27:33.087 [2024-11-28 11:51:52.919704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.087 [2024-11-28 11:51:52.919811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.087 [2024-11-28 11:51:52.919841] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.087 [2024-11-28 11:51:52.919857] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.087 [2024-11-28 11:51:52.919870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ffa30000b90 00:27:33.087 [2024-11-28 11:51:52.919898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:33.087 qpair failed and we were unable to recover it. 00:27:33.087 [2024-11-28 11:51:52.920038] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:27:33.087 A controller has encountered a failure and is being reset. 00:27:33.087 Controller properly reset. 00:27:33.087 Initializing NVMe Controllers 00:27:33.087 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:33.087 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:33.087 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:27:33.087 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:27:33.087 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:27:33.087 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:27:33.087 Initialization complete. Launching workers. 00:27:33.087 Starting thread on core 1 00:27:33.087 Starting thread on core 2 00:27:33.087 Starting thread on core 3 00:27:33.087 Starting thread on core 0 00:27:33.087 11:51:52 -- host/target_disconnect.sh@59 -- # sync 00:27:33.087 00:27:33.087 real 0m11.495s 00:27:33.087 user 0m20.843s 00:27:33.087 sys 0m5.453s 00:27:33.087 11:51:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:33.088 11:51:52 -- common/autotest_common.sh@10 -- # set +x 00:27:33.088 ************************************ 00:27:33.088 END TEST nvmf_target_disconnect_tc2 00:27:33.088 ************************************ 00:27:33.088 11:51:52 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:27:33.088 11:51:52 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:27:33.088 11:51:52 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:27:33.088 11:51:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:33.088 11:51:52 -- nvmf/common.sh@116 -- # sync 00:27:33.088 11:51:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:33.088 11:51:53 -- nvmf/common.sh@119 -- # set +e 00:27:33.088 11:51:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:33.088 11:51:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:33.088 rmmod nvme_tcp 00:27:33.088 rmmod nvme_fabrics 00:27:33.088 rmmod nvme_keyring 00:27:33.088 11:51:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:33.088 11:51:53 -- nvmf/common.sh@123 -- # set -e 00:27:33.088 11:51:53 -- nvmf/common.sh@124 -- # return 0 00:27:33.088 11:51:53 -- nvmf/common.sh@477 -- # '[' -n 3930813 ']' 00:27:33.088 11:51:53 -- nvmf/common.sh@478 -- # killprocess 3930813 00:27:33.088 11:51:53 -- common/autotest_common.sh@936 -- # '[' -z 3930813 ']' 00:27:33.088 11:51:53 -- common/autotest_common.sh@940 -- # kill -0 3930813 00:27:33.088 11:51:53 -- common/autotest_common.sh@941 -- # uname 00:27:33.088 11:51:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:33.088 11:51:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3930813 00:27:33.088 11:51:53 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:27:33.088 11:51:53 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:27:33.088 11:51:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3930813' 00:27:33.088 killing process with pid 3930813 00:27:33.088 11:51:53 -- common/autotest_common.sh@955 -- # kill 3930813 00:27:33.088 11:51:53 -- common/autotest_common.sh@960 -- # wait 3930813 00:27:33.349 11:51:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:33.349 11:51:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:33.349 11:51:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:33.349 11:51:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:33.349 11:51:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:33.349 11:51:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:33.349 11:51:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:33.349 11:51:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:35.885 11:51:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:35.885 00:27:35.885 real 0m16.435s 00:27:35.885 user 0m46.981s 00:27:35.885 sys 0m7.496s 00:27:35.885 11:51:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:35.885 11:51:55 -- common/autotest_common.sh@10 -- # set +x 00:27:35.885 ************************************ 00:27:35.885 END TEST nvmf_target_disconnect 00:27:35.885 ************************************ 00:27:35.885 11:51:55 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:27:35.885 11:51:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:35.885 11:51:55 -- common/autotest_common.sh@10 -- # set +x 00:27:35.885 11:51:55 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:27:35.885 00:27:35.885 real 21m35.269s 00:27:35.885 user 62m13.765s 00:27:35.885 sys 5m10.060s 00:27:35.885 11:51:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:35.885 11:51:55 -- common/autotest_common.sh@10 -- # set +x 00:27:35.885 ************************************ 00:27:35.885 END TEST nvmf_tcp 00:27:35.885 ************************************ 00:27:35.885 11:51:55 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:27:35.885 11:51:55 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:35.885 11:51:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:35.885 11:51:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:35.885 11:51:55 -- common/autotest_common.sh@10 -- # set +x 00:27:35.885 ************************************ 00:27:35.885 START TEST spdkcli_nvmf_tcp 00:27:35.885 ************************************ 00:27:35.885 11:51:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:35.885 * Looking for test storage... 00:27:35.885 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:27:35.885 11:51:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:35.885 11:51:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:35.885 11:51:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:35.885 11:51:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:35.885 11:51:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:35.885 11:51:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:35.885 11:51:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:35.885 11:51:55 -- scripts/common.sh@335 -- # IFS=.-: 00:27:35.885 11:51:55 -- scripts/common.sh@335 -- # read -ra ver1 00:27:35.885 11:51:55 -- scripts/common.sh@336 -- # IFS=.-: 00:27:35.885 11:51:55 -- scripts/common.sh@336 -- # read -ra ver2 00:27:35.885 11:51:55 -- scripts/common.sh@337 -- # local 'op=<' 00:27:35.885 11:51:55 -- scripts/common.sh@339 -- # ver1_l=2 00:27:35.885 11:51:55 -- scripts/common.sh@340 -- # ver2_l=1 00:27:35.885 11:51:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:35.885 11:51:55 -- scripts/common.sh@343 -- # case "$op" in 00:27:35.885 11:51:55 -- scripts/common.sh@344 -- # : 1 00:27:35.885 11:51:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:35.885 11:51:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:35.885 11:51:55 -- scripts/common.sh@364 -- # decimal 1 00:27:35.885 11:51:55 -- scripts/common.sh@352 -- # local d=1 00:27:35.885 11:51:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:35.885 11:51:55 -- scripts/common.sh@354 -- # echo 1 00:27:35.885 11:51:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:35.885 11:51:55 -- scripts/common.sh@365 -- # decimal 2 00:27:35.885 11:51:55 -- scripts/common.sh@352 -- # local d=2 00:27:35.885 11:51:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:35.885 11:51:55 -- scripts/common.sh@354 -- # echo 2 00:27:35.885 11:51:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:35.885 11:51:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:35.885 11:51:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:35.885 11:51:55 -- scripts/common.sh@367 -- # return 0 00:27:35.885 11:51:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:35.885 11:51:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:35.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:35.885 --rc genhtml_branch_coverage=1 00:27:35.885 --rc genhtml_function_coverage=1 00:27:35.885 --rc genhtml_legend=1 00:27:35.885 --rc geninfo_all_blocks=1 00:27:35.885 --rc geninfo_unexecuted_blocks=1 00:27:35.885 00:27:35.885 ' 00:27:35.885 11:51:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:35.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:35.885 --rc genhtml_branch_coverage=1 00:27:35.885 --rc genhtml_function_coverage=1 00:27:35.885 --rc genhtml_legend=1 00:27:35.885 --rc geninfo_all_blocks=1 00:27:35.885 --rc geninfo_unexecuted_blocks=1 00:27:35.885 00:27:35.885 ' 00:27:35.885 11:51:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:35.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:35.885 --rc genhtml_branch_coverage=1 00:27:35.885 --rc genhtml_function_coverage=1 00:27:35.885 --rc genhtml_legend=1 00:27:35.885 --rc geninfo_all_blocks=1 00:27:35.885 --rc geninfo_unexecuted_blocks=1 00:27:35.885 00:27:35.885 ' 00:27:35.885 11:51:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:35.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:35.885 --rc genhtml_branch_coverage=1 00:27:35.885 --rc genhtml_function_coverage=1 00:27:35.885 --rc genhtml_legend=1 00:27:35.885 --rc geninfo_all_blocks=1 00:27:35.885 --rc geninfo_unexecuted_blocks=1 00:27:35.885 00:27:35.885 ' 00:27:35.885 11:51:55 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:27:35.885 11:51:55 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:27:35.885 11:51:55 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:27:35.885 11:51:55 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:35.885 11:51:55 -- nvmf/common.sh@7 -- # uname -s 00:27:35.885 11:51:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:35.885 11:51:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:35.885 11:51:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:35.885 11:51:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:35.885 11:51:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:35.885 11:51:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:35.885 11:51:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:35.885 11:51:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:35.885 11:51:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:35.885 11:51:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:35.885 11:51:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:35.885 11:51:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:35.885 11:51:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:35.885 11:51:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:35.885 11:51:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:35.885 11:51:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:35.885 11:51:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:35.885 11:51:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:35.885 11:51:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:35.885 11:51:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:35.885 11:51:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:35.885 11:51:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:35.885 11:51:55 -- paths/export.sh@5 -- # export PATH 00:27:35.885 11:51:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:35.885 11:51:55 -- nvmf/common.sh@46 -- # : 0 00:27:35.885 11:51:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:35.885 11:51:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:35.885 11:51:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:35.886 11:51:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:35.886 11:51:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:35.886 11:51:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:35.886 11:51:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:35.886 11:51:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:35.886 11:51:55 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:27:35.886 11:51:55 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:27:35.886 11:51:55 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:27:35.886 11:51:55 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:27:35.886 11:51:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:35.886 11:51:55 -- common/autotest_common.sh@10 -- # set +x 00:27:35.886 11:51:55 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:27:35.886 11:51:55 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=3932048 00:27:35.886 11:51:55 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:27:35.886 11:51:55 -- spdkcli/common.sh@34 -- # waitforlisten 3932048 00:27:35.886 11:51:55 -- common/autotest_common.sh@829 -- # '[' -z 3932048 ']' 00:27:35.886 11:51:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:35.886 11:51:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:35.886 11:51:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:35.886 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:35.886 11:51:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:35.886 11:51:55 -- common/autotest_common.sh@10 -- # set +x 00:27:35.886 [2024-11-28 11:51:55.690809] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:35.886 [2024-11-28 11:51:55.690895] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3932048 ] 00:27:35.886 EAL: No free 2048 kB hugepages reported on node 1 00:27:35.886 [2024-11-28 11:51:55.747894] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:35.886 [2024-11-28 11:51:55.860804] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:35.886 [2024-11-28 11:51:55.861011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:35.886 [2024-11-28 11:51:55.861018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:36.818 11:51:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:36.818 11:51:56 -- common/autotest_common.sh@862 -- # return 0 00:27:36.818 11:51:56 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:27:36.818 11:51:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:36.818 11:51:56 -- common/autotest_common.sh@10 -- # set +x 00:27:36.818 11:51:56 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:27:36.818 11:51:56 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:27:36.818 11:51:56 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:27:36.818 11:51:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:36.818 11:51:56 -- common/autotest_common.sh@10 -- # set +x 00:27:36.818 11:51:56 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:27:36.818 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:27:36.818 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:27:36.818 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:27:36.818 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:27:36.818 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:27:36.818 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:27:36.818 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:36.818 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:36.818 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:27:36.818 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:27:36.818 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:27:36.818 ' 00:27:37.077 [2024-11-28 11:51:57.068390] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:39.604 [2024-11-28 11:51:59.236289] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:40.535 [2024-11-28 11:52:00.476858] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:27:43.062 [2024-11-28 11:52:02.764034] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:27:44.958 [2024-11-28 11:52:04.746701] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:27:46.338 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:27:46.338 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:27:46.338 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:27:46.338 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:27:46.338 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:27:46.338 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:27:46.338 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:27:46.338 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:46.338 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:46.338 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:27:46.338 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:27:46.338 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:27:46.338 11:52:06 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:27:46.338 11:52:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:46.338 11:52:06 -- common/autotest_common.sh@10 -- # set +x 00:27:46.338 11:52:06 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:27:46.338 11:52:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:46.338 11:52:06 -- common/autotest_common.sh@10 -- # set +x 00:27:46.338 11:52:06 -- spdkcli/nvmf.sh@69 -- # check_match 00:27:46.338 11:52:06 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:27:46.903 11:52:06 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:27:46.903 11:52:06 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:27:46.903 11:52:06 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:27:46.903 11:52:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:46.903 11:52:06 -- common/autotest_common.sh@10 -- # set +x 00:27:46.903 11:52:06 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:27:46.903 11:52:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:46.903 11:52:06 -- common/autotest_common.sh@10 -- # set +x 00:27:46.903 11:52:06 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:27:46.903 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:27:46.903 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:27:46.903 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:27:46.903 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:27:46.903 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:27:46.903 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:27:46.903 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:27:46.903 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:27:46.903 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:27:46.903 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:27:46.903 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:27:46.903 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:27:46.903 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:27:46.903 ' 00:27:52.167 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:27:52.167 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:27:52.167 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:27:52.167 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:27:52.167 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:27:52.167 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:27:52.167 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:27:52.167 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:27:52.167 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:27:52.167 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:27:52.167 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:27:52.167 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:27:52.167 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:27:52.167 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:27:52.167 11:52:12 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:27:52.167 11:52:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:52.167 11:52:12 -- common/autotest_common.sh@10 -- # set +x 00:27:52.167 11:52:12 -- spdkcli/nvmf.sh@90 -- # killprocess 3932048 00:27:52.167 11:52:12 -- common/autotest_common.sh@936 -- # '[' -z 3932048 ']' 00:27:52.167 11:52:12 -- common/autotest_common.sh@940 -- # kill -0 3932048 00:27:52.167 11:52:12 -- common/autotest_common.sh@941 -- # uname 00:27:52.167 11:52:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:52.167 11:52:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3932048 00:27:52.426 11:52:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:52.426 11:52:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:52.426 11:52:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3932048' 00:27:52.426 killing process with pid 3932048 00:27:52.426 11:52:12 -- common/autotest_common.sh@955 -- # kill 3932048 00:27:52.426 [2024-11-28 11:52:12.238673] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:52.426 11:52:12 -- common/autotest_common.sh@960 -- # wait 3932048 00:27:52.685 11:52:12 -- spdkcli/nvmf.sh@1 -- # cleanup 00:27:52.685 11:52:12 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:27:52.685 11:52:12 -- spdkcli/common.sh@13 -- # '[' -n 3932048 ']' 00:27:52.685 11:52:12 -- spdkcli/common.sh@14 -- # killprocess 3932048 00:27:52.685 11:52:12 -- common/autotest_common.sh@936 -- # '[' -z 3932048 ']' 00:27:52.685 11:52:12 -- common/autotest_common.sh@940 -- # kill -0 3932048 00:27:52.685 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3932048) - No such process 00:27:52.685 11:52:12 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3932048 is not found' 00:27:52.685 Process with pid 3932048 is not found 00:27:52.685 11:52:12 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:27:52.685 11:52:12 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:27:52.685 11:52:12 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:27:52.685 00:27:52.685 real 0m17.023s 00:27:52.685 user 0m36.174s 00:27:52.685 sys 0m0.797s 00:27:52.685 11:52:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:52.685 11:52:12 -- common/autotest_common.sh@10 -- # set +x 00:27:52.685 ************************************ 00:27:52.685 END TEST spdkcli_nvmf_tcp 00:27:52.685 ************************************ 00:27:52.685 11:52:12 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:27:52.685 11:52:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:52.685 11:52:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:52.685 11:52:12 -- common/autotest_common.sh@10 -- # set +x 00:27:52.685 ************************************ 00:27:52.685 START TEST nvmf_identify_passthru 00:27:52.685 ************************************ 00:27:52.685 11:52:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:27:52.685 * Looking for test storage... 00:27:52.685 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:27:52.685 11:52:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:52.685 11:52:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:52.685 11:52:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:52.685 11:52:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:52.685 11:52:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:52.685 11:52:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:52.685 11:52:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:52.685 11:52:12 -- scripts/common.sh@335 -- # IFS=.-: 00:27:52.685 11:52:12 -- scripts/common.sh@335 -- # read -ra ver1 00:27:52.685 11:52:12 -- scripts/common.sh@336 -- # IFS=.-: 00:27:52.685 11:52:12 -- scripts/common.sh@336 -- # read -ra ver2 00:27:52.685 11:52:12 -- scripts/common.sh@337 -- # local 'op=<' 00:27:52.685 11:52:12 -- scripts/common.sh@339 -- # ver1_l=2 00:27:52.685 11:52:12 -- scripts/common.sh@340 -- # ver2_l=1 00:27:52.685 11:52:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:52.685 11:52:12 -- scripts/common.sh@343 -- # case "$op" in 00:27:52.685 11:52:12 -- scripts/common.sh@344 -- # : 1 00:27:52.685 11:52:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:52.685 11:52:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:52.685 11:52:12 -- scripts/common.sh@364 -- # decimal 1 00:27:52.685 11:52:12 -- scripts/common.sh@352 -- # local d=1 00:27:52.685 11:52:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:52.685 11:52:12 -- scripts/common.sh@354 -- # echo 1 00:27:52.685 11:52:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:52.685 11:52:12 -- scripts/common.sh@365 -- # decimal 2 00:27:52.685 11:52:12 -- scripts/common.sh@352 -- # local d=2 00:27:52.686 11:52:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:52.686 11:52:12 -- scripts/common.sh@354 -- # echo 2 00:27:52.686 11:52:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:52.686 11:52:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:52.686 11:52:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:52.686 11:52:12 -- scripts/common.sh@367 -- # return 0 00:27:52.686 11:52:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:52.686 11:52:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:52.686 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:52.686 --rc genhtml_branch_coverage=1 00:27:52.686 --rc genhtml_function_coverage=1 00:27:52.686 --rc genhtml_legend=1 00:27:52.686 --rc geninfo_all_blocks=1 00:27:52.686 --rc geninfo_unexecuted_blocks=1 00:27:52.686 00:27:52.686 ' 00:27:52.686 11:52:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:52.686 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:52.686 --rc genhtml_branch_coverage=1 00:27:52.686 --rc genhtml_function_coverage=1 00:27:52.686 --rc genhtml_legend=1 00:27:52.686 --rc geninfo_all_blocks=1 00:27:52.686 --rc geninfo_unexecuted_blocks=1 00:27:52.686 00:27:52.686 ' 00:27:52.686 11:52:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:52.686 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:52.686 --rc genhtml_branch_coverage=1 00:27:52.686 --rc genhtml_function_coverage=1 00:27:52.686 --rc genhtml_legend=1 00:27:52.686 --rc geninfo_all_blocks=1 00:27:52.686 --rc geninfo_unexecuted_blocks=1 00:27:52.686 00:27:52.686 ' 00:27:52.686 11:52:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:52.686 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:52.686 --rc genhtml_branch_coverage=1 00:27:52.686 --rc genhtml_function_coverage=1 00:27:52.686 --rc genhtml_legend=1 00:27:52.686 --rc geninfo_all_blocks=1 00:27:52.686 --rc geninfo_unexecuted_blocks=1 00:27:52.686 00:27:52.686 ' 00:27:52.686 11:52:12 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:52.686 11:52:12 -- nvmf/common.sh@7 -- # uname -s 00:27:52.686 11:52:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:52.686 11:52:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:52.686 11:52:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:52.686 11:52:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:52.686 11:52:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:52.686 11:52:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:52.686 11:52:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:52.686 11:52:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:52.686 11:52:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:52.686 11:52:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:52.686 11:52:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:52.686 11:52:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:52.686 11:52:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:52.686 11:52:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:52.686 11:52:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:52.686 11:52:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:52.686 11:52:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:52.686 11:52:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:52.686 11:52:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:52.686 11:52:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.686 11:52:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.686 11:52:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.686 11:52:12 -- paths/export.sh@5 -- # export PATH 00:27:52.686 11:52:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.686 11:52:12 -- nvmf/common.sh@46 -- # : 0 00:27:52.686 11:52:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:52.686 11:52:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:52.686 11:52:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:52.686 11:52:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:52.686 11:52:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:52.686 11:52:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:52.686 11:52:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:52.686 11:52:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:52.686 11:52:12 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:52.686 11:52:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:52.686 11:52:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:52.686 11:52:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:52.686 11:52:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.686 11:52:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.686 11:52:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.686 11:52:12 -- paths/export.sh@5 -- # export PATH 00:27:52.686 11:52:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.686 11:52:12 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:27:52.686 11:52:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:52.686 11:52:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:52.686 11:52:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:52.686 11:52:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:52.686 11:52:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:52.686 11:52:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:52.686 11:52:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:27:52.686 11:52:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:52.686 11:52:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:52.686 11:52:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:52.686 11:52:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:52.686 11:52:12 -- common/autotest_common.sh@10 -- # set +x 00:27:54.651 11:52:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:54.651 11:52:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:54.651 11:52:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:54.651 11:52:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:54.651 11:52:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:54.651 11:52:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:54.651 11:52:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:54.651 11:52:14 -- nvmf/common.sh@294 -- # net_devs=() 00:27:54.651 11:52:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:54.651 11:52:14 -- nvmf/common.sh@295 -- # e810=() 00:27:54.651 11:52:14 -- nvmf/common.sh@295 -- # local -ga e810 00:27:54.651 11:52:14 -- nvmf/common.sh@296 -- # x722=() 00:27:54.651 11:52:14 -- nvmf/common.sh@296 -- # local -ga x722 00:27:54.651 11:52:14 -- nvmf/common.sh@297 -- # mlx=() 00:27:54.651 11:52:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:54.651 11:52:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:54.651 11:52:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:54.651 11:52:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:54.651 11:52:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:54.651 11:52:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:54.651 11:52:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:54.651 11:52:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:54.651 11:52:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:54.651 11:52:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:54.651 11:52:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:54.651 11:52:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:54.651 11:52:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:54.651 11:52:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:54.651 11:52:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:54.651 11:52:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:54.651 11:52:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:54.651 11:52:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:54.651 11:52:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:54.651 11:52:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:54.651 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:54.651 11:52:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:54.652 11:52:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:54.652 11:52:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:54.652 11:52:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:54.652 11:52:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:54.652 11:52:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:54.652 11:52:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:54.652 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:54.652 11:52:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:54.652 11:52:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:54.652 11:52:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:54.652 11:52:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:54.652 11:52:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:54.652 11:52:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:54.652 11:52:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:54.652 11:52:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:54.652 11:52:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:54.652 11:52:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:54.652 11:52:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:54.652 11:52:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:54.652 11:52:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:54.652 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:54.652 11:52:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:54.652 11:52:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:54.652 11:52:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:54.652 11:52:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:54.652 11:52:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:54.652 11:52:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:54.652 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:54.652 11:52:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:54.652 11:52:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:54.652 11:52:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:54.652 11:52:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:54.652 11:52:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:54.652 11:52:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:54.652 11:52:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:54.652 11:52:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:54.652 11:52:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:54.652 11:52:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:54.652 11:52:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:54.652 11:52:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:54.652 11:52:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:54.652 11:52:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:54.652 11:52:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:54.652 11:52:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:54.652 11:52:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:54.652 11:52:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:54.652 11:52:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:54.910 11:52:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:54.910 11:52:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:54.910 11:52:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:54.910 11:52:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:54.910 11:52:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:54.910 11:52:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:54.910 11:52:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:54.910 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:54.910 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:27:54.910 00:27:54.910 --- 10.0.0.2 ping statistics --- 00:27:54.910 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:54.910 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:27:54.910 11:52:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:54.910 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:54.910 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:27:54.910 00:27:54.910 --- 10.0.0.1 ping statistics --- 00:27:54.910 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:54.910 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:27:54.910 11:52:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:54.910 11:52:14 -- nvmf/common.sh@410 -- # return 0 00:27:54.910 11:52:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:54.910 11:52:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:54.910 11:52:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:54.910 11:52:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:54.910 11:52:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:54.910 11:52:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:54.910 11:52:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:54.910 11:52:14 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:27:54.910 11:52:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:54.910 11:52:14 -- common/autotest_common.sh@10 -- # set +x 00:27:54.910 11:52:14 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:27:54.910 11:52:14 -- common/autotest_common.sh@1519 -- # bdfs=() 00:27:54.910 11:52:14 -- common/autotest_common.sh@1519 -- # local bdfs 00:27:54.910 11:52:14 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:27:54.910 11:52:14 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:27:54.910 11:52:14 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:54.910 11:52:14 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:54.910 11:52:14 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:54.910 11:52:14 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:54.910 11:52:14 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:54.910 11:52:14 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:54.910 11:52:14 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:54.910 11:52:14 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:27:54.910 11:52:14 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:27:54.910 11:52:14 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:27:54.910 11:52:14 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:27:54.910 11:52:14 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:27:54.910 11:52:14 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:27:54.910 EAL: No free 2048 kB hugepages reported on node 1 00:27:59.097 11:52:19 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:27:59.097 11:52:19 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:27:59.097 11:52:19 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:27:59.097 11:52:19 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:27:59.097 EAL: No free 2048 kB hugepages reported on node 1 00:28:03.286 11:52:23 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:03.287 11:52:23 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:03.287 11:52:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:03.287 11:52:23 -- common/autotest_common.sh@10 -- # set +x 00:28:03.287 11:52:23 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:03.287 11:52:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:03.287 11:52:23 -- common/autotest_common.sh@10 -- # set +x 00:28:03.287 11:52:23 -- target/identify_passthru.sh@31 -- # nvmfpid=3936783 00:28:03.287 11:52:23 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:03.287 11:52:23 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:03.287 11:52:23 -- target/identify_passthru.sh@35 -- # waitforlisten 3936783 00:28:03.287 11:52:23 -- common/autotest_common.sh@829 -- # '[' -z 3936783 ']' 00:28:03.287 11:52:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:03.287 11:52:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:03.287 11:52:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:03.287 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:03.287 11:52:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:03.287 11:52:23 -- common/autotest_common.sh@10 -- # set +x 00:28:03.287 [2024-11-28 11:52:23.333941] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:03.287 [2024-11-28 11:52:23.334037] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:03.545 EAL: No free 2048 kB hugepages reported on node 1 00:28:03.545 [2024-11-28 11:52:23.402608] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:03.545 [2024-11-28 11:52:23.513672] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:03.545 [2024-11-28 11:52:23.513837] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:03.545 [2024-11-28 11:52:23.513854] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:03.545 [2024-11-28 11:52:23.513865] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:03.545 [2024-11-28 11:52:23.513918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:03.545 [2024-11-28 11:52:23.514002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:03.545 [2024-11-28 11:52:23.513943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:03.545 [2024-11-28 11:52:23.514005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:03.545 11:52:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:03.545 11:52:23 -- common/autotest_common.sh@862 -- # return 0 00:28:03.545 11:52:23 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:03.545 11:52:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:03.545 11:52:23 -- common/autotest_common.sh@10 -- # set +x 00:28:03.545 INFO: Log level set to 20 00:28:03.545 INFO: Requests: 00:28:03.545 { 00:28:03.545 "jsonrpc": "2.0", 00:28:03.545 "method": "nvmf_set_config", 00:28:03.545 "id": 1, 00:28:03.545 "params": { 00:28:03.545 "admin_cmd_passthru": { 00:28:03.545 "identify_ctrlr": true 00:28:03.545 } 00:28:03.545 } 00:28:03.545 } 00:28:03.545 00:28:03.545 INFO: response: 00:28:03.545 { 00:28:03.545 "jsonrpc": "2.0", 00:28:03.545 "id": 1, 00:28:03.545 "result": true 00:28:03.545 } 00:28:03.545 00:28:03.545 11:52:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:03.545 11:52:23 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:03.545 11:52:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:03.545 11:52:23 -- common/autotest_common.sh@10 -- # set +x 00:28:03.545 INFO: Setting log level to 20 00:28:03.545 INFO: Setting log level to 20 00:28:03.545 INFO: Log level set to 20 00:28:03.545 INFO: Log level set to 20 00:28:03.545 INFO: Requests: 00:28:03.545 { 00:28:03.545 "jsonrpc": "2.0", 00:28:03.545 "method": "framework_start_init", 00:28:03.545 "id": 1 00:28:03.545 } 00:28:03.545 00:28:03.545 INFO: Requests: 00:28:03.545 { 00:28:03.545 "jsonrpc": "2.0", 00:28:03.545 "method": "framework_start_init", 00:28:03.545 "id": 1 00:28:03.545 } 00:28:03.545 00:28:03.804 [2024-11-28 11:52:23.674922] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:03.804 INFO: response: 00:28:03.804 { 00:28:03.804 "jsonrpc": "2.0", 00:28:03.804 "id": 1, 00:28:03.804 "result": true 00:28:03.804 } 00:28:03.804 00:28:03.804 INFO: response: 00:28:03.804 { 00:28:03.804 "jsonrpc": "2.0", 00:28:03.804 "id": 1, 00:28:03.804 "result": true 00:28:03.804 } 00:28:03.804 00:28:03.804 11:52:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:03.804 11:52:23 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:03.804 11:52:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:03.804 11:52:23 -- common/autotest_common.sh@10 -- # set +x 00:28:03.804 INFO: Setting log level to 40 00:28:03.804 INFO: Setting log level to 40 00:28:03.804 INFO: Setting log level to 40 00:28:03.804 [2024-11-28 11:52:23.685043] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:03.804 11:52:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:03.804 11:52:23 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:03.804 11:52:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:03.804 11:52:23 -- common/autotest_common.sh@10 -- # set +x 00:28:03.804 11:52:23 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:03.804 11:52:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:03.804 11:52:23 -- common/autotest_common.sh@10 -- # set +x 00:28:07.100 Nvme0n1 00:28:07.100 11:52:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:07.100 11:52:26 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:07.100 11:52:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:07.100 11:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:07.100 11:52:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:07.100 11:52:26 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:07.100 11:52:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:07.100 11:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:07.100 11:52:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:07.100 11:52:26 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:07.100 11:52:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:07.100 11:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:07.100 [2024-11-28 11:52:26.582135] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:07.100 11:52:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:07.100 11:52:26 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:07.100 11:52:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:07.100 11:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:07.100 [2024-11-28 11:52:26.589857] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:07.100 [ 00:28:07.100 { 00:28:07.100 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:07.100 "subtype": "Discovery", 00:28:07.100 "listen_addresses": [], 00:28:07.100 "allow_any_host": true, 00:28:07.100 "hosts": [] 00:28:07.100 }, 00:28:07.100 { 00:28:07.100 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:07.100 "subtype": "NVMe", 00:28:07.100 "listen_addresses": [ 00:28:07.100 { 00:28:07.100 "transport": "TCP", 00:28:07.100 "trtype": "TCP", 00:28:07.100 "adrfam": "IPv4", 00:28:07.100 "traddr": "10.0.0.2", 00:28:07.100 "trsvcid": "4420" 00:28:07.100 } 00:28:07.100 ], 00:28:07.100 "allow_any_host": true, 00:28:07.100 "hosts": [], 00:28:07.100 "serial_number": "SPDK00000000000001", 00:28:07.100 "model_number": "SPDK bdev Controller", 00:28:07.100 "max_namespaces": 1, 00:28:07.100 "min_cntlid": 1, 00:28:07.100 "max_cntlid": 65519, 00:28:07.100 "namespaces": [ 00:28:07.100 { 00:28:07.100 "nsid": 1, 00:28:07.100 "bdev_name": "Nvme0n1", 00:28:07.100 "name": "Nvme0n1", 00:28:07.100 "nguid": "B2FB6E84550943E783423DDED4DA1419", 00:28:07.100 "uuid": "b2fb6e84-5509-43e7-8342-3dded4da1419" 00:28:07.100 } 00:28:07.100 ] 00:28:07.100 } 00:28:07.100 ] 00:28:07.100 11:52:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:07.100 11:52:26 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:07.100 11:52:26 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:07.100 11:52:26 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:07.100 EAL: No free 2048 kB hugepages reported on node 1 00:28:07.100 11:52:26 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:07.100 11:52:26 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:07.100 11:52:26 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:07.100 11:52:26 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:07.100 EAL: No free 2048 kB hugepages reported on node 1 00:28:07.100 11:52:26 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:07.100 11:52:26 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:07.100 11:52:26 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:07.100 11:52:26 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:07.100 11:52:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:07.100 11:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:07.100 11:52:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:07.100 11:52:26 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:07.100 11:52:26 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:07.100 11:52:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:07.100 11:52:26 -- nvmf/common.sh@116 -- # sync 00:28:07.100 11:52:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:07.100 11:52:26 -- nvmf/common.sh@119 -- # set +e 00:28:07.100 11:52:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:07.100 11:52:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:07.100 rmmod nvme_tcp 00:28:07.100 rmmod nvme_fabrics 00:28:07.100 rmmod nvme_keyring 00:28:07.100 11:52:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:07.100 11:52:26 -- nvmf/common.sh@123 -- # set -e 00:28:07.100 11:52:26 -- nvmf/common.sh@124 -- # return 0 00:28:07.100 11:52:26 -- nvmf/common.sh@477 -- # '[' -n 3936783 ']' 00:28:07.100 11:52:26 -- nvmf/common.sh@478 -- # killprocess 3936783 00:28:07.100 11:52:26 -- common/autotest_common.sh@936 -- # '[' -z 3936783 ']' 00:28:07.100 11:52:26 -- common/autotest_common.sh@940 -- # kill -0 3936783 00:28:07.100 11:52:26 -- common/autotest_common.sh@941 -- # uname 00:28:07.100 11:52:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:07.100 11:52:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3936783 00:28:07.100 11:52:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:07.100 11:52:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:07.100 11:52:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3936783' 00:28:07.100 killing process with pid 3936783 00:28:07.100 11:52:26 -- common/autotest_common.sh@955 -- # kill 3936783 00:28:07.100 [2024-11-28 11:52:26.994043] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:07.100 11:52:26 -- common/autotest_common.sh@960 -- # wait 3936783 00:28:09.000 11:52:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:09.000 11:52:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:09.000 11:52:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:09.000 11:52:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:09.000 11:52:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:09.000 11:52:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:09.000 11:52:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:09.000 11:52:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:10.905 11:52:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:10.905 00:28:10.905 real 0m18.094s 00:28:10.905 user 0m26.728s 00:28:10.905 sys 0m2.295s 00:28:10.905 11:52:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:10.905 11:52:30 -- common/autotest_common.sh@10 -- # set +x 00:28:10.905 ************************************ 00:28:10.905 END TEST nvmf_identify_passthru 00:28:10.905 ************************************ 00:28:10.905 11:52:30 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:10.905 11:52:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:10.905 11:52:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:10.905 11:52:30 -- common/autotest_common.sh@10 -- # set +x 00:28:10.905 ************************************ 00:28:10.905 START TEST nvmf_dif 00:28:10.905 ************************************ 00:28:10.905 11:52:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:10.905 * Looking for test storage... 00:28:10.905 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:10.905 11:52:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:10.905 11:52:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:10.905 11:52:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:10.905 11:52:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:10.905 11:52:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:10.905 11:52:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:10.905 11:52:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:10.905 11:52:30 -- scripts/common.sh@335 -- # IFS=.-: 00:28:10.905 11:52:30 -- scripts/common.sh@335 -- # read -ra ver1 00:28:10.905 11:52:30 -- scripts/common.sh@336 -- # IFS=.-: 00:28:10.905 11:52:30 -- scripts/common.sh@336 -- # read -ra ver2 00:28:10.905 11:52:30 -- scripts/common.sh@337 -- # local 'op=<' 00:28:10.905 11:52:30 -- scripts/common.sh@339 -- # ver1_l=2 00:28:10.905 11:52:30 -- scripts/common.sh@340 -- # ver2_l=1 00:28:10.905 11:52:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:10.905 11:52:30 -- scripts/common.sh@343 -- # case "$op" in 00:28:10.905 11:52:30 -- scripts/common.sh@344 -- # : 1 00:28:10.905 11:52:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:10.905 11:52:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:10.905 11:52:30 -- scripts/common.sh@364 -- # decimal 1 00:28:10.905 11:52:30 -- scripts/common.sh@352 -- # local d=1 00:28:10.905 11:52:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:10.905 11:52:30 -- scripts/common.sh@354 -- # echo 1 00:28:10.905 11:52:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:10.905 11:52:30 -- scripts/common.sh@365 -- # decimal 2 00:28:10.905 11:52:30 -- scripts/common.sh@352 -- # local d=2 00:28:10.905 11:52:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:10.905 11:52:30 -- scripts/common.sh@354 -- # echo 2 00:28:10.905 11:52:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:10.905 11:52:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:10.905 11:52:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:10.905 11:52:30 -- scripts/common.sh@367 -- # return 0 00:28:10.905 11:52:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:10.905 11:52:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:10.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:10.905 --rc genhtml_branch_coverage=1 00:28:10.905 --rc genhtml_function_coverage=1 00:28:10.905 --rc genhtml_legend=1 00:28:10.905 --rc geninfo_all_blocks=1 00:28:10.905 --rc geninfo_unexecuted_blocks=1 00:28:10.905 00:28:10.905 ' 00:28:10.905 11:52:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:10.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:10.905 --rc genhtml_branch_coverage=1 00:28:10.905 --rc genhtml_function_coverage=1 00:28:10.905 --rc genhtml_legend=1 00:28:10.905 --rc geninfo_all_blocks=1 00:28:10.905 --rc geninfo_unexecuted_blocks=1 00:28:10.905 00:28:10.905 ' 00:28:10.905 11:52:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:10.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:10.905 --rc genhtml_branch_coverage=1 00:28:10.905 --rc genhtml_function_coverage=1 00:28:10.905 --rc genhtml_legend=1 00:28:10.905 --rc geninfo_all_blocks=1 00:28:10.905 --rc geninfo_unexecuted_blocks=1 00:28:10.905 00:28:10.905 ' 00:28:10.905 11:52:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:10.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:10.905 --rc genhtml_branch_coverage=1 00:28:10.905 --rc genhtml_function_coverage=1 00:28:10.905 --rc genhtml_legend=1 00:28:10.905 --rc geninfo_all_blocks=1 00:28:10.905 --rc geninfo_unexecuted_blocks=1 00:28:10.905 00:28:10.905 ' 00:28:10.905 11:52:30 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:10.905 11:52:30 -- nvmf/common.sh@7 -- # uname -s 00:28:10.905 11:52:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:10.905 11:52:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:10.905 11:52:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:10.905 11:52:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:10.905 11:52:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:10.905 11:52:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:10.905 11:52:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:10.905 11:52:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:10.905 11:52:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:10.905 11:52:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:10.905 11:52:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:10.905 11:52:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:10.905 11:52:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:10.905 11:52:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:10.905 11:52:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:10.906 11:52:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:10.906 11:52:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:10.906 11:52:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:10.906 11:52:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:10.906 11:52:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:10.906 11:52:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:10.906 11:52:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:10.906 11:52:30 -- paths/export.sh@5 -- # export PATH 00:28:10.906 11:52:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:10.906 11:52:30 -- nvmf/common.sh@46 -- # : 0 00:28:10.906 11:52:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:10.906 11:52:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:10.906 11:52:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:10.906 11:52:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:10.906 11:52:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:10.906 11:52:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:10.906 11:52:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:10.906 11:52:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:10.906 11:52:30 -- target/dif.sh@15 -- # NULL_META=16 00:28:10.906 11:52:30 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:10.906 11:52:30 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:10.906 11:52:30 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:10.906 11:52:30 -- target/dif.sh@135 -- # nvmftestinit 00:28:10.906 11:52:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:10.906 11:52:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:10.906 11:52:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:10.906 11:52:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:10.906 11:52:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:10.906 11:52:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:10.906 11:52:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:10.906 11:52:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:10.906 11:52:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:10.906 11:52:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:10.906 11:52:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:10.906 11:52:30 -- common/autotest_common.sh@10 -- # set +x 00:28:12.808 11:52:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:12.808 11:52:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:12.808 11:52:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:12.808 11:52:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:12.808 11:52:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:12.808 11:52:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:12.808 11:52:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:12.808 11:52:32 -- nvmf/common.sh@294 -- # net_devs=() 00:28:12.808 11:52:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:12.808 11:52:32 -- nvmf/common.sh@295 -- # e810=() 00:28:12.808 11:52:32 -- nvmf/common.sh@295 -- # local -ga e810 00:28:12.808 11:52:32 -- nvmf/common.sh@296 -- # x722=() 00:28:12.808 11:52:32 -- nvmf/common.sh@296 -- # local -ga x722 00:28:12.808 11:52:32 -- nvmf/common.sh@297 -- # mlx=() 00:28:12.808 11:52:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:12.808 11:52:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:12.808 11:52:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:12.808 11:52:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:12.808 11:52:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:12.808 11:52:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:12.808 11:52:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:12.808 11:52:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:12.808 11:52:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:12.808 11:52:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:12.808 11:52:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:12.808 11:52:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:12.808 11:52:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:12.808 11:52:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:12.808 11:52:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:12.808 11:52:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:12.808 11:52:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:12.808 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:12.808 11:52:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:12.808 11:52:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:12.808 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:12.808 11:52:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:12.808 11:52:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:12.808 11:52:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:12.808 11:52:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:12.808 11:52:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:12.808 11:52:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:12.808 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:12.808 11:52:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:12.808 11:52:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:12.808 11:52:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:12.808 11:52:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:12.808 11:52:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:12.808 11:52:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:12.808 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:12.808 11:52:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:12.808 11:52:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:12.808 11:52:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:12.808 11:52:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:12.808 11:52:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:12.808 11:52:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:12.808 11:52:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:12.808 11:52:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:12.808 11:52:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:12.808 11:52:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:12.808 11:52:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:12.808 11:52:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:12.808 11:52:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:12.808 11:52:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:12.808 11:52:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:12.808 11:52:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:12.808 11:52:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:12.808 11:52:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:12.808 11:52:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:12.808 11:52:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:12.808 11:52:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:12.808 11:52:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:13.067 11:52:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:13.067 11:52:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:13.067 11:52:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:13.067 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:13.067 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:28:13.067 00:28:13.067 --- 10.0.0.2 ping statistics --- 00:28:13.067 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:13.067 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:28:13.067 11:52:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:13.067 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:13.067 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.062 ms 00:28:13.067 00:28:13.067 --- 10.0.0.1 ping statistics --- 00:28:13.067 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:13.067 rtt min/avg/max/mdev = 0.062/0.062/0.062/0.000 ms 00:28:13.067 11:52:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:13.067 11:52:32 -- nvmf/common.sh@410 -- # return 0 00:28:13.067 11:52:32 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:13.067 11:52:32 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:14.003 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:14.003 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:14.003 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:14.003 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:14.003 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:14.003 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:14.003 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:14.003 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:14.003 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:14.003 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:14.003 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:14.003 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:14.003 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:14.003 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:14.003 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:14.003 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:14.003 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:14.262 11:52:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:14.262 11:52:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:14.262 11:52:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:14.262 11:52:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:14.262 11:52:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:14.262 11:52:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:14.262 11:52:34 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:14.262 11:52:34 -- target/dif.sh@137 -- # nvmfappstart 00:28:14.262 11:52:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:14.262 11:52:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:14.262 11:52:34 -- common/autotest_common.sh@10 -- # set +x 00:28:14.262 11:52:34 -- nvmf/common.sh@469 -- # nvmfpid=3940076 00:28:14.262 11:52:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:14.262 11:52:34 -- nvmf/common.sh@470 -- # waitforlisten 3940076 00:28:14.262 11:52:34 -- common/autotest_common.sh@829 -- # '[' -z 3940076 ']' 00:28:14.262 11:52:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:14.262 11:52:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:14.262 11:52:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:14.262 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:14.262 11:52:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:14.262 11:52:34 -- common/autotest_common.sh@10 -- # set +x 00:28:14.262 [2024-11-28 11:52:34.211770] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:14.262 [2024-11-28 11:52:34.211884] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:14.262 EAL: No free 2048 kB hugepages reported on node 1 00:28:14.262 [2024-11-28 11:52:34.278502] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:14.521 [2024-11-28 11:52:34.393825] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:14.521 [2024-11-28 11:52:34.393977] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:14.521 [2024-11-28 11:52:34.393996] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:14.521 [2024-11-28 11:52:34.394010] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:14.521 [2024-11-28 11:52:34.394040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:15.458 11:52:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:15.458 11:52:35 -- common/autotest_common.sh@862 -- # return 0 00:28:15.458 11:52:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:15.458 11:52:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:15.458 11:52:35 -- common/autotest_common.sh@10 -- # set +x 00:28:15.458 11:52:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:15.458 11:52:35 -- target/dif.sh@139 -- # create_transport 00:28:15.458 11:52:35 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:15.458 11:52:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:15.458 11:52:35 -- common/autotest_common.sh@10 -- # set +x 00:28:15.458 [2024-11-28 11:52:35.236780] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:15.458 11:52:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:15.458 11:52:35 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:15.458 11:52:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:15.458 11:52:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:15.458 11:52:35 -- common/autotest_common.sh@10 -- # set +x 00:28:15.458 ************************************ 00:28:15.458 START TEST fio_dif_1_default 00:28:15.458 ************************************ 00:28:15.458 11:52:35 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:15.458 11:52:35 -- target/dif.sh@86 -- # create_subsystems 0 00:28:15.458 11:52:35 -- target/dif.sh@28 -- # local sub 00:28:15.458 11:52:35 -- target/dif.sh@30 -- # for sub in "$@" 00:28:15.458 11:52:35 -- target/dif.sh@31 -- # create_subsystem 0 00:28:15.458 11:52:35 -- target/dif.sh@18 -- # local sub_id=0 00:28:15.458 11:52:35 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:15.458 11:52:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:15.458 11:52:35 -- common/autotest_common.sh@10 -- # set +x 00:28:15.458 bdev_null0 00:28:15.458 11:52:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:15.458 11:52:35 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:15.458 11:52:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:15.458 11:52:35 -- common/autotest_common.sh@10 -- # set +x 00:28:15.458 11:52:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:15.458 11:52:35 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:15.458 11:52:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:15.458 11:52:35 -- common/autotest_common.sh@10 -- # set +x 00:28:15.458 11:52:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:15.458 11:52:35 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:15.458 11:52:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:15.458 11:52:35 -- common/autotest_common.sh@10 -- # set +x 00:28:15.458 [2024-11-28 11:52:35.273068] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:15.458 11:52:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:15.458 11:52:35 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:15.458 11:52:35 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:15.458 11:52:35 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:15.458 11:52:35 -- nvmf/common.sh@520 -- # config=() 00:28:15.458 11:52:35 -- nvmf/common.sh@520 -- # local subsystem config 00:28:15.458 11:52:35 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:15.458 11:52:35 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:15.458 { 00:28:15.458 "params": { 00:28:15.458 "name": "Nvme$subsystem", 00:28:15.458 "trtype": "$TEST_TRANSPORT", 00:28:15.458 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:15.458 "adrfam": "ipv4", 00:28:15.458 "trsvcid": "$NVMF_PORT", 00:28:15.458 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:15.458 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:15.458 "hdgst": ${hdgst:-false}, 00:28:15.458 "ddgst": ${ddgst:-false} 00:28:15.458 }, 00:28:15.458 "method": "bdev_nvme_attach_controller" 00:28:15.458 } 00:28:15.458 EOF 00:28:15.458 )") 00:28:15.458 11:52:35 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:15.458 11:52:35 -- target/dif.sh@82 -- # gen_fio_conf 00:28:15.458 11:52:35 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:15.458 11:52:35 -- target/dif.sh@54 -- # local file 00:28:15.458 11:52:35 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:15.458 11:52:35 -- target/dif.sh@56 -- # cat 00:28:15.458 11:52:35 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:15.458 11:52:35 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:15.458 11:52:35 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:15.458 11:52:35 -- common/autotest_common.sh@1330 -- # shift 00:28:15.458 11:52:35 -- nvmf/common.sh@542 -- # cat 00:28:15.458 11:52:35 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:15.458 11:52:35 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:15.458 11:52:35 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:15.458 11:52:35 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:15.458 11:52:35 -- target/dif.sh@72 -- # (( file <= files )) 00:28:15.458 11:52:35 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:15.458 11:52:35 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:15.458 11:52:35 -- nvmf/common.sh@544 -- # jq . 00:28:15.458 11:52:35 -- nvmf/common.sh@545 -- # IFS=, 00:28:15.458 11:52:35 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:15.458 "params": { 00:28:15.458 "name": "Nvme0", 00:28:15.458 "trtype": "tcp", 00:28:15.458 "traddr": "10.0.0.2", 00:28:15.458 "adrfam": "ipv4", 00:28:15.458 "trsvcid": "4420", 00:28:15.458 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:15.458 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:15.458 "hdgst": false, 00:28:15.458 "ddgst": false 00:28:15.458 }, 00:28:15.458 "method": "bdev_nvme_attach_controller" 00:28:15.458 }' 00:28:15.458 11:52:35 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:15.458 11:52:35 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:15.458 11:52:35 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:15.458 11:52:35 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:15.458 11:52:35 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:15.458 11:52:35 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:15.458 11:52:35 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:15.458 11:52:35 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:15.458 11:52:35 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:15.458 11:52:35 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:15.716 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:15.716 fio-3.35 00:28:15.716 Starting 1 thread 00:28:15.716 EAL: No free 2048 kB hugepages reported on node 1 00:28:15.975 [2024-11-28 11:52:36.013641] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:15.975 [2024-11-28 11:52:36.013717] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:28.173 00:28:28.173 filename0: (groupid=0, jobs=1): err= 0: pid=3940344: Thu Nov 28 11:52:46 2024 00:28:28.173 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10009msec) 00:28:28.173 slat (nsec): min=6627, max=54853, avg=8481.53, stdev=2980.56 00:28:28.173 clat (usec): min=40842, max=45688, avg=40992.67, stdev=301.19 00:28:28.173 lat (usec): min=40849, max=45723, avg=41001.15, stdev=301.58 00:28:28.173 clat percentiles (usec): 00:28:28.173 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:28.173 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:28.173 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:28.173 | 99.00th=[41157], 99.50th=[41157], 99.90th=[45876], 99.95th=[45876], 00:28:28.173 | 99.99th=[45876] 00:28:28.173 bw ( KiB/s): min= 384, max= 416, per=99.47%, avg=388.80, stdev=11.72, samples=20 00:28:28.173 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:28:28.173 lat (msec) : 50=100.00% 00:28:28.174 cpu : usr=91.34%, sys=8.38%, ctx=17, majf=0, minf=288 00:28:28.174 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:28.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:28.174 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:28.174 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:28.174 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:28.174 00:28:28.174 Run status group 0 (all jobs): 00:28:28.174 READ: bw=390KiB/s (399kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=3904KiB (3998kB), run=10009-10009msec 00:28:28.174 11:52:46 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:28.174 11:52:46 -- target/dif.sh@43 -- # local sub 00:28:28.174 11:52:46 -- target/dif.sh@45 -- # for sub in "$@" 00:28:28.174 11:52:46 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:28.174 11:52:46 -- target/dif.sh@36 -- # local sub_id=0 00:28:28.174 11:52:46 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:28.174 11:52:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.174 11:52:46 -- common/autotest_common.sh@10 -- # set +x 00:28:28.174 11:52:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.174 11:52:46 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:28.174 11:52:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.174 11:52:46 -- common/autotest_common.sh@10 -- # set +x 00:28:28.174 11:52:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.174 00:28:28.174 real 0m11.238s 00:28:28.174 user 0m10.373s 00:28:28.174 sys 0m1.095s 00:28:28.174 11:52:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:28.174 11:52:46 -- common/autotest_common.sh@10 -- # set +x 00:28:28.174 ************************************ 00:28:28.174 END TEST fio_dif_1_default 00:28:28.174 ************************************ 00:28:28.174 11:52:46 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:28.174 11:52:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:28.174 11:52:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:28.174 11:52:46 -- common/autotest_common.sh@10 -- # set +x 00:28:28.174 ************************************ 00:28:28.174 START TEST fio_dif_1_multi_subsystems 00:28:28.174 ************************************ 00:28:28.174 11:52:46 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:28:28.174 11:52:46 -- target/dif.sh@92 -- # local files=1 00:28:28.174 11:52:46 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:28.174 11:52:46 -- target/dif.sh@28 -- # local sub 00:28:28.174 11:52:46 -- target/dif.sh@30 -- # for sub in "$@" 00:28:28.174 11:52:46 -- target/dif.sh@31 -- # create_subsystem 0 00:28:28.174 11:52:46 -- target/dif.sh@18 -- # local sub_id=0 00:28:28.174 11:52:46 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:28.174 11:52:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.174 11:52:46 -- common/autotest_common.sh@10 -- # set +x 00:28:28.174 bdev_null0 00:28:28.174 11:52:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.174 11:52:46 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:28.174 11:52:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.174 11:52:46 -- common/autotest_common.sh@10 -- # set +x 00:28:28.174 11:52:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.174 11:52:46 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:28.174 11:52:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.174 11:52:46 -- common/autotest_common.sh@10 -- # set +x 00:28:28.174 11:52:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.174 11:52:46 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:28.174 11:52:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.174 11:52:46 -- common/autotest_common.sh@10 -- # set +x 00:28:28.174 [2024-11-28 11:52:46.543295] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:28.174 11:52:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.174 11:52:46 -- target/dif.sh@30 -- # for sub in "$@" 00:28:28.174 11:52:46 -- target/dif.sh@31 -- # create_subsystem 1 00:28:28.174 11:52:46 -- target/dif.sh@18 -- # local sub_id=1 00:28:28.174 11:52:46 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:28.174 11:52:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.174 11:52:46 -- common/autotest_common.sh@10 -- # set +x 00:28:28.174 bdev_null1 00:28:28.174 11:52:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.174 11:52:46 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:28.174 11:52:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.174 11:52:46 -- common/autotest_common.sh@10 -- # set +x 00:28:28.174 11:52:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.174 11:52:46 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:28.174 11:52:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.174 11:52:46 -- common/autotest_common.sh@10 -- # set +x 00:28:28.174 11:52:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.174 11:52:46 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:28.174 11:52:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.174 11:52:46 -- common/autotest_common.sh@10 -- # set +x 00:28:28.174 11:52:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.174 11:52:46 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:28.174 11:52:46 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:28.174 11:52:46 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:28.174 11:52:46 -- nvmf/common.sh@520 -- # config=() 00:28:28.174 11:52:46 -- nvmf/common.sh@520 -- # local subsystem config 00:28:28.174 11:52:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:28.174 11:52:46 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:28.174 11:52:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:28.174 { 00:28:28.174 "params": { 00:28:28.174 "name": "Nvme$subsystem", 00:28:28.174 "trtype": "$TEST_TRANSPORT", 00:28:28.174 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:28.174 "adrfam": "ipv4", 00:28:28.174 "trsvcid": "$NVMF_PORT", 00:28:28.174 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:28.174 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:28.174 "hdgst": ${hdgst:-false}, 00:28:28.174 "ddgst": ${ddgst:-false} 00:28:28.174 }, 00:28:28.174 "method": "bdev_nvme_attach_controller" 00:28:28.174 } 00:28:28.174 EOF 00:28:28.174 )") 00:28:28.174 11:52:46 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:28.174 11:52:46 -- target/dif.sh@82 -- # gen_fio_conf 00:28:28.174 11:52:46 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:28.174 11:52:46 -- target/dif.sh@54 -- # local file 00:28:28.174 11:52:46 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:28.174 11:52:46 -- target/dif.sh@56 -- # cat 00:28:28.174 11:52:46 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:28.174 11:52:46 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:28.174 11:52:46 -- common/autotest_common.sh@1330 -- # shift 00:28:28.174 11:52:46 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:28.174 11:52:46 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:28.174 11:52:46 -- nvmf/common.sh@542 -- # cat 00:28:28.174 11:52:46 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:28.174 11:52:46 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:28.174 11:52:46 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:28.174 11:52:46 -- target/dif.sh@72 -- # (( file <= files )) 00:28:28.174 11:52:46 -- target/dif.sh@73 -- # cat 00:28:28.174 11:52:46 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:28.174 11:52:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:28.174 11:52:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:28.174 { 00:28:28.174 "params": { 00:28:28.174 "name": "Nvme$subsystem", 00:28:28.174 "trtype": "$TEST_TRANSPORT", 00:28:28.174 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:28.174 "adrfam": "ipv4", 00:28:28.174 "trsvcid": "$NVMF_PORT", 00:28:28.174 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:28.174 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:28.174 "hdgst": ${hdgst:-false}, 00:28:28.174 "ddgst": ${ddgst:-false} 00:28:28.174 }, 00:28:28.174 "method": "bdev_nvme_attach_controller" 00:28:28.174 } 00:28:28.174 EOF 00:28:28.174 )") 00:28:28.174 11:52:46 -- nvmf/common.sh@542 -- # cat 00:28:28.174 11:52:46 -- target/dif.sh@72 -- # (( file++ )) 00:28:28.174 11:52:46 -- target/dif.sh@72 -- # (( file <= files )) 00:28:28.174 11:52:46 -- nvmf/common.sh@544 -- # jq . 00:28:28.174 11:52:46 -- nvmf/common.sh@545 -- # IFS=, 00:28:28.174 11:52:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:28.174 "params": { 00:28:28.174 "name": "Nvme0", 00:28:28.174 "trtype": "tcp", 00:28:28.174 "traddr": "10.0.0.2", 00:28:28.174 "adrfam": "ipv4", 00:28:28.174 "trsvcid": "4420", 00:28:28.174 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:28.174 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:28.174 "hdgst": false, 00:28:28.174 "ddgst": false 00:28:28.174 }, 00:28:28.174 "method": "bdev_nvme_attach_controller" 00:28:28.174 },{ 00:28:28.174 "params": { 00:28:28.174 "name": "Nvme1", 00:28:28.174 "trtype": "tcp", 00:28:28.174 "traddr": "10.0.0.2", 00:28:28.174 "adrfam": "ipv4", 00:28:28.174 "trsvcid": "4420", 00:28:28.174 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:28.174 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:28.174 "hdgst": false, 00:28:28.174 "ddgst": false 00:28:28.174 }, 00:28:28.174 "method": "bdev_nvme_attach_controller" 00:28:28.174 }' 00:28:28.174 11:52:46 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:28.174 11:52:46 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:28.175 11:52:46 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:28.175 11:52:46 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:28.175 11:52:46 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:28.175 11:52:46 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:28.175 11:52:46 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:28.175 11:52:46 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:28.175 11:52:46 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:28.175 11:52:46 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:28.175 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:28.175 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:28.175 fio-3.35 00:28:28.175 Starting 2 threads 00:28:28.175 EAL: No free 2048 kB hugepages reported on node 1 00:28:28.175 [2024-11-28 11:52:47.523582] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:28.175 [2024-11-28 11:52:47.523644] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:38.145 00:28:38.145 filename0: (groupid=0, jobs=1): err= 0: pid=3941792: Thu Nov 28 11:52:57 2024 00:28:38.145 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10012msec) 00:28:38.145 slat (nsec): min=6798, max=70183, avg=8785.47, stdev=3533.68 00:28:38.145 clat (usec): min=40902, max=44781, avg=41004.30, stdev=281.34 00:28:38.145 lat (usec): min=40909, max=44814, avg=41013.08, stdev=282.07 00:28:38.145 clat percentiles (usec): 00:28:38.145 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:38.145 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:38.145 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:38.145 | 99.00th=[41681], 99.50th=[42730], 99.90th=[44827], 99.95th=[44827], 00:28:38.145 | 99.99th=[44827] 00:28:38.145 bw ( KiB/s): min= 384, max= 416, per=49.75%, avg=388.80, stdev=11.72, samples=20 00:28:38.145 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:28:38.145 lat (msec) : 50=100.00% 00:28:38.145 cpu : usr=95.46%, sys=4.23%, ctx=17, majf=0, minf=184 00:28:38.145 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:38.145 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:38.145 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:38.145 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:38.145 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:38.145 filename1: (groupid=0, jobs=1): err= 0: pid=3941793: Thu Nov 28 11:52:57 2024 00:28:38.145 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10009msec) 00:28:38.145 slat (nsec): min=6824, max=27979, avg=8553.96, stdev=2509.48 00:28:38.145 clat (usec): min=40836, max=44803, avg=40992.94, stdev=252.69 00:28:38.145 lat (usec): min=40843, max=44822, avg=41001.50, stdev=253.04 00:28:38.145 clat percentiles (usec): 00:28:38.145 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:38.146 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:38.146 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:38.146 | 99.00th=[41157], 99.50th=[42206], 99.90th=[44827], 99.95th=[44827], 00:28:38.146 | 99.99th=[44827] 00:28:38.146 bw ( KiB/s): min= 384, max= 416, per=49.75%, avg=388.80, stdev=11.72, samples=20 00:28:38.146 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:28:38.146 lat (msec) : 50=100.00% 00:28:38.146 cpu : usr=95.70%, sys=4.00%, ctx=14, majf=0, minf=196 00:28:38.146 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:38.146 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:38.146 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:38.146 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:38.146 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:38.146 00:28:38.146 Run status group 0 (all jobs): 00:28:38.146 READ: bw=780KiB/s (799kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=7808KiB (7995kB), run=10009-10012msec 00:28:38.146 11:52:57 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:28:38.146 11:52:57 -- target/dif.sh@43 -- # local sub 00:28:38.146 11:52:57 -- target/dif.sh@45 -- # for sub in "$@" 00:28:38.146 11:52:57 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:38.146 11:52:57 -- target/dif.sh@36 -- # local sub_id=0 00:28:38.146 11:52:57 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:38.146 11:52:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.146 11:52:57 -- common/autotest_common.sh@10 -- # set +x 00:28:38.146 11:52:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.146 11:52:57 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:38.146 11:52:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.146 11:52:57 -- common/autotest_common.sh@10 -- # set +x 00:28:38.146 11:52:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.146 11:52:57 -- target/dif.sh@45 -- # for sub in "$@" 00:28:38.146 11:52:57 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:38.146 11:52:57 -- target/dif.sh@36 -- # local sub_id=1 00:28:38.146 11:52:57 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:38.146 11:52:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.146 11:52:57 -- common/autotest_common.sh@10 -- # set +x 00:28:38.146 11:52:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.146 11:52:57 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:38.146 11:52:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.146 11:52:57 -- common/autotest_common.sh@10 -- # set +x 00:28:38.146 11:52:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.146 00:28:38.146 real 0m11.399s 00:28:38.146 user 0m20.556s 00:28:38.146 sys 0m1.106s 00:28:38.146 11:52:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:38.146 11:52:57 -- common/autotest_common.sh@10 -- # set +x 00:28:38.146 ************************************ 00:28:38.146 END TEST fio_dif_1_multi_subsystems 00:28:38.146 ************************************ 00:28:38.146 11:52:57 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:28:38.146 11:52:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:38.146 11:52:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:38.146 11:52:57 -- common/autotest_common.sh@10 -- # set +x 00:28:38.146 ************************************ 00:28:38.146 START TEST fio_dif_rand_params 00:28:38.146 ************************************ 00:28:38.146 11:52:57 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:28:38.146 11:52:57 -- target/dif.sh@100 -- # local NULL_DIF 00:28:38.146 11:52:57 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:28:38.146 11:52:57 -- target/dif.sh@103 -- # NULL_DIF=3 00:28:38.146 11:52:57 -- target/dif.sh@103 -- # bs=128k 00:28:38.146 11:52:57 -- target/dif.sh@103 -- # numjobs=3 00:28:38.146 11:52:57 -- target/dif.sh@103 -- # iodepth=3 00:28:38.146 11:52:57 -- target/dif.sh@103 -- # runtime=5 00:28:38.146 11:52:57 -- target/dif.sh@105 -- # create_subsystems 0 00:28:38.146 11:52:57 -- target/dif.sh@28 -- # local sub 00:28:38.146 11:52:57 -- target/dif.sh@30 -- # for sub in "$@" 00:28:38.146 11:52:57 -- target/dif.sh@31 -- # create_subsystem 0 00:28:38.146 11:52:57 -- target/dif.sh@18 -- # local sub_id=0 00:28:38.146 11:52:57 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:28:38.146 11:52:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.146 11:52:57 -- common/autotest_common.sh@10 -- # set +x 00:28:38.146 bdev_null0 00:28:38.146 11:52:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.146 11:52:57 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:38.146 11:52:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.146 11:52:57 -- common/autotest_common.sh@10 -- # set +x 00:28:38.146 11:52:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.146 11:52:57 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:38.146 11:52:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.146 11:52:57 -- common/autotest_common.sh@10 -- # set +x 00:28:38.146 11:52:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.146 11:52:57 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:38.146 11:52:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.146 11:52:57 -- common/autotest_common.sh@10 -- # set +x 00:28:38.146 [2024-11-28 11:52:57.969408] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:38.146 11:52:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.146 11:52:57 -- target/dif.sh@106 -- # fio /dev/fd/62 00:28:38.146 11:52:57 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:28:38.146 11:52:57 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:38.146 11:52:57 -- nvmf/common.sh@520 -- # config=() 00:28:38.146 11:52:57 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:38.146 11:52:57 -- nvmf/common.sh@520 -- # local subsystem config 00:28:38.146 11:52:57 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:38.146 11:52:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:38.146 11:52:57 -- target/dif.sh@82 -- # gen_fio_conf 00:28:38.146 11:52:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:38.146 { 00:28:38.146 "params": { 00:28:38.146 "name": "Nvme$subsystem", 00:28:38.146 "trtype": "$TEST_TRANSPORT", 00:28:38.146 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:38.146 "adrfam": "ipv4", 00:28:38.146 "trsvcid": "$NVMF_PORT", 00:28:38.146 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:38.146 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:38.146 "hdgst": ${hdgst:-false}, 00:28:38.146 "ddgst": ${ddgst:-false} 00:28:38.146 }, 00:28:38.146 "method": "bdev_nvme_attach_controller" 00:28:38.146 } 00:28:38.146 EOF 00:28:38.146 )") 00:28:38.146 11:52:57 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:38.146 11:52:57 -- target/dif.sh@54 -- # local file 00:28:38.146 11:52:57 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:38.146 11:52:57 -- target/dif.sh@56 -- # cat 00:28:38.146 11:52:57 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:38.146 11:52:57 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:38.146 11:52:57 -- common/autotest_common.sh@1330 -- # shift 00:28:38.147 11:52:57 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:38.147 11:52:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:38.147 11:52:57 -- nvmf/common.sh@542 -- # cat 00:28:38.147 11:52:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:38.147 11:52:57 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:38.147 11:52:57 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:38.147 11:52:57 -- target/dif.sh@72 -- # (( file <= files )) 00:28:38.147 11:52:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:38.147 11:52:57 -- nvmf/common.sh@544 -- # jq . 00:28:38.147 11:52:57 -- nvmf/common.sh@545 -- # IFS=, 00:28:38.147 11:52:57 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:38.147 "params": { 00:28:38.147 "name": "Nvme0", 00:28:38.147 "trtype": "tcp", 00:28:38.147 "traddr": "10.0.0.2", 00:28:38.147 "adrfam": "ipv4", 00:28:38.147 "trsvcid": "4420", 00:28:38.147 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:38.147 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:38.147 "hdgst": false, 00:28:38.147 "ddgst": false 00:28:38.147 }, 00:28:38.147 "method": "bdev_nvme_attach_controller" 00:28:38.147 }' 00:28:38.147 11:52:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:38.147 11:52:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:38.147 11:52:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:38.147 11:52:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:38.147 11:52:57 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:38.147 11:52:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:38.147 11:52:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:38.147 11:52:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:38.147 11:52:58 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:38.147 11:52:58 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:38.405 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:28:38.406 ... 00:28:38.406 fio-3.35 00:28:38.406 Starting 3 threads 00:28:38.406 EAL: No free 2048 kB hugepages reported on node 1 00:28:38.972 [2024-11-28 11:52:58.781273] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:38.972 [2024-11-28 11:52:58.781368] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:44.241 00:28:44.241 filename0: (groupid=0, jobs=1): err= 0: pid=3943231: Thu Nov 28 11:53:03 2024 00:28:44.241 read: IOPS=214, BW=26.8MiB/s (28.1MB/s)(135MiB/5048msec) 00:28:44.241 slat (nsec): min=5771, max=63988, avg=12994.45, stdev=3556.12 00:28:44.241 clat (usec): min=5197, max=59759, avg=13937.96, stdev=9706.11 00:28:44.241 lat (usec): min=5209, max=59791, avg=13950.96, stdev=9706.04 00:28:44.241 clat percentiles (usec): 00:28:44.241 | 1.00th=[ 5473], 5.00th=[ 6980], 10.00th=[ 8225], 20.00th=[ 9503], 00:28:44.241 | 30.00th=[10683], 40.00th=[11600], 50.00th=[12125], 60.00th=[12649], 00:28:44.241 | 70.00th=[13304], 80.00th=[14222], 90.00th=[15664], 95.00th=[49021], 00:28:44.241 | 99.00th=[53740], 99.50th=[55313], 99.90th=[59507], 99.95th=[59507], 00:28:44.241 | 99.99th=[59507] 00:28:44.241 bw ( KiB/s): min=22784, max=32000, per=32.97%, avg=27622.40, stdev=3061.20, samples=10 00:28:44.241 iops : min= 178, max= 250, avg=215.80, stdev=23.92, samples=10 00:28:44.241 lat (msec) : 10=24.86%, 20=69.41%, 50=1.57%, 100=4.16% 00:28:44.241 cpu : usr=90.75%, sys=8.78%, ctx=16, majf=0, minf=177 00:28:44.241 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:44.241 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:44.241 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:44.241 issued rwts: total=1082,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:44.241 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:44.242 filename0: (groupid=0, jobs=1): err= 0: pid=3943232: Thu Nov 28 11:53:03 2024 00:28:44.242 read: IOPS=221, BW=27.7MiB/s (29.1MB/s)(139MiB/5006msec) 00:28:44.242 slat (nsec): min=6169, max=41392, avg=12950.46, stdev=3298.66 00:28:44.242 clat (usec): min=4664, max=57202, avg=13509.83, stdev=9388.01 00:28:44.242 lat (usec): min=4676, max=57215, avg=13522.78, stdev=9388.04 00:28:44.242 clat percentiles (usec): 00:28:44.242 | 1.00th=[ 5407], 5.00th=[ 6390], 10.00th=[ 7963], 20.00th=[ 9372], 00:28:44.242 | 30.00th=[10552], 40.00th=[11338], 50.00th=[11994], 60.00th=[12387], 00:28:44.242 | 70.00th=[12911], 80.00th=[13566], 90.00th=[14877], 95.00th=[47449], 00:28:44.242 | 99.00th=[53216], 99.50th=[54264], 99.90th=[57410], 99.95th=[57410], 00:28:44.242 | 99.99th=[57410] 00:28:44.242 bw ( KiB/s): min=24576, max=31488, per=33.83%, avg=28339.20, stdev=2371.13, samples=10 00:28:44.242 iops : min= 192, max= 246, avg=221.40, stdev=18.52, samples=10 00:28:44.242 lat (msec) : 10=25.68%, 20=68.92%, 50=1.53%, 100=3.87% 00:28:44.242 cpu : usr=91.09%, sys=8.35%, ctx=19, majf=0, minf=94 00:28:44.242 IO depths : 1=0.4%, 2=99.6%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:44.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:44.242 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:44.242 issued rwts: total=1110,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:44.242 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:44.242 filename0: (groupid=0, jobs=1): err= 0: pid=3943233: Thu Nov 28 11:53:03 2024 00:28:44.242 read: IOPS=222, BW=27.8MiB/s (29.1MB/s)(139MiB/5007msec) 00:28:44.242 slat (nsec): min=5630, max=36412, avg=13000.66, stdev=3033.71 00:28:44.242 clat (usec): min=5030, max=56858, avg=13487.78, stdev=8030.40 00:28:44.242 lat (usec): min=5041, max=56870, avg=13500.78, stdev=8030.33 00:28:44.242 clat percentiles (usec): 00:28:44.242 | 1.00th=[ 5604], 5.00th=[ 7570], 10.00th=[ 8291], 20.00th=[ 9372], 00:28:44.242 | 30.00th=[10421], 40.00th=[11338], 50.00th=[12256], 60.00th=[12911], 00:28:44.242 | 70.00th=[13698], 80.00th=[15008], 90.00th=[16581], 95.00th=[17957], 00:28:44.242 | 99.00th=[53216], 99.50th=[54789], 99.90th=[56361], 99.95th=[56886], 00:28:44.242 | 99.99th=[56886] 00:28:44.242 bw ( KiB/s): min=25600, max=31807, per=33.89%, avg=28396.70, stdev=2388.42, samples=10 00:28:44.242 iops : min= 200, max= 248, avg=221.80, stdev=18.58, samples=10 00:28:44.242 lat (msec) : 10=24.82%, 20=71.40%, 50=1.44%, 100=2.34% 00:28:44.242 cpu : usr=91.61%, sys=7.91%, ctx=10, majf=0, minf=69 00:28:44.242 IO depths : 1=0.7%, 2=99.3%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:44.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:44.242 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:44.242 issued rwts: total=1112,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:44.242 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:44.242 00:28:44.242 Run status group 0 (all jobs): 00:28:44.242 READ: bw=81.8MiB/s (85.8MB/s), 26.8MiB/s-27.8MiB/s (28.1MB/s-29.1MB/s), io=413MiB (433MB), run=5006-5048msec 00:28:44.242 11:53:04 -- target/dif.sh@107 -- # destroy_subsystems 0 00:28:44.242 11:53:04 -- target/dif.sh@43 -- # local sub 00:28:44.242 11:53:04 -- target/dif.sh@45 -- # for sub in "$@" 00:28:44.242 11:53:04 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:44.242 11:53:04 -- target/dif.sh@36 -- # local sub_id=0 00:28:44.242 11:53:04 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:44.242 11:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.242 11:53:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.242 11:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.242 11:53:04 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:44.242 11:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.242 11:53:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.242 11:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.242 11:53:04 -- target/dif.sh@109 -- # NULL_DIF=2 00:28:44.242 11:53:04 -- target/dif.sh@109 -- # bs=4k 00:28:44.242 11:53:04 -- target/dif.sh@109 -- # numjobs=8 00:28:44.242 11:53:04 -- target/dif.sh@109 -- # iodepth=16 00:28:44.242 11:53:04 -- target/dif.sh@109 -- # runtime= 00:28:44.242 11:53:04 -- target/dif.sh@109 -- # files=2 00:28:44.242 11:53:04 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:28:44.242 11:53:04 -- target/dif.sh@28 -- # local sub 00:28:44.242 11:53:04 -- target/dif.sh@30 -- # for sub in "$@" 00:28:44.242 11:53:04 -- target/dif.sh@31 -- # create_subsystem 0 00:28:44.242 11:53:04 -- target/dif.sh@18 -- # local sub_id=0 00:28:44.242 11:53:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:28:44.242 11:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.242 11:53:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.242 bdev_null0 00:28:44.242 11:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.242 11:53:04 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:44.242 11:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.242 11:53:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.502 11:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.502 11:53:04 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:44.502 11:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.502 11:53:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.502 11:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.502 11:53:04 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:44.502 11:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.502 11:53:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.502 [2024-11-28 11:53:04.312968] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:44.502 11:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.502 11:53:04 -- target/dif.sh@30 -- # for sub in "$@" 00:28:44.502 11:53:04 -- target/dif.sh@31 -- # create_subsystem 1 00:28:44.502 11:53:04 -- target/dif.sh@18 -- # local sub_id=1 00:28:44.502 11:53:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:28:44.502 11:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.502 11:53:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.502 bdev_null1 00:28:44.502 11:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.502 11:53:04 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:44.502 11:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.502 11:53:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.502 11:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.502 11:53:04 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:44.502 11:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.502 11:53:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.502 11:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.502 11:53:04 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:44.502 11:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.502 11:53:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.502 11:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.502 11:53:04 -- target/dif.sh@30 -- # for sub in "$@" 00:28:44.502 11:53:04 -- target/dif.sh@31 -- # create_subsystem 2 00:28:44.502 11:53:04 -- target/dif.sh@18 -- # local sub_id=2 00:28:44.502 11:53:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:28:44.502 11:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.502 11:53:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.502 bdev_null2 00:28:44.502 11:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.502 11:53:04 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:28:44.502 11:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.502 11:53:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.502 11:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.502 11:53:04 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:28:44.502 11:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.502 11:53:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.502 11:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.502 11:53:04 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:28:44.502 11:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.502 11:53:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.502 11:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.502 11:53:04 -- target/dif.sh@112 -- # fio /dev/fd/62 00:28:44.502 11:53:04 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:44.502 11:53:04 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:28:44.502 11:53:04 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:44.502 11:53:04 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:44.502 11:53:04 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:28:44.502 11:53:04 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:44.502 11:53:04 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:44.502 11:53:04 -- target/dif.sh@82 -- # gen_fio_conf 00:28:44.502 11:53:04 -- nvmf/common.sh@520 -- # config=() 00:28:44.502 11:53:04 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:44.502 11:53:04 -- nvmf/common.sh@520 -- # local subsystem config 00:28:44.502 11:53:04 -- common/autotest_common.sh@1330 -- # shift 00:28:44.502 11:53:04 -- target/dif.sh@54 -- # local file 00:28:44.502 11:53:04 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:44.502 11:53:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:44.502 11:53:04 -- target/dif.sh@56 -- # cat 00:28:44.502 11:53:04 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:44.502 11:53:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:44.502 { 00:28:44.502 "params": { 00:28:44.502 "name": "Nvme$subsystem", 00:28:44.502 "trtype": "$TEST_TRANSPORT", 00:28:44.502 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:44.502 "adrfam": "ipv4", 00:28:44.502 "trsvcid": "$NVMF_PORT", 00:28:44.502 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:44.502 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:44.502 "hdgst": ${hdgst:-false}, 00:28:44.502 "ddgst": ${ddgst:-false} 00:28:44.502 }, 00:28:44.502 "method": "bdev_nvme_attach_controller" 00:28:44.502 } 00:28:44.502 EOF 00:28:44.502 )") 00:28:44.502 11:53:04 -- nvmf/common.sh@542 -- # cat 00:28:44.502 11:53:04 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:44.502 11:53:04 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:44.502 11:53:04 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:44.502 11:53:04 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:44.502 11:53:04 -- target/dif.sh@72 -- # (( file <= files )) 00:28:44.502 11:53:04 -- target/dif.sh@73 -- # cat 00:28:44.502 11:53:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:44.502 11:53:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:44.502 { 00:28:44.502 "params": { 00:28:44.502 "name": "Nvme$subsystem", 00:28:44.502 "trtype": "$TEST_TRANSPORT", 00:28:44.502 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:44.502 "adrfam": "ipv4", 00:28:44.502 "trsvcid": "$NVMF_PORT", 00:28:44.502 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:44.503 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:44.503 "hdgst": ${hdgst:-false}, 00:28:44.503 "ddgst": ${ddgst:-false} 00:28:44.503 }, 00:28:44.503 "method": "bdev_nvme_attach_controller" 00:28:44.503 } 00:28:44.503 EOF 00:28:44.503 )") 00:28:44.503 11:53:04 -- target/dif.sh@72 -- # (( file++ )) 00:28:44.503 11:53:04 -- nvmf/common.sh@542 -- # cat 00:28:44.503 11:53:04 -- target/dif.sh@72 -- # (( file <= files )) 00:28:44.503 11:53:04 -- target/dif.sh@73 -- # cat 00:28:44.503 11:53:04 -- target/dif.sh@72 -- # (( file++ )) 00:28:44.503 11:53:04 -- target/dif.sh@72 -- # (( file <= files )) 00:28:44.503 11:53:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:44.503 11:53:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:44.503 { 00:28:44.503 "params": { 00:28:44.503 "name": "Nvme$subsystem", 00:28:44.503 "trtype": "$TEST_TRANSPORT", 00:28:44.503 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:44.503 "adrfam": "ipv4", 00:28:44.503 "trsvcid": "$NVMF_PORT", 00:28:44.503 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:44.503 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:44.503 "hdgst": ${hdgst:-false}, 00:28:44.503 "ddgst": ${ddgst:-false} 00:28:44.503 }, 00:28:44.503 "method": "bdev_nvme_attach_controller" 00:28:44.503 } 00:28:44.503 EOF 00:28:44.503 )") 00:28:44.503 11:53:04 -- nvmf/common.sh@542 -- # cat 00:28:44.503 11:53:04 -- nvmf/common.sh@544 -- # jq . 00:28:44.503 11:53:04 -- nvmf/common.sh@545 -- # IFS=, 00:28:44.503 11:53:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:44.503 "params": { 00:28:44.503 "name": "Nvme0", 00:28:44.503 "trtype": "tcp", 00:28:44.503 "traddr": "10.0.0.2", 00:28:44.503 "adrfam": "ipv4", 00:28:44.503 "trsvcid": "4420", 00:28:44.503 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:44.503 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:44.503 "hdgst": false, 00:28:44.503 "ddgst": false 00:28:44.503 }, 00:28:44.503 "method": "bdev_nvme_attach_controller" 00:28:44.503 },{ 00:28:44.503 "params": { 00:28:44.503 "name": "Nvme1", 00:28:44.503 "trtype": "tcp", 00:28:44.503 "traddr": "10.0.0.2", 00:28:44.503 "adrfam": "ipv4", 00:28:44.503 "trsvcid": "4420", 00:28:44.503 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:44.503 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:44.503 "hdgst": false, 00:28:44.503 "ddgst": false 00:28:44.503 }, 00:28:44.503 "method": "bdev_nvme_attach_controller" 00:28:44.503 },{ 00:28:44.503 "params": { 00:28:44.503 "name": "Nvme2", 00:28:44.503 "trtype": "tcp", 00:28:44.503 "traddr": "10.0.0.2", 00:28:44.503 "adrfam": "ipv4", 00:28:44.503 "trsvcid": "4420", 00:28:44.503 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:28:44.503 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:28:44.503 "hdgst": false, 00:28:44.503 "ddgst": false 00:28:44.503 }, 00:28:44.503 "method": "bdev_nvme_attach_controller" 00:28:44.503 }' 00:28:44.503 11:53:04 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:44.503 11:53:04 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:44.503 11:53:04 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:44.503 11:53:04 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:44.503 11:53:04 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:44.503 11:53:04 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:44.503 11:53:04 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:44.503 11:53:04 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:44.503 11:53:04 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:44.503 11:53:04 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:44.769 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:44.769 ... 00:28:44.769 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:44.769 ... 00:28:44.770 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:44.770 ... 00:28:44.770 fio-3.35 00:28:44.770 Starting 24 threads 00:28:44.770 EAL: No free 2048 kB hugepages reported on node 1 00:28:45.817 [2024-11-28 11:53:05.603908] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:45.817 [2024-11-28 11:53:05.603978] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:55.793 00:28:55.793 filename0: (groupid=0, jobs=1): err= 0: pid=3944124: Thu Nov 28 11:53:15 2024 00:28:55.793 read: IOPS=498, BW=1995KiB/s (2043kB/s)(19.5MiB/10008msec) 00:28:55.793 slat (usec): min=8, max=149, avg=40.62, stdev=21.36 00:28:55.793 clat (usec): min=8819, max=42974, avg=31717.40, stdev=2198.68 00:28:55.793 lat (usec): min=8832, max=43014, avg=31758.02, stdev=2197.66 00:28:55.793 clat percentiles (usec): 00:28:55.793 | 1.00th=[29492], 5.00th=[30540], 10.00th=[30802], 20.00th=[31065], 00:28:55.793 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:28:55.793 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33162], 00:28:55.793 | 99.00th=[40109], 99.50th=[40633], 99.90th=[42730], 99.95th=[42730], 00:28:55.793 | 99.99th=[42730] 00:28:55.793 bw ( KiB/s): min= 1792, max= 2048, per=4.18%, avg=1990.40, stdev=87.85, samples=20 00:28:55.793 iops : min= 448, max= 512, avg=497.60, stdev=21.96, samples=20 00:28:55.793 lat (msec) : 10=0.28%, 20=0.22%, 50=99.50% 00:28:55.793 cpu : usr=95.59%, sys=2.39%, ctx=91, majf=0, minf=87 00:28:55.793 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:55.793 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.793 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.793 issued rwts: total=4992,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.793 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.793 filename0: (groupid=0, jobs=1): err= 0: pid=3944125: Thu Nov 28 11:53:15 2024 00:28:55.793 read: IOPS=497, BW=1989KiB/s (2036kB/s)(19.4MiB/10009msec) 00:28:55.793 slat (usec): min=11, max=102, avg=38.48, stdev=13.30 00:28:55.793 clat (usec): min=8394, max=57176, avg=31817.99, stdev=2430.59 00:28:55.793 lat (usec): min=8407, max=57217, avg=31856.48, stdev=2432.82 00:28:55.793 clat percentiles (usec): 00:28:55.793 | 1.00th=[30016], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:28:55.793 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:28:55.793 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33162], 00:28:55.793 | 99.00th=[40109], 99.50th=[42206], 99.90th=[56886], 99.95th=[56886], 00:28:55.793 | 99.99th=[57410] 00:28:55.793 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1980.63, stdev=89.18, samples=19 00:28:55.793 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:28:55.793 lat (msec) : 10=0.28%, 20=0.04%, 50=99.36%, 100=0.32% 00:28:55.793 cpu : usr=98.67%, sys=0.92%, ctx=12, majf=0, minf=51 00:28:55.793 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:55.793 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.793 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.793 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.793 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.793 filename0: (groupid=0, jobs=1): err= 0: pid=3944126: Thu Nov 28 11:53:15 2024 00:28:55.793 read: IOPS=496, BW=1987KiB/s (2034kB/s)(19.4MiB/10019msec) 00:28:55.793 slat (usec): min=7, max=145, avg=53.81, stdev=29.43 00:28:55.793 clat (usec): min=25528, max=44240, avg=31752.22, stdev=1704.77 00:28:55.793 lat (usec): min=25560, max=44255, avg=31806.03, stdev=1697.14 00:28:55.793 clat percentiles (usec): 00:28:55.793 | 1.00th=[29754], 5.00th=[30278], 10.00th=[30540], 20.00th=[31065], 00:28:55.793 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:28:55.793 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33162], 00:28:55.793 | 99.00th=[40109], 99.50th=[41681], 99.90th=[44303], 99.95th=[44303], 00:28:55.793 | 99.99th=[44303] 00:28:55.793 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1980.63, stdev=89.18, samples=19 00:28:55.793 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:28:55.793 lat (msec) : 50=100.00% 00:28:55.793 cpu : usr=96.76%, sys=1.88%, ctx=205, majf=0, minf=82 00:28:55.793 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:55.793 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.793 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.793 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.793 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.793 filename0: (groupid=0, jobs=1): err= 0: pid=3944127: Thu Nov 28 11:53:15 2024 00:28:55.793 read: IOPS=482, BW=1931KiB/s (1977kB/s)(18.9MiB/10007msec) 00:28:55.793 slat (usec): min=8, max=173, avg=65.76, stdev=38.04 00:28:55.793 clat (usec): min=7484, max=59034, avg=32730.34, stdev=4911.08 00:28:55.793 lat (usec): min=7492, max=59062, avg=32796.10, stdev=4909.83 00:28:55.793 clat percentiles (usec): 00:28:55.793 | 1.00th=[22414], 5.00th=[30278], 10.00th=[30802], 20.00th=[31065], 00:28:55.793 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:28:55.793 | 70.00th=[32113], 80.00th=[32375], 90.00th=[36963], 95.00th=[44303], 00:28:55.793 | 99.00th=[53740], 99.50th=[55837], 99.90th=[58983], 99.95th=[58983], 00:28:55.793 | 99.99th=[58983] 00:28:55.793 bw ( KiB/s): min= 1776, max= 2048, per=4.03%, avg=1920.58, stdev=95.35, samples=19 00:28:55.793 iops : min= 444, max= 512, avg=480.11, stdev=23.89, samples=19 00:28:55.793 lat (msec) : 10=0.14%, 20=0.68%, 50=97.76%, 100=1.41% 00:28:55.793 cpu : usr=98.57%, sys=0.97%, ctx=9, majf=0, minf=55 00:28:55.793 IO depths : 1=0.7%, 2=5.3%, 4=19.3%, 8=62.0%, 16=12.8%, 32=0.0%, >=64=0.0% 00:28:55.793 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.793 complete : 0=0.0%, 4=93.1%, 8=2.2%, 16=4.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.793 issued rwts: total=4830,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.793 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.793 filename0: (groupid=0, jobs=1): err= 0: pid=3944128: Thu Nov 28 11:53:15 2024 00:28:55.793 read: IOPS=496, BW=1987KiB/s (2034kB/s)(19.4MiB/10019msec) 00:28:55.793 slat (usec): min=11, max=116, avg=43.38, stdev=16.18 00:28:55.793 clat (usec): min=22907, max=57309, avg=31829.00, stdev=1693.80 00:28:55.793 lat (usec): min=22959, max=57336, avg=31872.38, stdev=1695.21 00:28:55.793 clat percentiles (usec): 00:28:55.793 | 1.00th=[30016], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:28:55.793 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:28:55.793 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33162], 00:28:55.793 | 99.00th=[40109], 99.50th=[42206], 99.90th=[43779], 99.95th=[44303], 00:28:55.793 | 99.99th=[57410] 00:28:55.794 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1980.63, stdev=89.18, samples=19 00:28:55.794 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:28:55.794 lat (msec) : 50=99.96%, 100=0.04% 00:28:55.794 cpu : usr=98.58%, sys=0.99%, ctx=12, majf=0, minf=59 00:28:55.794 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:28:55.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.794 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.794 filename0: (groupid=0, jobs=1): err= 0: pid=3944129: Thu Nov 28 11:53:15 2024 00:28:55.794 read: IOPS=496, BW=1987KiB/s (2034kB/s)(19.4MiB/10019msec) 00:28:55.794 slat (usec): min=7, max=115, avg=37.10, stdev=14.80 00:28:55.794 clat (usec): min=25676, max=44263, avg=31895.38, stdev=1615.00 00:28:55.794 lat (usec): min=25719, max=44280, avg=31932.48, stdev=1617.01 00:28:55.794 clat percentiles (usec): 00:28:55.794 | 1.00th=[30278], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:28:55.794 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:28:55.794 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33162], 00:28:55.794 | 99.00th=[40109], 99.50th=[41681], 99.90th=[44303], 99.95th=[44303], 00:28:55.794 | 99.99th=[44303] 00:28:55.794 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1980.63, stdev=89.18, samples=19 00:28:55.794 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:28:55.794 lat (msec) : 50=100.00% 00:28:55.794 cpu : usr=97.86%, sys=1.34%, ctx=161, majf=0, minf=58 00:28:55.794 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:55.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.794 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.794 filename0: (groupid=0, jobs=1): err= 0: pid=3944130: Thu Nov 28 11:53:15 2024 00:28:55.794 read: IOPS=495, BW=1984KiB/s (2031kB/s)(19.4MiB/10002msec) 00:28:55.794 slat (nsec): min=7793, max=97390, avg=21022.86, stdev=19708.84 00:28:55.794 clat (usec): min=28932, max=61757, avg=32064.28, stdev=2222.94 00:28:55.794 lat (usec): min=28988, max=61782, avg=32085.31, stdev=2224.10 00:28:55.794 clat percentiles (usec): 00:28:55.794 | 1.00th=[30016], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:28:55.794 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:28:55.794 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32900], 95.00th=[33162], 00:28:55.794 | 99.00th=[40109], 99.50th=[41681], 99.90th=[61604], 99.95th=[61604], 00:28:55.794 | 99.99th=[61604] 00:28:55.794 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1980.63, stdev=89.18, samples=19 00:28:55.794 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:28:55.794 lat (msec) : 50=99.68%, 100=0.32% 00:28:55.794 cpu : usr=98.63%, sys=0.97%, ctx=14, majf=0, minf=85 00:28:55.794 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:55.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 issued rwts: total=4960,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.794 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.794 filename0: (groupid=0, jobs=1): err= 0: pid=3944131: Thu Nov 28 11:53:15 2024 00:28:55.794 read: IOPS=524, BW=2098KiB/s (2149kB/s)(20.5MiB/10005msec) 00:28:55.794 slat (usec): min=7, max=133, avg=23.69, stdev=23.98 00:28:55.794 clat (usec): min=10526, max=56857, avg=30353.89, stdev=5143.21 00:28:55.794 lat (usec): min=10534, max=56899, avg=30377.58, stdev=5148.00 00:28:55.794 clat percentiles (usec): 00:28:55.794 | 1.00th=[16188], 5.00th=[21103], 10.00th=[23462], 20.00th=[25822], 00:28:55.794 | 30.00th=[31065], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:28:55.794 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32900], 95.00th=[38536], 00:28:55.794 | 99.00th=[43779], 99.50th=[47973], 99.90th=[56886], 99.95th=[56886], 00:28:55.794 | 99.99th=[56886] 00:28:55.794 bw ( KiB/s): min= 1760, max= 2352, per=4.39%, avg=2092.63, stdev=159.87, samples=19 00:28:55.794 iops : min= 440, max= 588, avg=523.16, stdev=39.97, samples=19 00:28:55.794 lat (msec) : 20=4.76%, 50=94.86%, 100=0.38% 00:28:55.794 cpu : usr=98.76%, sys=0.83%, ctx=14, majf=0, minf=61 00:28:55.794 IO depths : 1=0.2%, 2=2.0%, 4=8.8%, 8=73.8%, 16=15.1%, 32=0.0%, >=64=0.0% 00:28:55.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 complete : 0=0.0%, 4=90.6%, 8=6.5%, 16=2.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 issued rwts: total=5248,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.794 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.794 filename1: (groupid=0, jobs=1): err= 0: pid=3944132: Thu Nov 28 11:53:15 2024 00:28:55.794 read: IOPS=498, BW=1995KiB/s (2043kB/s)(19.5MiB/10007msec) 00:28:55.794 slat (usec): min=4, max=137, avg=41.76, stdev=22.16 00:28:55.794 clat (usec): min=10096, max=43052, avg=31722.00, stdev=2134.98 00:28:55.794 lat (usec): min=10164, max=43082, avg=31763.76, stdev=2134.54 00:28:55.794 clat percentiles (usec): 00:28:55.794 | 1.00th=[29492], 5.00th=[30540], 10.00th=[30802], 20.00th=[31065], 00:28:55.794 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:28:55.794 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33162], 00:28:55.794 | 99.00th=[40109], 99.50th=[40633], 99.90th=[42730], 99.95th=[42730], 00:28:55.794 | 99.99th=[43254] 00:28:55.794 bw ( KiB/s): min= 1792, max= 2052, per=4.19%, avg=1994.32, stdev=88.78, samples=19 00:28:55.794 iops : min= 448, max= 513, avg=498.58, stdev=22.19, samples=19 00:28:55.794 lat (msec) : 20=0.50%, 50=99.50% 00:28:55.794 cpu : usr=98.64%, sys=0.94%, ctx=15, majf=0, minf=52 00:28:55.794 IO depths : 1=6.1%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:55.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 issued rwts: total=4992,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.794 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.794 filename1: (groupid=0, jobs=1): err= 0: pid=3944133: Thu Nov 28 11:53:15 2024 00:28:55.794 read: IOPS=496, BW=1987KiB/s (2034kB/s)(19.4MiB/10019msec) 00:28:55.794 slat (usec): min=7, max=141, avg=35.88, stdev=19.93 00:28:55.794 clat (usec): min=25650, max=44165, avg=31919.60, stdev=1641.24 00:28:55.794 lat (usec): min=25699, max=44180, avg=31955.48, stdev=1639.92 00:28:55.794 clat percentiles (usec): 00:28:55.794 | 1.00th=[30016], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:28:55.794 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:28:55.794 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33424], 00:28:55.794 | 99.00th=[40109], 99.50th=[41681], 99.90th=[44303], 99.95th=[44303], 00:28:55.794 | 99.99th=[44303] 00:28:55.794 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1980.63, stdev=89.18, samples=19 00:28:55.794 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:28:55.794 lat (msec) : 50=100.00% 00:28:55.794 cpu : usr=98.60%, sys=0.98%, ctx=19, majf=0, minf=85 00:28:55.794 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:55.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.794 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.794 filename1: (groupid=0, jobs=1): err= 0: pid=3944134: Thu Nov 28 11:53:15 2024 00:28:55.794 read: IOPS=497, BW=1990KiB/s (2038kB/s)(19.5MiB/10015msec) 00:28:55.794 slat (usec): min=6, max=106, avg=39.28, stdev=15.96 00:28:55.794 clat (usec): min=16761, max=62002, avg=31824.32, stdev=2566.91 00:28:55.794 lat (usec): min=16827, max=62019, avg=31863.60, stdev=2566.41 00:28:55.794 clat percentiles (usec): 00:28:55.794 | 1.00th=[25560], 5.00th=[30540], 10.00th=[31065], 20.00th=[31065], 00:28:55.794 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:28:55.794 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[33162], 00:28:55.794 | 99.00th=[40633], 99.50th=[43254], 99.90th=[62129], 99.95th=[62129], 00:28:55.794 | 99.99th=[62129] 00:28:55.794 bw ( KiB/s): min= 1840, max= 2048, per=4.16%, avg=1983.16, stdev=72.44, samples=19 00:28:55.794 iops : min= 460, max= 512, avg=495.79, stdev=18.11, samples=19 00:28:55.794 lat (msec) : 20=0.34%, 50=99.34%, 100=0.32% 00:28:55.794 cpu : usr=98.39%, sys=1.09%, ctx=42, majf=0, minf=60 00:28:55.794 IO depths : 1=6.0%, 2=12.0%, 4=24.0%, 8=51.3%, 16=6.7%, 32=0.0%, >=64=0.0% 00:28:55.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 complete : 0=0.0%, 4=93.9%, 8=0.4%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 issued rwts: total=4982,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.794 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.794 filename1: (groupid=0, jobs=1): err= 0: pid=3944135: Thu Nov 28 11:53:15 2024 00:28:55.794 read: IOPS=500, BW=2002KiB/s (2050kB/s)(19.6MiB/10011msec) 00:28:55.794 slat (usec): min=4, max=157, avg=23.76, stdev=18.81 00:28:55.794 clat (usec): min=10944, max=42241, avg=31753.77, stdev=2260.82 00:28:55.794 lat (usec): min=10953, max=42258, avg=31777.53, stdev=2260.68 00:28:55.794 clat percentiles (usec): 00:28:55.794 | 1.00th=[21627], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:28:55.794 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:28:55.794 | 70.00th=[32113], 80.00th=[32113], 90.00th=[32637], 95.00th=[33424], 00:28:55.794 | 99.00th=[40109], 99.50th=[40633], 99.90th=[42206], 99.95th=[42206], 00:28:55.794 | 99.99th=[42206] 00:28:55.794 bw ( KiB/s): min= 1792, max= 2200, per=4.19%, avg=1998.00, stdev=89.83, samples=20 00:28:55.794 iops : min= 448, max= 550, avg=499.50, stdev=22.46, samples=20 00:28:55.794 lat (msec) : 20=0.84%, 50=99.16% 00:28:55.794 cpu : usr=98.30%, sys=1.20%, ctx=21, majf=0, minf=82 00:28:55.794 IO depths : 1=6.0%, 2=12.1%, 4=24.3%, 8=51.1%, 16=6.5%, 32=0.0%, >=64=0.0% 00:28:55.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 complete : 0=0.0%, 4=93.9%, 8=0.2%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.794 issued rwts: total=5011,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.794 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.794 filename1: (groupid=0, jobs=1): err= 0: pid=3944136: Thu Nov 28 11:53:15 2024 00:28:55.794 read: IOPS=496, BW=1986KiB/s (2034kB/s)(19.4MiB/10022msec) 00:28:55.794 slat (usec): min=8, max=145, avg=37.51, stdev=17.51 00:28:55.795 clat (usec): min=17710, max=45098, avg=31882.18, stdev=1709.80 00:28:55.795 lat (usec): min=17816, max=45116, avg=31919.69, stdev=1707.98 00:28:55.795 clat percentiles (usec): 00:28:55.795 | 1.00th=[30016], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:28:55.795 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:28:55.795 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33162], 00:28:55.795 | 99.00th=[40109], 99.50th=[42730], 99.90th=[44303], 99.95th=[44303], 00:28:55.795 | 99.99th=[45351] 00:28:55.795 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1980.63, stdev=89.18, samples=19 00:28:55.795 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:28:55.795 lat (msec) : 20=0.04%, 50=99.96% 00:28:55.795 cpu : usr=96.28%, sys=2.19%, ctx=101, majf=0, minf=42 00:28:55.795 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:55.795 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.795 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.795 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.795 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.795 filename1: (groupid=0, jobs=1): err= 0: pid=3944137: Thu Nov 28 11:53:15 2024 00:28:55.795 read: IOPS=496, BW=1987KiB/s (2034kB/s)(19.4MiB/10019msec) 00:28:55.795 slat (usec): min=8, max=125, avg=39.97, stdev=13.59 00:28:55.795 clat (usec): min=25608, max=44247, avg=31861.60, stdev=1619.29 00:28:55.795 lat (usec): min=25640, max=44261, avg=31901.57, stdev=1621.03 00:28:55.795 clat percentiles (usec): 00:28:55.795 | 1.00th=[30278], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:28:55.795 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:28:55.795 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33162], 00:28:55.795 | 99.00th=[40109], 99.50th=[41681], 99.90th=[44303], 99.95th=[44303], 00:28:55.795 | 99.99th=[44303] 00:28:55.795 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1980.63, stdev=89.18, samples=19 00:28:55.795 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:28:55.795 lat (msec) : 50=100.00% 00:28:55.795 cpu : usr=95.90%, sys=2.38%, ctx=164, majf=0, minf=48 00:28:55.795 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:55.795 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.795 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.795 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.795 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.795 filename1: (groupid=0, jobs=1): err= 0: pid=3944138: Thu Nov 28 11:53:15 2024 00:28:55.795 read: IOPS=495, BW=1981KiB/s (2028kB/s)(19.4MiB/10046msec) 00:28:55.795 slat (usec): min=7, max=150, avg=33.11, stdev=28.69 00:28:55.795 clat (usec): min=10769, max=55000, avg=32091.84, stdev=5267.45 00:28:55.795 lat (usec): min=10790, max=55055, avg=32124.95, stdev=5273.77 00:28:55.795 clat percentiles (usec): 00:28:55.795 | 1.00th=[17433], 5.00th=[23987], 10.00th=[28181], 20.00th=[31065], 00:28:55.795 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:28:55.795 | 70.00th=[32113], 80.00th=[32637], 90.00th=[38536], 95.00th=[43779], 00:28:55.795 | 99.00th=[51643], 99.50th=[53740], 99.90th=[54789], 99.95th=[54789], 00:28:55.795 | 99.99th=[54789] 00:28:55.795 bw ( KiB/s): min= 1592, max= 2144, per=4.16%, avg=1980.21, stdev=138.29, samples=19 00:28:55.795 iops : min= 398, max= 536, avg=495.05, stdev=34.57, samples=19 00:28:55.795 lat (msec) : 20=3.08%, 50=95.92%, 100=1.01% 00:28:55.795 cpu : usr=95.54%, sys=2.52%, ctx=117, majf=0, minf=96 00:28:55.795 IO depths : 1=0.3%, 2=2.0%, 4=7.9%, 8=74.1%, 16=15.7%, 32=0.0%, >=64=0.0% 00:28:55.795 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.795 complete : 0=0.0%, 4=90.6%, 8=7.1%, 16=2.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.795 issued rwts: total=4975,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.795 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.795 filename1: (groupid=0, jobs=1): err= 0: pid=3944139: Thu Nov 28 11:53:15 2024 00:28:55.795 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10006msec) 00:28:55.795 slat (usec): min=8, max=125, avg=39.42, stdev=14.36 00:28:55.795 clat (usec): min=8338, max=54518, avg=31802.14, stdev=2341.37 00:28:55.795 lat (usec): min=8351, max=54557, avg=31841.56, stdev=2343.93 00:28:55.795 clat percentiles (usec): 00:28:55.795 | 1.00th=[30016], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:28:55.795 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:28:55.795 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33162], 00:28:55.795 | 99.00th=[40109], 99.50th=[41681], 99.90th=[54264], 99.95th=[54264], 00:28:55.795 | 99.99th=[54264] 00:28:55.795 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1980.79, stdev=88.83, samples=19 00:28:55.795 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:28:55.795 lat (msec) : 10=0.32%, 50=99.36%, 100=0.32% 00:28:55.795 cpu : usr=98.63%, sys=0.98%, ctx=10, majf=0, minf=53 00:28:55.795 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:55.795 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.795 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.795 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.795 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.795 filename2: (groupid=0, jobs=1): err= 0: pid=3944140: Thu Nov 28 11:53:15 2024 00:28:55.795 read: IOPS=496, BW=1987KiB/s (2034kB/s)(19.4MiB/10019msec) 00:28:55.795 slat (nsec): min=6106, max=77119, avg=32291.27, stdev=12638.74 00:28:55.795 clat (usec): min=25628, max=43717, avg=31921.09, stdev=1650.36 00:28:55.795 lat (usec): min=25651, max=43734, avg=31953.38, stdev=1646.94 00:28:55.795 clat percentiles (usec): 00:28:55.795 | 1.00th=[30278], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:28:55.795 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:28:55.795 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33162], 00:28:55.795 | 99.00th=[40633], 99.50th=[41681], 99.90th=[43779], 99.95th=[43779], 00:28:55.795 | 99.99th=[43779] 00:28:55.795 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1980.63, stdev=89.18, samples=19 00:28:55.795 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:28:55.795 lat (msec) : 50=100.00% 00:28:55.795 cpu : usr=97.68%, sys=1.54%, ctx=60, majf=0, minf=77 00:28:55.795 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:55.795 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.795 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.795 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.795 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.795 filename2: (groupid=0, jobs=1): err= 0: pid=3944141: Thu Nov 28 11:53:15 2024 00:28:55.795 read: IOPS=500, BW=2002KiB/s (2050kB/s)(19.6MiB/10002msec) 00:28:55.795 slat (usec): min=7, max=133, avg=32.53, stdev=23.21 00:28:55.795 clat (usec): min=12214, max=68377, avg=31740.24, stdev=4621.52 00:28:55.795 lat (usec): min=12227, max=68421, avg=31772.77, stdev=4623.85 00:28:55.795 clat percentiles (usec): 00:28:55.795 | 1.00th=[16712], 5.00th=[23987], 10.00th=[30540], 20.00th=[31065], 00:28:55.795 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:28:55.795 | 70.00th=[32113], 80.00th=[32375], 90.00th=[33162], 95.00th=[39060], 00:28:55.795 | 99.00th=[46924], 99.50th=[56361], 99.90th=[68682], 99.95th=[68682], 00:28:55.795 | 99.99th=[68682] 00:28:55.795 bw ( KiB/s): min= 1720, max= 2304, per=4.20%, avg=2000.00, stdev=129.46, samples=19 00:28:55.795 iops : min= 430, max= 576, avg=500.00, stdev=32.37, samples=19 00:28:55.795 lat (msec) : 20=2.88%, 50=96.46%, 100=0.66% 00:28:55.795 cpu : usr=98.57%, sys=1.01%, ctx=19, majf=0, minf=68 00:28:55.795 IO depths : 1=2.4%, 2=5.9%, 4=14.4%, 8=65.1%, 16=12.3%, 32=0.0%, >=64=0.0% 00:28:55.795 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.795 complete : 0=0.0%, 4=91.9%, 8=4.5%, 16=3.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.795 issued rwts: total=5006,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.795 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.795 filename2: (groupid=0, jobs=1): err= 0: pid=3944142: Thu Nov 28 11:53:15 2024 00:28:55.795 read: IOPS=495, BW=1983KiB/s (2031kB/s)(19.4MiB/10005msec) 00:28:55.795 slat (usec): min=6, max=149, avg=46.25, stdev=26.29 00:28:55.795 clat (usec): min=18090, max=59910, avg=31884.22, stdev=2307.05 00:28:55.795 lat (usec): min=18102, max=59926, avg=31930.48, stdev=2303.97 00:28:55.795 clat percentiles (usec): 00:28:55.795 | 1.00th=[29492], 5.00th=[30540], 10.00th=[30802], 20.00th=[31065], 00:28:55.795 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:28:55.795 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33424], 00:28:55.795 | 99.00th=[40633], 99.50th=[42730], 99.90th=[60031], 99.95th=[60031], 00:28:55.795 | 99.99th=[60031] 00:28:55.795 bw ( KiB/s): min= 1776, max= 2048, per=4.16%, avg=1980.63, stdev=88.21, samples=19 00:28:55.795 iops : min= 444, max= 512, avg=495.16, stdev=22.05, samples=19 00:28:55.795 lat (msec) : 20=0.10%, 50=99.58%, 100=0.32% 00:28:55.795 cpu : usr=97.96%, sys=1.44%, ctx=45, majf=0, minf=64 00:28:55.795 IO depths : 1=4.9%, 2=11.1%, 4=24.9%, 8=51.5%, 16=7.6%, 32=0.0%, >=64=0.0% 00:28:55.795 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.795 complete : 0=0.0%, 4=94.2%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.795 issued rwts: total=4960,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.795 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.795 filename2: (groupid=0, jobs=1): err= 0: pid=3944143: Thu Nov 28 11:53:15 2024 00:28:55.795 read: IOPS=496, BW=1987KiB/s (2034kB/s)(19.4MiB/10019msec) 00:28:55.795 slat (usec): min=12, max=137, avg=45.87, stdev=20.53 00:28:55.795 clat (usec): min=25620, max=44143, avg=31810.04, stdev=1642.40 00:28:55.795 lat (usec): min=25660, max=44171, avg=31855.91, stdev=1641.45 00:28:55.795 clat percentiles (usec): 00:28:55.795 | 1.00th=[29754], 5.00th=[30540], 10.00th=[30802], 20.00th=[31065], 00:28:55.795 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:28:55.795 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33162], 00:28:55.795 | 99.00th=[40109], 99.50th=[41681], 99.90th=[44303], 99.95th=[44303], 00:28:55.795 | 99.99th=[44303] 00:28:55.795 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1980.63, stdev=89.18, samples=19 00:28:55.795 iops : min= 448, max= 512, avg=495.16, stdev=22.29, samples=19 00:28:55.795 lat (msec) : 50=100.00% 00:28:55.795 cpu : usr=97.63%, sys=1.43%, ctx=48, majf=0, minf=62 00:28:55.795 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:55.796 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.796 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.796 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.796 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.796 filename2: (groupid=0, jobs=1): err= 0: pid=3944144: Thu Nov 28 11:53:15 2024 00:28:55.796 read: IOPS=495, BW=1982KiB/s (2029kB/s)(19.4MiB/10008msec) 00:28:55.796 slat (usec): min=9, max=150, avg=65.35, stdev=36.06 00:28:55.796 clat (usec): min=16005, max=63482, avg=31748.96, stdev=3097.51 00:28:55.796 lat (usec): min=16023, max=63519, avg=31814.31, stdev=3095.53 00:28:55.796 clat percentiles (usec): 00:28:55.796 | 1.00th=[20055], 5.00th=[30016], 10.00th=[30540], 20.00th=[30802], 00:28:55.796 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:28:55.796 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[34341], 00:28:55.796 | 99.00th=[43779], 99.50th=[45876], 99.90th=[63177], 99.95th=[63177], 00:28:55.796 | 99.99th=[63701] 00:28:55.796 bw ( KiB/s): min= 1664, max= 2048, per=4.15%, avg=1978.95, stdev=96.75, samples=19 00:28:55.796 iops : min= 416, max= 512, avg=494.74, stdev=24.19, samples=19 00:28:55.796 lat (msec) : 20=0.97%, 50=98.59%, 100=0.44% 00:28:55.796 cpu : usr=97.79%, sys=1.36%, ctx=45, majf=0, minf=64 00:28:55.796 IO depths : 1=4.5%, 2=10.7%, 4=24.9%, 8=51.9%, 16=8.0%, 32=0.0%, >=64=0.0% 00:28:55.796 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.796 complete : 0=0.0%, 4=94.2%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.796 issued rwts: total=4958,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.796 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.796 filename2: (groupid=0, jobs=1): err= 0: pid=3944145: Thu Nov 28 11:53:15 2024 00:28:55.796 read: IOPS=500, BW=2004KiB/s (2052kB/s)(19.6MiB/10006msec) 00:28:55.796 slat (usec): min=7, max=157, avg=45.62, stdev=36.97 00:28:55.796 clat (usec): min=7827, max=55659, avg=31615.64, stdev=4022.26 00:28:55.796 lat (usec): min=7837, max=55713, avg=31661.26, stdev=4023.31 00:28:55.796 clat percentiles (usec): 00:28:55.796 | 1.00th=[16909], 5.00th=[24773], 10.00th=[30016], 20.00th=[30802], 00:28:55.796 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:28:55.796 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32900], 95.00th=[38536], 00:28:55.796 | 99.00th=[49021], 99.50th=[53216], 99.90th=[54264], 99.95th=[54789], 00:28:55.796 | 99.99th=[55837] 00:28:55.796 bw ( KiB/s): min= 1680, max= 2112, per=4.18%, avg=1993.42, stdev=109.33, samples=19 00:28:55.796 iops : min= 420, max= 528, avg=498.32, stdev=27.41, samples=19 00:28:55.796 lat (msec) : 10=0.18%, 20=1.06%, 50=98.02%, 100=0.74% 00:28:55.796 cpu : usr=98.73%, sys=0.84%, ctx=14, majf=0, minf=59 00:28:55.796 IO depths : 1=1.6%, 2=4.9%, 4=13.9%, 8=66.5%, 16=13.2%, 32=0.0%, >=64=0.0% 00:28:55.796 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.796 complete : 0=0.0%, 4=91.8%, 8=4.7%, 16=3.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.796 issued rwts: total=5012,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.796 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.796 filename2: (groupid=0, jobs=1): err= 0: pid=3944146: Thu Nov 28 11:53:15 2024 00:28:55.796 read: IOPS=498, BW=1995KiB/s (2043kB/s)(19.5MiB/10008msec) 00:28:55.796 slat (nsec): min=5306, max=69527, avg=28612.21, stdev=11227.00 00:28:55.796 clat (usec): min=11812, max=45643, avg=31840.70, stdev=2002.63 00:28:55.796 lat (usec): min=11825, max=45667, avg=31869.31, stdev=2002.27 00:28:55.796 clat percentiles (usec): 00:28:55.796 | 1.00th=[25297], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:28:55.796 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:28:55.796 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33162], 00:28:55.796 | 99.00th=[40633], 99.50th=[40633], 99.90th=[42730], 99.95th=[42730], 00:28:55.796 | 99.99th=[45876] 00:28:55.796 bw ( KiB/s): min= 1792, max= 2048, per=4.19%, avg=1994.11, stdev=88.64, samples=19 00:28:55.796 iops : min= 448, max= 512, avg=498.53, stdev=22.16, samples=19 00:28:55.796 lat (msec) : 20=0.36%, 50=99.64% 00:28:55.796 cpu : usr=97.29%, sys=1.78%, ctx=236, majf=0, minf=65 00:28:55.796 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:55.796 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.796 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.796 issued rwts: total=4992,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.796 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.796 filename2: (groupid=0, jobs=1): err= 0: pid=3944147: Thu Nov 28 11:53:15 2024 00:28:55.796 read: IOPS=497, BW=1990KiB/s (2038kB/s)(19.4MiB/10003msec) 00:28:55.796 slat (usec): min=6, max=313, avg=39.95, stdev=16.75 00:28:55.796 clat (usec): min=17386, max=49957, avg=31834.29, stdev=1673.96 00:28:55.796 lat (usec): min=17402, max=49972, avg=31874.24, stdev=1674.81 00:28:55.796 clat percentiles (usec): 00:28:55.796 | 1.00th=[30278], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:28:55.796 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:28:55.796 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[33162], 00:28:55.796 | 99.00th=[40109], 99.50th=[40633], 99.90th=[42730], 99.95th=[45351], 00:28:55.796 | 99.99th=[50070] 00:28:55.796 bw ( KiB/s): min= 1792, max= 2048, per=4.17%, avg=1987.37, stdev=78.49, samples=19 00:28:55.796 iops : min= 448, max= 512, avg=496.84, stdev=19.62, samples=19 00:28:55.796 lat (msec) : 20=0.08%, 50=99.92% 00:28:55.796 cpu : usr=97.06%, sys=2.09%, ctx=120, majf=0, minf=51 00:28:55.796 IO depths : 1=5.0%, 2=11.2%, 4=25.0%, 8=51.3%, 16=7.5%, 32=0.0%, >=64=0.0% 00:28:55.796 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.796 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.796 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.796 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:55.796 00:28:55.796 Run status group 0 (all jobs): 00:28:55.796 READ: bw=46.5MiB/s (48.8MB/s), 1931KiB/s-2098KiB/s (1977kB/s-2149kB/s), io=467MiB (490MB), run=10002-10046msec 00:28:56.362 11:53:16 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:28:56.362 11:53:16 -- target/dif.sh@43 -- # local sub 00:28:56.362 11:53:16 -- target/dif.sh@45 -- # for sub in "$@" 00:28:56.362 11:53:16 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:56.362 11:53:16 -- target/dif.sh@36 -- # local sub_id=0 00:28:56.362 11:53:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:56.362 11:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.362 11:53:16 -- common/autotest_common.sh@10 -- # set +x 00:28:56.362 11:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.362 11:53:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:56.362 11:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.362 11:53:16 -- common/autotest_common.sh@10 -- # set +x 00:28:56.362 11:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.362 11:53:16 -- target/dif.sh@45 -- # for sub in "$@" 00:28:56.362 11:53:16 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:56.362 11:53:16 -- target/dif.sh@36 -- # local sub_id=1 00:28:56.362 11:53:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:56.362 11:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.362 11:53:16 -- common/autotest_common.sh@10 -- # set +x 00:28:56.362 11:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.362 11:53:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:56.362 11:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.362 11:53:16 -- common/autotest_common.sh@10 -- # set +x 00:28:56.362 11:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.362 11:53:16 -- target/dif.sh@45 -- # for sub in "$@" 00:28:56.362 11:53:16 -- target/dif.sh@46 -- # destroy_subsystem 2 00:28:56.362 11:53:16 -- target/dif.sh@36 -- # local sub_id=2 00:28:56.362 11:53:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:56.362 11:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.362 11:53:16 -- common/autotest_common.sh@10 -- # set +x 00:28:56.362 11:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.362 11:53:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:28:56.362 11:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.362 11:53:16 -- common/autotest_common.sh@10 -- # set +x 00:28:56.362 11:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.362 11:53:16 -- target/dif.sh@115 -- # NULL_DIF=1 00:28:56.362 11:53:16 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:28:56.362 11:53:16 -- target/dif.sh@115 -- # numjobs=2 00:28:56.362 11:53:16 -- target/dif.sh@115 -- # iodepth=8 00:28:56.362 11:53:16 -- target/dif.sh@115 -- # runtime=5 00:28:56.362 11:53:16 -- target/dif.sh@115 -- # files=1 00:28:56.362 11:53:16 -- target/dif.sh@117 -- # create_subsystems 0 1 00:28:56.362 11:53:16 -- target/dif.sh@28 -- # local sub 00:28:56.362 11:53:16 -- target/dif.sh@30 -- # for sub in "$@" 00:28:56.362 11:53:16 -- target/dif.sh@31 -- # create_subsystem 0 00:28:56.362 11:53:16 -- target/dif.sh@18 -- # local sub_id=0 00:28:56.362 11:53:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:56.362 11:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.362 11:53:16 -- common/autotest_common.sh@10 -- # set +x 00:28:56.362 bdev_null0 00:28:56.362 11:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.362 11:53:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:56.362 11:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.362 11:53:16 -- common/autotest_common.sh@10 -- # set +x 00:28:56.362 11:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.362 11:53:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:56.362 11:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.362 11:53:16 -- common/autotest_common.sh@10 -- # set +x 00:28:56.362 11:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.362 11:53:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:56.362 11:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.362 11:53:16 -- common/autotest_common.sh@10 -- # set +x 00:28:56.362 [2024-11-28 11:53:16.205143] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:56.362 11:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.362 11:53:16 -- target/dif.sh@30 -- # for sub in "$@" 00:28:56.362 11:53:16 -- target/dif.sh@31 -- # create_subsystem 1 00:28:56.362 11:53:16 -- target/dif.sh@18 -- # local sub_id=1 00:28:56.362 11:53:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:56.362 11:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.362 11:53:16 -- common/autotest_common.sh@10 -- # set +x 00:28:56.362 bdev_null1 00:28:56.362 11:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.362 11:53:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:56.362 11:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.362 11:53:16 -- common/autotest_common.sh@10 -- # set +x 00:28:56.362 11:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.362 11:53:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:56.362 11:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.362 11:53:16 -- common/autotest_common.sh@10 -- # set +x 00:28:56.362 11:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.362 11:53:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:56.362 11:53:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.362 11:53:16 -- common/autotest_common.sh@10 -- # set +x 00:28:56.362 11:53:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.362 11:53:16 -- target/dif.sh@118 -- # fio /dev/fd/62 00:28:56.362 11:53:16 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:28:56.362 11:53:16 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:56.362 11:53:16 -- nvmf/common.sh@520 -- # config=() 00:28:56.362 11:53:16 -- nvmf/common.sh@520 -- # local subsystem config 00:28:56.362 11:53:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:56.362 11:53:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:56.362 { 00:28:56.362 "params": { 00:28:56.362 "name": "Nvme$subsystem", 00:28:56.362 "trtype": "$TEST_TRANSPORT", 00:28:56.362 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:56.362 "adrfam": "ipv4", 00:28:56.362 "trsvcid": "$NVMF_PORT", 00:28:56.362 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:56.362 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:56.362 "hdgst": ${hdgst:-false}, 00:28:56.362 "ddgst": ${ddgst:-false} 00:28:56.362 }, 00:28:56.362 "method": "bdev_nvme_attach_controller" 00:28:56.362 } 00:28:56.362 EOF 00:28:56.362 )") 00:28:56.362 11:53:16 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:56.362 11:53:16 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:56.362 11:53:16 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:56.362 11:53:16 -- target/dif.sh@82 -- # gen_fio_conf 00:28:56.362 11:53:16 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:56.362 11:53:16 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:56.362 11:53:16 -- target/dif.sh@54 -- # local file 00:28:56.362 11:53:16 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:56.362 11:53:16 -- common/autotest_common.sh@1330 -- # shift 00:28:56.362 11:53:16 -- target/dif.sh@56 -- # cat 00:28:56.362 11:53:16 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:56.362 11:53:16 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:56.362 11:53:16 -- nvmf/common.sh@542 -- # cat 00:28:56.362 11:53:16 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:56.362 11:53:16 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:56.362 11:53:16 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:56.362 11:53:16 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:56.362 11:53:16 -- target/dif.sh@72 -- # (( file <= files )) 00:28:56.362 11:53:16 -- target/dif.sh@73 -- # cat 00:28:56.362 11:53:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:56.362 11:53:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:56.363 { 00:28:56.363 "params": { 00:28:56.363 "name": "Nvme$subsystem", 00:28:56.363 "trtype": "$TEST_TRANSPORT", 00:28:56.363 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:56.363 "adrfam": "ipv4", 00:28:56.363 "trsvcid": "$NVMF_PORT", 00:28:56.363 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:56.363 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:56.363 "hdgst": ${hdgst:-false}, 00:28:56.363 "ddgst": ${ddgst:-false} 00:28:56.363 }, 00:28:56.363 "method": "bdev_nvme_attach_controller" 00:28:56.363 } 00:28:56.363 EOF 00:28:56.363 )") 00:28:56.363 11:53:16 -- nvmf/common.sh@542 -- # cat 00:28:56.363 11:53:16 -- target/dif.sh@72 -- # (( file++ )) 00:28:56.363 11:53:16 -- target/dif.sh@72 -- # (( file <= files )) 00:28:56.363 11:53:16 -- nvmf/common.sh@544 -- # jq . 00:28:56.363 11:53:16 -- nvmf/common.sh@545 -- # IFS=, 00:28:56.363 11:53:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:56.363 "params": { 00:28:56.363 "name": "Nvme0", 00:28:56.363 "trtype": "tcp", 00:28:56.363 "traddr": "10.0.0.2", 00:28:56.363 "adrfam": "ipv4", 00:28:56.363 "trsvcid": "4420", 00:28:56.363 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:56.363 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:56.363 "hdgst": false, 00:28:56.363 "ddgst": false 00:28:56.363 }, 00:28:56.363 "method": "bdev_nvme_attach_controller" 00:28:56.363 },{ 00:28:56.363 "params": { 00:28:56.363 "name": "Nvme1", 00:28:56.363 "trtype": "tcp", 00:28:56.363 "traddr": "10.0.0.2", 00:28:56.363 "adrfam": "ipv4", 00:28:56.363 "trsvcid": "4420", 00:28:56.363 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:56.363 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:56.363 "hdgst": false, 00:28:56.363 "ddgst": false 00:28:56.363 }, 00:28:56.363 "method": "bdev_nvme_attach_controller" 00:28:56.363 }' 00:28:56.363 11:53:16 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:56.363 11:53:16 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:56.363 11:53:16 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:56.363 11:53:16 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:56.363 11:53:16 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:56.363 11:53:16 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:56.363 11:53:16 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:56.363 11:53:16 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:56.363 11:53:16 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:56.363 11:53:16 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:56.621 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:28:56.621 ... 00:28:56.621 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:28:56.621 ... 00:28:56.621 fio-3.35 00:28:56.621 Starting 4 threads 00:28:56.621 EAL: No free 2048 kB hugepages reported on node 1 00:28:57.187 [2024-11-28 11:53:17.087758] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:57.187 [2024-11-28 11:53:17.087827] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:02.455 00:29:02.455 filename0: (groupid=0, jobs=1): err= 0: pid=3945567: Thu Nov 28 11:53:22 2024 00:29:02.455 read: IOPS=2014, BW=15.7MiB/s (16.5MB/s)(78.7MiB/5003msec) 00:29:02.455 slat (nsec): min=3755, max=58040, avg=13153.17, stdev=7244.41 00:29:02.455 clat (usec): min=656, max=7250, avg=3930.78, stdev=660.52 00:29:02.455 lat (usec): min=673, max=7269, avg=3943.93, stdev=659.95 00:29:02.455 clat percentiles (usec): 00:29:02.455 | 1.00th=[ 2737], 5.00th=[ 3195], 10.00th=[ 3359], 20.00th=[ 3523], 00:29:02.455 | 30.00th=[ 3621], 40.00th=[ 3687], 50.00th=[ 3785], 60.00th=[ 3884], 00:29:02.455 | 70.00th=[ 3949], 80.00th=[ 4113], 90.00th=[ 5342], 95.00th=[ 5473], 00:29:02.455 | 99.00th=[ 5800], 99.50th=[ 5997], 99.90th=[ 6456], 99.95th=[ 7046], 00:29:02.455 | 99.99th=[ 7111] 00:29:02.455 bw ( KiB/s): min=15536, max=16688, per=25.30%, avg=16115.20, stdev=346.61, samples=10 00:29:02.455 iops : min= 1942, max= 2086, avg=2014.40, stdev=43.33, samples=10 00:29:02.455 lat (usec) : 750=0.02% 00:29:02.455 lat (msec) : 2=0.05%, 4=72.96%, 10=26.97% 00:29:02.455 cpu : usr=95.86%, sys=3.64%, ctx=6, majf=0, minf=59 00:29:02.455 IO depths : 1=0.1%, 2=2.8%, 4=69.7%, 8=27.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:02.455 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:02.455 complete : 0=0.0%, 4=92.7%, 8=7.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:02.455 issued rwts: total=10077,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:02.455 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:02.455 filename0: (groupid=0, jobs=1): err= 0: pid=3945568: Thu Nov 28 11:53:22 2024 00:29:02.455 read: IOPS=1977, BW=15.5MiB/s (16.2MB/s)(77.3MiB/5002msec) 00:29:02.455 slat (usec): min=3, max=169, avg=13.69, stdev= 8.14 00:29:02.455 clat (usec): min=764, max=7411, avg=3998.88, stdev=661.27 00:29:02.455 lat (usec): min=777, max=7431, avg=4012.58, stdev=660.39 00:29:02.455 clat percentiles (usec): 00:29:02.455 | 1.00th=[ 2999], 5.00th=[ 3392], 10.00th=[ 3490], 20.00th=[ 3589], 00:29:02.455 | 30.00th=[ 3654], 40.00th=[ 3720], 50.00th=[ 3785], 60.00th=[ 3916], 00:29:02.455 | 70.00th=[ 4015], 80.00th=[ 4146], 90.00th=[ 5407], 95.00th=[ 5538], 00:29:02.455 | 99.00th=[ 5932], 99.50th=[ 6128], 99.90th=[ 6587], 99.95th=[ 6652], 00:29:02.455 | 99.99th=[ 7439] 00:29:02.455 bw ( KiB/s): min=15568, max=15968, per=24.82%, avg=15809.78, stdev=132.53, samples=9 00:29:02.455 iops : min= 1946, max= 1996, avg=1976.22, stdev=16.57, samples=9 00:29:02.455 lat (usec) : 1000=0.04% 00:29:02.455 lat (msec) : 2=0.08%, 4=70.03%, 10=29.85% 00:29:02.455 cpu : usr=95.30%, sys=3.76%, ctx=30, majf=0, minf=48 00:29:02.455 IO depths : 1=0.1%, 2=4.2%, 4=68.8%, 8=27.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:02.455 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:02.455 complete : 0=0.0%, 4=92.3%, 8=7.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:02.455 issued rwts: total=9893,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:02.455 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:02.455 filename1: (groupid=0, jobs=1): err= 0: pid=3945569: Thu Nov 28 11:53:22 2024 00:29:02.455 read: IOPS=1991, BW=15.6MiB/s (16.3MB/s)(77.8MiB/5002msec) 00:29:02.455 slat (nsec): min=3682, max=63349, avg=14310.18, stdev=7748.48 00:29:02.455 clat (usec): min=1260, max=8541, avg=3969.96, stdev=657.22 00:29:02.455 lat (usec): min=1274, max=8565, avg=3984.27, stdev=656.41 00:29:02.455 clat percentiles (usec): 00:29:02.455 | 1.00th=[ 2900], 5.00th=[ 3294], 10.00th=[ 3392], 20.00th=[ 3523], 00:29:02.455 | 30.00th=[ 3621], 40.00th=[ 3720], 50.00th=[ 3851], 60.00th=[ 3916], 00:29:02.455 | 70.00th=[ 4015], 80.00th=[ 4146], 90.00th=[ 5407], 95.00th=[ 5473], 00:29:02.455 | 99.00th=[ 5866], 99.50th=[ 6063], 99.90th=[ 6521], 99.95th=[ 6652], 00:29:02.455 | 99.99th=[ 8586] 00:29:02.455 bw ( KiB/s): min=15616, max=16384, per=25.00%, avg=15921.78, stdev=213.68, samples=9 00:29:02.455 iops : min= 1952, max= 2048, avg=1990.22, stdev=26.71, samples=9 00:29:02.455 lat (msec) : 2=0.17%, 4=70.08%, 10=29.75% 00:29:02.455 cpu : usr=96.10%, sys=3.34%, ctx=10, majf=0, minf=42 00:29:02.455 IO depths : 1=0.1%, 2=4.1%, 4=68.6%, 8=27.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:02.455 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:02.455 complete : 0=0.0%, 4=92.6%, 8=7.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:02.455 issued rwts: total=9962,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:02.455 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:02.455 filename1: (groupid=0, jobs=1): err= 0: pid=3945570: Thu Nov 28 11:53:22 2024 00:29:02.455 read: IOPS=1980, BW=15.5MiB/s (16.2MB/s)(77.4MiB/5001msec) 00:29:02.455 slat (usec): min=3, max=128, avg=14.71, stdev= 8.10 00:29:02.455 clat (usec): min=626, max=7839, avg=3992.93, stdev=659.97 00:29:02.455 lat (usec): min=645, max=7850, avg=4007.64, stdev=658.87 00:29:02.455 clat percentiles (usec): 00:29:02.455 | 1.00th=[ 2999], 5.00th=[ 3326], 10.00th=[ 3425], 20.00th=[ 3589], 00:29:02.455 | 30.00th=[ 3687], 40.00th=[ 3752], 50.00th=[ 3851], 60.00th=[ 3916], 00:29:02.455 | 70.00th=[ 3982], 80.00th=[ 4146], 90.00th=[ 5342], 95.00th=[ 5538], 00:29:02.455 | 99.00th=[ 5997], 99.50th=[ 6259], 99.90th=[ 6980], 99.95th=[ 7242], 00:29:02.455 | 99.99th=[ 7832] 00:29:02.455 bw ( KiB/s): min=15632, max=16016, per=24.83%, avg=15818.67, stdev=155.74, samples=9 00:29:02.455 iops : min= 1954, max= 2002, avg=1977.33, stdev=19.47, samples=9 00:29:02.455 lat (usec) : 750=0.06%, 1000=0.04% 00:29:02.455 lat (msec) : 2=0.15%, 4=70.34%, 10=29.41% 00:29:02.455 cpu : usr=94.66%, sys=4.36%, ctx=108, majf=0, minf=49 00:29:02.456 IO depths : 1=0.1%, 2=3.6%, 4=69.0%, 8=27.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:02.456 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:02.456 complete : 0=0.0%, 4=92.6%, 8=7.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:02.456 issued rwts: total=9902,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:02.456 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:02.456 00:29:02.456 Run status group 0 (all jobs): 00:29:02.456 READ: bw=62.2MiB/s (65.2MB/s), 15.5MiB/s-15.7MiB/s (16.2MB/s-16.5MB/s), io=311MiB (326MB), run=5001-5003msec 00:29:02.456 11:53:22 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:02.456 11:53:22 -- target/dif.sh@43 -- # local sub 00:29:02.456 11:53:22 -- target/dif.sh@45 -- # for sub in "$@" 00:29:02.456 11:53:22 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:02.456 11:53:22 -- target/dif.sh@36 -- # local sub_id=0 00:29:02.456 11:53:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:02.456 11:53:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.456 11:53:22 -- common/autotest_common.sh@10 -- # set +x 00:29:02.456 11:53:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.456 11:53:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:02.456 11:53:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.456 11:53:22 -- common/autotest_common.sh@10 -- # set +x 00:29:02.456 11:53:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.456 11:53:22 -- target/dif.sh@45 -- # for sub in "$@" 00:29:02.456 11:53:22 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:02.456 11:53:22 -- target/dif.sh@36 -- # local sub_id=1 00:29:02.456 11:53:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:02.456 11:53:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.456 11:53:22 -- common/autotest_common.sh@10 -- # set +x 00:29:02.456 11:53:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.456 11:53:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:02.456 11:53:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.456 11:53:22 -- common/autotest_common.sh@10 -- # set +x 00:29:02.456 11:53:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.456 00:29:02.456 real 0m24.535s 00:29:02.456 user 4m33.159s 00:29:02.456 sys 0m6.390s 00:29:02.456 11:53:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:02.456 11:53:22 -- common/autotest_common.sh@10 -- # set +x 00:29:02.456 ************************************ 00:29:02.456 END TEST fio_dif_rand_params 00:29:02.456 ************************************ 00:29:02.456 11:53:22 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:02.456 11:53:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:02.456 11:53:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:02.456 11:53:22 -- common/autotest_common.sh@10 -- # set +x 00:29:02.456 ************************************ 00:29:02.456 START TEST fio_dif_digest 00:29:02.456 ************************************ 00:29:02.456 11:53:22 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:02.456 11:53:22 -- target/dif.sh@123 -- # local NULL_DIF 00:29:02.456 11:53:22 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:02.456 11:53:22 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:02.456 11:53:22 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:02.456 11:53:22 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:02.456 11:53:22 -- target/dif.sh@127 -- # numjobs=3 00:29:02.456 11:53:22 -- target/dif.sh@127 -- # iodepth=3 00:29:02.456 11:53:22 -- target/dif.sh@127 -- # runtime=10 00:29:02.456 11:53:22 -- target/dif.sh@128 -- # hdgst=true 00:29:02.456 11:53:22 -- target/dif.sh@128 -- # ddgst=true 00:29:02.456 11:53:22 -- target/dif.sh@130 -- # create_subsystems 0 00:29:02.456 11:53:22 -- target/dif.sh@28 -- # local sub 00:29:02.456 11:53:22 -- target/dif.sh@30 -- # for sub in "$@" 00:29:02.456 11:53:22 -- target/dif.sh@31 -- # create_subsystem 0 00:29:02.456 11:53:22 -- target/dif.sh@18 -- # local sub_id=0 00:29:02.456 11:53:22 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:02.456 11:53:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.456 11:53:22 -- common/autotest_common.sh@10 -- # set +x 00:29:02.714 bdev_null0 00:29:02.714 11:53:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.714 11:53:22 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:02.714 11:53:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.714 11:53:22 -- common/autotest_common.sh@10 -- # set +x 00:29:02.714 11:53:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.714 11:53:22 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:02.714 11:53:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.714 11:53:22 -- common/autotest_common.sh@10 -- # set +x 00:29:02.714 11:53:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.714 11:53:22 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:02.714 11:53:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.714 11:53:22 -- common/autotest_common.sh@10 -- # set +x 00:29:02.714 [2024-11-28 11:53:22.538177] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:02.714 11:53:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.714 11:53:22 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:02.714 11:53:22 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:02.714 11:53:22 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:02.714 11:53:22 -- nvmf/common.sh@520 -- # config=() 00:29:02.714 11:53:22 -- nvmf/common.sh@520 -- # local subsystem config 00:29:02.714 11:53:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:02.714 11:53:22 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:02.714 11:53:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:02.714 { 00:29:02.714 "params": { 00:29:02.714 "name": "Nvme$subsystem", 00:29:02.714 "trtype": "$TEST_TRANSPORT", 00:29:02.714 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:02.715 "adrfam": "ipv4", 00:29:02.715 "trsvcid": "$NVMF_PORT", 00:29:02.715 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:02.715 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:02.715 "hdgst": ${hdgst:-false}, 00:29:02.715 "ddgst": ${ddgst:-false} 00:29:02.715 }, 00:29:02.715 "method": "bdev_nvme_attach_controller" 00:29:02.715 } 00:29:02.715 EOF 00:29:02.715 )") 00:29:02.715 11:53:22 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:02.715 11:53:22 -- target/dif.sh@82 -- # gen_fio_conf 00:29:02.715 11:53:22 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:02.715 11:53:22 -- target/dif.sh@54 -- # local file 00:29:02.715 11:53:22 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:02.715 11:53:22 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:02.715 11:53:22 -- target/dif.sh@56 -- # cat 00:29:02.715 11:53:22 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:02.715 11:53:22 -- common/autotest_common.sh@1330 -- # shift 00:29:02.715 11:53:22 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:02.715 11:53:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:02.715 11:53:22 -- nvmf/common.sh@542 -- # cat 00:29:02.715 11:53:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:02.715 11:53:22 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:02.715 11:53:22 -- target/dif.sh@72 -- # (( file <= files )) 00:29:02.715 11:53:22 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:02.715 11:53:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:02.715 11:53:22 -- nvmf/common.sh@544 -- # jq . 00:29:02.715 11:53:22 -- nvmf/common.sh@545 -- # IFS=, 00:29:02.715 11:53:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:02.715 "params": { 00:29:02.715 "name": "Nvme0", 00:29:02.715 "trtype": "tcp", 00:29:02.715 "traddr": "10.0.0.2", 00:29:02.715 "adrfam": "ipv4", 00:29:02.715 "trsvcid": "4420", 00:29:02.715 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:02.715 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:02.715 "hdgst": true, 00:29:02.715 "ddgst": true 00:29:02.715 }, 00:29:02.715 "method": "bdev_nvme_attach_controller" 00:29:02.715 }' 00:29:02.715 11:53:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:02.715 11:53:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:02.715 11:53:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:02.715 11:53:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:02.715 11:53:22 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:02.715 11:53:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:02.715 11:53:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:02.715 11:53:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:02.715 11:53:22 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:02.715 11:53:22 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:02.973 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:02.973 ... 00:29:02.973 fio-3.35 00:29:02.973 Starting 3 threads 00:29:02.973 EAL: No free 2048 kB hugepages reported on node 1 00:29:03.538 [2024-11-28 11:53:23.319586] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:03.538 [2024-11-28 11:53:23.319644] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:13.513 00:29:13.513 filename0: (groupid=0, jobs=1): err= 0: pid=3946361: Thu Nov 28 11:53:33 2024 00:29:13.513 read: IOPS=215, BW=26.9MiB/s (28.2MB/s)(271MiB/10049msec) 00:29:13.513 slat (nsec): min=4585, max=42050, avg=17991.24, stdev=3409.97 00:29:13.513 clat (usec): min=10345, max=53803, avg=13883.33, stdev=1507.63 00:29:13.513 lat (usec): min=10363, max=53823, avg=13901.32, stdev=1507.64 00:29:13.513 clat percentiles (usec): 00:29:13.513 | 1.00th=[11600], 5.00th=[12387], 10.00th=[12649], 20.00th=[13042], 00:29:13.513 | 30.00th=[13304], 40.00th=[13566], 50.00th=[13829], 60.00th=[14091], 00:29:13.513 | 70.00th=[14222], 80.00th=[14615], 90.00th=[15139], 95.00th=[15533], 00:29:13.513 | 99.00th=[16450], 99.50th=[16909], 99.90th=[23725], 99.95th=[47973], 00:29:13.513 | 99.99th=[53740] 00:29:13.513 bw ( KiB/s): min=26624, max=29184, per=33.97%, avg=27673.60, stdev=604.10, samples=20 00:29:13.513 iops : min= 208, max= 228, avg=216.20, stdev= 4.72, samples=20 00:29:13.513 lat (msec) : 20=99.77%, 50=0.18%, 100=0.05% 00:29:13.513 cpu : usr=94.31%, sys=5.21%, ctx=29, majf=0, minf=60 00:29:13.513 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:13.513 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.513 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.513 issued rwts: total=2165,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:13.513 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:13.513 filename0: (groupid=0, jobs=1): err= 0: pid=3946362: Thu Nov 28 11:53:33 2024 00:29:13.513 read: IOPS=212, BW=26.6MiB/s (27.9MB/s)(267MiB/10047msec) 00:29:13.513 slat (nsec): min=8044, max=66289, avg=17021.18, stdev=4576.62 00:29:13.513 clat (usec): min=10812, max=54658, avg=14076.78, stdev=1536.26 00:29:13.513 lat (usec): min=10827, max=54671, avg=14093.80, stdev=1536.34 00:29:13.513 clat percentiles (usec): 00:29:13.513 | 1.00th=[11600], 5.00th=[12387], 10.00th=[12780], 20.00th=[13173], 00:29:13.513 | 30.00th=[13566], 40.00th=[13829], 50.00th=[13960], 60.00th=[14222], 00:29:13.513 | 70.00th=[14484], 80.00th=[14877], 90.00th=[15401], 95.00th=[15795], 00:29:13.513 | 99.00th=[16909], 99.50th=[17171], 99.90th=[18744], 99.95th=[46924], 00:29:13.513 | 99.99th=[54789] 00:29:13.513 bw ( KiB/s): min=26368, max=28160, per=33.50%, avg=27292.20, stdev=567.52, samples=20 00:29:13.513 iops : min= 206, max= 220, avg=213.20, stdev= 4.47, samples=20 00:29:13.513 lat (msec) : 20=99.91%, 50=0.05%, 100=0.05% 00:29:13.513 cpu : usr=95.67%, sys=3.79%, ctx=25, majf=0, minf=120 00:29:13.513 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:13.513 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.513 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.513 issued rwts: total=2135,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:13.513 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:13.513 filename0: (groupid=0, jobs=1): err= 0: pid=3946363: Thu Nov 28 11:53:33 2024 00:29:13.513 read: IOPS=208, BW=26.1MiB/s (27.3MB/s)(262MiB/10045msec) 00:29:13.514 slat (nsec): min=8500, max=66095, avg=18588.70, stdev=5017.69 00:29:13.514 clat (usec): min=11196, max=52997, avg=14342.49, stdev=1450.82 00:29:13.514 lat (usec): min=11211, max=53017, avg=14361.08, stdev=1451.04 00:29:13.514 clat percentiles (usec): 00:29:13.514 | 1.00th=[12125], 5.00th=[12780], 10.00th=[13173], 20.00th=[13566], 00:29:13.514 | 30.00th=[13829], 40.00th=[14091], 50.00th=[14222], 60.00th=[14484], 00:29:13.514 | 70.00th=[14746], 80.00th=[15139], 90.00th=[15533], 95.00th=[15926], 00:29:13.514 | 99.00th=[16581], 99.50th=[16909], 99.90th=[20317], 99.95th=[46400], 00:29:13.514 | 99.99th=[53216] 00:29:13.514 bw ( KiB/s): min=25856, max=28416, per=32.89%, avg=26790.40, stdev=655.44, samples=20 00:29:13.514 iops : min= 202, max= 222, avg=209.30, stdev= 5.12, samples=20 00:29:13.514 lat (msec) : 20=99.86%, 50=0.10%, 100=0.05% 00:29:13.514 cpu : usr=93.25%, sys=5.44%, ctx=250, majf=0, minf=166 00:29:13.514 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:13.514 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.514 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.514 issued rwts: total=2095,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:13.514 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:13.514 00:29:13.514 Run status group 0 (all jobs): 00:29:13.514 READ: bw=79.5MiB/s (83.4MB/s), 26.1MiB/s-26.9MiB/s (27.3MB/s-28.2MB/s), io=799MiB (838MB), run=10045-10049msec 00:29:13.772 11:53:33 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:13.772 11:53:33 -- target/dif.sh@43 -- # local sub 00:29:13.772 11:53:33 -- target/dif.sh@45 -- # for sub in "$@" 00:29:13.772 11:53:33 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:13.772 11:53:33 -- target/dif.sh@36 -- # local sub_id=0 00:29:13.772 11:53:33 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:13.772 11:53:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.772 11:53:33 -- common/autotest_common.sh@10 -- # set +x 00:29:13.772 11:53:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.772 11:53:33 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:13.772 11:53:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.772 11:53:33 -- common/autotest_common.sh@10 -- # set +x 00:29:13.772 11:53:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.772 00:29:13.772 real 0m11.213s 00:29:13.772 user 0m29.582s 00:29:13.772 sys 0m1.736s 00:29:13.772 11:53:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:13.772 11:53:33 -- common/autotest_common.sh@10 -- # set +x 00:29:13.772 ************************************ 00:29:13.772 END TEST fio_dif_digest 00:29:13.772 ************************************ 00:29:13.772 11:53:33 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:13.772 11:53:33 -- target/dif.sh@147 -- # nvmftestfini 00:29:13.772 11:53:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:13.772 11:53:33 -- nvmf/common.sh@116 -- # sync 00:29:13.772 11:53:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:13.772 11:53:33 -- nvmf/common.sh@119 -- # set +e 00:29:13.772 11:53:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:13.772 11:53:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:13.772 rmmod nvme_tcp 00:29:13.772 rmmod nvme_fabrics 00:29:13.772 rmmod nvme_keyring 00:29:13.772 11:53:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:13.772 11:53:33 -- nvmf/common.sh@123 -- # set -e 00:29:13.772 11:53:33 -- nvmf/common.sh@124 -- # return 0 00:29:13.772 11:53:33 -- nvmf/common.sh@477 -- # '[' -n 3940076 ']' 00:29:13.772 11:53:33 -- nvmf/common.sh@478 -- # killprocess 3940076 00:29:13.772 11:53:33 -- common/autotest_common.sh@936 -- # '[' -z 3940076 ']' 00:29:13.772 11:53:33 -- common/autotest_common.sh@940 -- # kill -0 3940076 00:29:13.772 11:53:33 -- common/autotest_common.sh@941 -- # uname 00:29:13.772 11:53:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:13.772 11:53:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3940076 00:29:14.030 11:53:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:14.030 11:53:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:14.030 11:53:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3940076' 00:29:14.030 killing process with pid 3940076 00:29:14.030 11:53:33 -- common/autotest_common.sh@955 -- # kill 3940076 00:29:14.030 11:53:33 -- common/autotest_common.sh@960 -- # wait 3940076 00:29:14.288 11:53:34 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:14.288 11:53:34 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:15.230 Waiting for block devices as requested 00:29:15.490 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:15.490 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:15.490 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:15.750 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:15.750 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:15.750 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:16.010 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:16.010 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:16.010 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:16.010 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:16.269 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:16.269 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:16.269 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:16.269 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:16.527 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:16.527 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:16.527 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:16.785 11:53:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:16.785 11:53:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:16.785 11:53:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:16.785 11:53:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:16.785 11:53:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:16.785 11:53:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:16.785 11:53:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:18.690 11:53:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:18.690 00:29:18.690 real 1m7.968s 00:29:18.690 user 6m31.908s 00:29:18.690 sys 0m17.112s 00:29:18.690 11:53:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:18.690 11:53:38 -- common/autotest_common.sh@10 -- # set +x 00:29:18.690 ************************************ 00:29:18.690 END TEST nvmf_dif 00:29:18.690 ************************************ 00:29:18.690 11:53:38 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:18.690 11:53:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:18.690 11:53:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:18.690 11:53:38 -- common/autotest_common.sh@10 -- # set +x 00:29:18.690 ************************************ 00:29:18.690 START TEST nvmf_abort_qd_sizes 00:29:18.690 ************************************ 00:29:18.690 11:53:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:18.690 * Looking for test storage... 00:29:18.690 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:18.690 11:53:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:18.690 11:53:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:18.690 11:53:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:18.949 11:53:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:18.949 11:53:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:18.949 11:53:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:18.949 11:53:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:18.949 11:53:38 -- scripts/common.sh@335 -- # IFS=.-: 00:29:18.949 11:53:38 -- scripts/common.sh@335 -- # read -ra ver1 00:29:18.949 11:53:38 -- scripts/common.sh@336 -- # IFS=.-: 00:29:18.949 11:53:38 -- scripts/common.sh@336 -- # read -ra ver2 00:29:18.949 11:53:38 -- scripts/common.sh@337 -- # local 'op=<' 00:29:18.949 11:53:38 -- scripts/common.sh@339 -- # ver1_l=2 00:29:18.949 11:53:38 -- scripts/common.sh@340 -- # ver2_l=1 00:29:18.949 11:53:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:18.949 11:53:38 -- scripts/common.sh@343 -- # case "$op" in 00:29:18.949 11:53:38 -- scripts/common.sh@344 -- # : 1 00:29:18.949 11:53:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:18.949 11:53:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:18.949 11:53:38 -- scripts/common.sh@364 -- # decimal 1 00:29:18.949 11:53:38 -- scripts/common.sh@352 -- # local d=1 00:29:18.949 11:53:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:18.949 11:53:38 -- scripts/common.sh@354 -- # echo 1 00:29:18.949 11:53:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:18.949 11:53:38 -- scripts/common.sh@365 -- # decimal 2 00:29:18.949 11:53:38 -- scripts/common.sh@352 -- # local d=2 00:29:18.949 11:53:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:18.949 11:53:38 -- scripts/common.sh@354 -- # echo 2 00:29:18.949 11:53:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:18.949 11:53:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:18.949 11:53:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:18.949 11:53:38 -- scripts/common.sh@367 -- # return 0 00:29:18.949 11:53:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:18.949 11:53:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:18.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:18.949 --rc genhtml_branch_coverage=1 00:29:18.949 --rc genhtml_function_coverage=1 00:29:18.949 --rc genhtml_legend=1 00:29:18.949 --rc geninfo_all_blocks=1 00:29:18.949 --rc geninfo_unexecuted_blocks=1 00:29:18.949 00:29:18.949 ' 00:29:18.949 11:53:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:18.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:18.949 --rc genhtml_branch_coverage=1 00:29:18.949 --rc genhtml_function_coverage=1 00:29:18.949 --rc genhtml_legend=1 00:29:18.949 --rc geninfo_all_blocks=1 00:29:18.949 --rc geninfo_unexecuted_blocks=1 00:29:18.949 00:29:18.949 ' 00:29:18.949 11:53:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:18.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:18.949 --rc genhtml_branch_coverage=1 00:29:18.949 --rc genhtml_function_coverage=1 00:29:18.949 --rc genhtml_legend=1 00:29:18.949 --rc geninfo_all_blocks=1 00:29:18.949 --rc geninfo_unexecuted_blocks=1 00:29:18.949 00:29:18.949 ' 00:29:18.949 11:53:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:18.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:18.949 --rc genhtml_branch_coverage=1 00:29:18.949 --rc genhtml_function_coverage=1 00:29:18.949 --rc genhtml_legend=1 00:29:18.949 --rc geninfo_all_blocks=1 00:29:18.949 --rc geninfo_unexecuted_blocks=1 00:29:18.949 00:29:18.949 ' 00:29:18.949 11:53:38 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:18.949 11:53:38 -- nvmf/common.sh@7 -- # uname -s 00:29:18.949 11:53:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:18.949 11:53:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:18.949 11:53:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:18.949 11:53:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:18.949 11:53:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:18.949 11:53:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:18.949 11:53:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:18.949 11:53:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:18.949 11:53:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:18.949 11:53:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:18.949 11:53:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:18.949 11:53:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:18.950 11:53:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:18.950 11:53:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:18.950 11:53:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:18.950 11:53:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:18.950 11:53:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:18.950 11:53:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:18.950 11:53:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:18.950 11:53:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:18.950 11:53:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:18.950 11:53:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:18.950 11:53:38 -- paths/export.sh@5 -- # export PATH 00:29:18.950 11:53:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:18.950 11:53:38 -- nvmf/common.sh@46 -- # : 0 00:29:18.950 11:53:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:18.950 11:53:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:18.950 11:53:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:18.950 11:53:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:18.950 11:53:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:18.950 11:53:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:18.950 11:53:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:18.950 11:53:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:18.950 11:53:38 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:18.950 11:53:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:18.950 11:53:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:18.950 11:53:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:18.950 11:53:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:18.950 11:53:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:18.950 11:53:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:18.950 11:53:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:18.950 11:53:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:18.950 11:53:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:18.950 11:53:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:18.950 11:53:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:18.950 11:53:38 -- common/autotest_common.sh@10 -- # set +x 00:29:20.853 11:53:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:20.853 11:53:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:20.853 11:53:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:20.853 11:53:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:20.853 11:53:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:20.853 11:53:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:20.853 11:53:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:20.853 11:53:40 -- nvmf/common.sh@294 -- # net_devs=() 00:29:20.853 11:53:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:20.853 11:53:40 -- nvmf/common.sh@295 -- # e810=() 00:29:20.853 11:53:40 -- nvmf/common.sh@295 -- # local -ga e810 00:29:20.853 11:53:40 -- nvmf/common.sh@296 -- # x722=() 00:29:20.853 11:53:40 -- nvmf/common.sh@296 -- # local -ga x722 00:29:20.853 11:53:40 -- nvmf/common.sh@297 -- # mlx=() 00:29:20.853 11:53:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:20.853 11:53:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:20.853 11:53:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:20.853 11:53:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:20.853 11:53:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:20.853 11:53:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:20.853 11:53:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:20.853 11:53:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:20.853 11:53:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:20.853 11:53:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:20.853 11:53:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:20.853 11:53:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:20.853 11:53:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:20.853 11:53:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:20.853 11:53:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:20.853 11:53:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:20.853 11:53:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:20.853 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:20.853 11:53:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:20.853 11:53:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:20.853 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:20.853 11:53:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:20.853 11:53:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:20.853 11:53:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:20.853 11:53:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:20.853 11:53:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:20.853 11:53:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:20.853 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:20.853 11:53:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:20.853 11:53:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:20.853 11:53:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:20.853 11:53:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:20.853 11:53:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:20.853 11:53:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:20.853 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:20.853 11:53:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:20.853 11:53:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:20.853 11:53:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:20.853 11:53:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:20.853 11:53:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:20.853 11:53:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:20.853 11:53:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:20.853 11:53:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:20.853 11:53:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:20.853 11:53:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:20.853 11:53:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:20.853 11:53:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:20.853 11:53:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:20.853 11:53:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:20.853 11:53:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:20.853 11:53:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:20.853 11:53:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:20.853 11:53:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:20.853 11:53:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:20.853 11:53:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:20.853 11:53:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:20.853 11:53:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:21.112 11:53:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:21.112 11:53:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:21.112 11:53:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:21.112 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:21.112 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.138 ms 00:29:21.112 00:29:21.112 --- 10.0.0.2 ping statistics --- 00:29:21.112 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:21.112 rtt min/avg/max/mdev = 0.138/0.138/0.138/0.000 ms 00:29:21.112 11:53:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:21.112 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:21.112 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:29:21.112 00:29:21.112 --- 10.0.0.1 ping statistics --- 00:29:21.112 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:21.112 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:29:21.112 11:53:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:21.112 11:53:40 -- nvmf/common.sh@410 -- # return 0 00:29:21.112 11:53:40 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:21.112 11:53:40 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:22.488 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:22.488 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:22.488 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:22.488 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:22.488 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:22.488 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:22.488 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:22.488 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:22.488 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:22.488 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:22.488 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:22.488 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:22.488 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:22.488 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:22.488 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:22.488 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:23.423 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:23.423 11:53:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:23.423 11:53:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:23.423 11:53:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:23.423 11:53:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:23.423 11:53:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:23.423 11:53:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:23.423 11:53:43 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:23.423 11:53:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:23.423 11:53:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:23.423 11:53:43 -- common/autotest_common.sh@10 -- # set +x 00:29:23.423 11:53:43 -- nvmf/common.sh@469 -- # nvmfpid=3951383 00:29:23.423 11:53:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:23.423 11:53:43 -- nvmf/common.sh@470 -- # waitforlisten 3951383 00:29:23.423 11:53:43 -- common/autotest_common.sh@829 -- # '[' -z 3951383 ']' 00:29:23.423 11:53:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:23.423 11:53:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:23.423 11:53:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:23.423 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:23.423 11:53:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:23.423 11:53:43 -- common/autotest_common.sh@10 -- # set +x 00:29:23.423 [2024-11-28 11:53:43.414397] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:23.423 [2024-11-28 11:53:43.414472] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:23.423 EAL: No free 2048 kB hugepages reported on node 1 00:29:23.682 [2024-11-28 11:53:43.482573] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:23.682 [2024-11-28 11:53:43.598776] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:23.682 [2024-11-28 11:53:43.598957] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:23.682 [2024-11-28 11:53:43.598988] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:23.682 [2024-11-28 11:53:43.599009] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:23.682 [2024-11-28 11:53:43.599106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:23.682 [2024-11-28 11:53:43.599184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:23.682 [2024-11-28 11:53:43.599282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:23.682 [2024-11-28 11:53:43.599288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:24.616 11:53:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:24.616 11:53:44 -- common/autotest_common.sh@862 -- # return 0 00:29:24.616 11:53:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:24.616 11:53:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:24.616 11:53:44 -- common/autotest_common.sh@10 -- # set +x 00:29:24.616 11:53:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:24.616 11:53:44 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:24.616 11:53:44 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:24.616 11:53:44 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:24.616 11:53:44 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:24.616 11:53:44 -- scripts/common.sh@312 -- # local nvmes 00:29:24.616 11:53:44 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:24.616 11:53:44 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:24.616 11:53:44 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:24.616 11:53:44 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:24.616 11:53:44 -- scripts/common.sh@322 -- # uname -s 00:29:24.616 11:53:44 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:24.616 11:53:44 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:24.616 11:53:44 -- scripts/common.sh@327 -- # (( 1 )) 00:29:24.616 11:53:44 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:24.616 11:53:44 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:24.616 11:53:44 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:24.616 11:53:44 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:24.616 11:53:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:24.616 11:53:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:24.616 11:53:44 -- common/autotest_common.sh@10 -- # set +x 00:29:24.616 ************************************ 00:29:24.616 START TEST spdk_target_abort 00:29:24.616 ************************************ 00:29:24.616 11:53:44 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:24.616 11:53:44 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:24.616 11:53:44 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:24.617 11:53:44 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:24.617 11:53:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.617 11:53:44 -- common/autotest_common.sh@10 -- # set +x 00:29:27.221 spdk_targetn1 00:29:27.221 11:53:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.221 11:53:47 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:27.221 11:53:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.221 11:53:47 -- common/autotest_common.sh@10 -- # set +x 00:29:27.221 [2024-11-28 11:53:47.250819] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:27.221 11:53:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.221 11:53:47 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:27.221 11:53:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.221 11:53:47 -- common/autotest_common.sh@10 -- # set +x 00:29:27.221 11:53:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.221 11:53:47 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:27.221 11:53:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.221 11:53:47 -- common/autotest_common.sh@10 -- # set +x 00:29:27.478 11:53:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.478 11:53:47 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:27.478 11:53:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.478 11:53:47 -- common/autotest_common.sh@10 -- # set +x 00:29:27.478 [2024-11-28 11:53:47.283107] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:27.478 11:53:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.478 11:53:47 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:27.478 11:53:47 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:27.478 11:53:47 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:27.479 11:53:47 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:27.479 EAL: No free 2048 kB hugepages reported on node 1 00:29:30.757 Initializing NVMe Controllers 00:29:30.757 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:30.757 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:30.757 Initialization complete. Launching workers. 00:29:30.757 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12194, failed: 0 00:29:30.757 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1290, failed to submit 10904 00:29:30.757 success 768, unsuccess 522, failed 0 00:29:30.757 11:53:50 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:30.757 11:53:50 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:30.757 EAL: No free 2048 kB hugepages reported on node 1 00:29:34.035 [2024-11-28 11:53:53.604553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc295e0 is same with the state(5) to be set 00:29:34.035 [2024-11-28 11:53:53.604606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc295e0 is same with the state(5) to be set 00:29:34.035 Initializing NVMe Controllers 00:29:34.035 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:34.035 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:34.035 Initialization complete. Launching workers. 00:29:34.035 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8601, failed: 0 00:29:34.035 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1204, failed to submit 7397 00:29:34.035 success 346, unsuccess 858, failed 0 00:29:34.035 11:53:53 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:34.035 11:53:53 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:34.035 EAL: No free 2048 kB hugepages reported on node 1 00:29:37.314 Initializing NVMe Controllers 00:29:37.314 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:37.314 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:37.314 Initialization complete. Launching workers. 00:29:37.314 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 31141, failed: 0 00:29:37.314 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2771, failed to submit 28370 00:29:37.314 success 550, unsuccess 2221, failed 0 00:29:37.314 11:53:56 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:29:37.314 11:53:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.314 11:53:56 -- common/autotest_common.sh@10 -- # set +x 00:29:37.314 11:53:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.314 11:53:56 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:29:37.314 11:53:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.314 11:53:56 -- common/autotest_common.sh@10 -- # set +x 00:29:38.248 11:53:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:38.248 11:53:58 -- target/abort_qd_sizes.sh@62 -- # killprocess 3951383 00:29:38.248 11:53:58 -- common/autotest_common.sh@936 -- # '[' -z 3951383 ']' 00:29:38.248 11:53:58 -- common/autotest_common.sh@940 -- # kill -0 3951383 00:29:38.248 11:53:58 -- common/autotest_common.sh@941 -- # uname 00:29:38.248 11:53:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:38.248 11:53:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3951383 00:29:38.248 11:53:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:38.248 11:53:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:38.248 11:53:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3951383' 00:29:38.248 killing process with pid 3951383 00:29:38.248 11:53:58 -- common/autotest_common.sh@955 -- # kill 3951383 00:29:38.248 11:53:58 -- common/autotest_common.sh@960 -- # wait 3951383 00:29:38.815 00:29:38.815 real 0m14.162s 00:29:38.815 user 0m55.966s 00:29:38.815 sys 0m2.557s 00:29:38.815 11:53:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:38.815 11:53:58 -- common/autotest_common.sh@10 -- # set +x 00:29:38.815 ************************************ 00:29:38.815 END TEST spdk_target_abort 00:29:38.815 ************************************ 00:29:38.815 11:53:58 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:29:38.815 11:53:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:38.815 11:53:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:38.815 11:53:58 -- common/autotest_common.sh@10 -- # set +x 00:29:38.815 ************************************ 00:29:38.815 START TEST kernel_target_abort 00:29:38.815 ************************************ 00:29:38.815 11:53:58 -- common/autotest_common.sh@1114 -- # kernel_target 00:29:38.815 11:53:58 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:29:38.815 11:53:58 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:29:38.815 11:53:58 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:29:38.815 11:53:58 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:29:38.815 11:53:58 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:29:38.815 11:53:58 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:38.815 11:53:58 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:29:38.815 11:53:58 -- nvmf/common.sh@627 -- # local block nvme 00:29:38.815 11:53:58 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:29:38.815 11:53:58 -- nvmf/common.sh@630 -- # modprobe nvmet 00:29:38.815 11:53:58 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:29:38.815 11:53:58 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:39.747 Waiting for block devices as requested 00:29:39.747 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:40.004 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:40.004 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:40.263 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:40.263 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:40.263 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:40.263 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:40.521 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:40.521 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:40.521 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:40.521 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:40.779 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:40.779 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:40.779 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:40.779 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:41.038 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:41.038 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:41.038 11:54:01 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:29:41.038 11:54:01 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:29:41.038 11:54:01 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:29:41.038 11:54:01 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:29:41.038 11:54:01 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:29:41.297 No valid GPT data, bailing 00:29:41.297 11:54:01 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:29:41.297 11:54:01 -- scripts/common.sh@393 -- # pt= 00:29:41.297 11:54:01 -- scripts/common.sh@394 -- # return 1 00:29:41.297 11:54:01 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:29:41.297 11:54:01 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:29:41.297 11:54:01 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:29:41.297 11:54:01 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:41.297 11:54:01 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:29:41.297 11:54:01 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:29:41.297 11:54:01 -- nvmf/common.sh@654 -- # echo 1 00:29:41.297 11:54:01 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:29:41.297 11:54:01 -- nvmf/common.sh@656 -- # echo 1 00:29:41.297 11:54:01 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:29:41.297 11:54:01 -- nvmf/common.sh@663 -- # echo tcp 00:29:41.297 11:54:01 -- nvmf/common.sh@664 -- # echo 4420 00:29:41.297 11:54:01 -- nvmf/common.sh@665 -- # echo ipv4 00:29:41.297 11:54:01 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:29:41.297 11:54:01 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:29:41.297 00:29:41.297 Discovery Log Number of Records 2, Generation counter 2 00:29:41.297 =====Discovery Log Entry 0====== 00:29:41.297 trtype: tcp 00:29:41.297 adrfam: ipv4 00:29:41.297 subtype: current discovery subsystem 00:29:41.297 treq: not specified, sq flow control disable supported 00:29:41.297 portid: 1 00:29:41.297 trsvcid: 4420 00:29:41.297 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:29:41.297 traddr: 10.0.0.1 00:29:41.297 eflags: none 00:29:41.297 sectype: none 00:29:41.297 =====Discovery Log Entry 1====== 00:29:41.297 trtype: tcp 00:29:41.297 adrfam: ipv4 00:29:41.297 subtype: nvme subsystem 00:29:41.297 treq: not specified, sq flow control disable supported 00:29:41.297 portid: 1 00:29:41.297 trsvcid: 4420 00:29:41.297 subnqn: kernel_target 00:29:41.297 traddr: 10.0.0.1 00:29:41.297 eflags: none 00:29:41.297 sectype: none 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:41.297 11:54:01 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:41.297 EAL: No free 2048 kB hugepages reported on node 1 00:29:44.575 Initializing NVMe Controllers 00:29:44.575 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:44.575 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:44.575 Initialization complete. Launching workers. 00:29:44.575 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 38066, failed: 0 00:29:44.575 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 38066, failed to submit 0 00:29:44.575 success 0, unsuccess 38066, failed 0 00:29:44.575 11:54:04 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:44.575 11:54:04 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:44.575 EAL: No free 2048 kB hugepages reported on node 1 00:29:47.879 Initializing NVMe Controllers 00:29:47.879 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:47.879 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:47.879 Initialization complete. Launching workers. 00:29:47.879 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 72631, failed: 0 00:29:47.879 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18330, failed to submit 54301 00:29:47.879 success 0, unsuccess 18330, failed 0 00:29:47.879 11:54:07 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:47.879 11:54:07 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:47.879 EAL: No free 2048 kB hugepages reported on node 1 00:29:51.195 Initializing NVMe Controllers 00:29:51.195 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:51.195 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:51.195 Initialization complete. Launching workers. 00:29:51.195 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 70545, failed: 0 00:29:51.195 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 17630, failed to submit 52915 00:29:51.195 success 0, unsuccess 17630, failed 0 00:29:51.195 11:54:10 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:29:51.196 11:54:10 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:29:51.196 11:54:10 -- nvmf/common.sh@677 -- # echo 0 00:29:51.196 11:54:10 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:29:51.196 11:54:10 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:51.196 11:54:10 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:29:51.196 11:54:10 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:29:51.196 11:54:10 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:29:51.196 11:54:10 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:29:51.196 00:29:51.196 real 0m12.005s 00:29:51.196 user 0m5.259s 00:29:51.196 sys 0m2.517s 00:29:51.196 11:54:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:51.196 11:54:10 -- common/autotest_common.sh@10 -- # set +x 00:29:51.196 ************************************ 00:29:51.196 END TEST kernel_target_abort 00:29:51.196 ************************************ 00:29:51.196 11:54:10 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:29:51.196 11:54:10 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:29:51.196 11:54:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:51.196 11:54:10 -- nvmf/common.sh@116 -- # sync 00:29:51.196 11:54:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:51.196 11:54:10 -- nvmf/common.sh@119 -- # set +e 00:29:51.196 11:54:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:51.196 11:54:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:51.196 rmmod nvme_tcp 00:29:51.196 rmmod nvme_fabrics 00:29:51.196 rmmod nvme_keyring 00:29:51.196 11:54:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:51.196 11:54:10 -- nvmf/common.sh@123 -- # set -e 00:29:51.196 11:54:10 -- nvmf/common.sh@124 -- # return 0 00:29:51.196 11:54:10 -- nvmf/common.sh@477 -- # '[' -n 3951383 ']' 00:29:51.196 11:54:10 -- nvmf/common.sh@478 -- # killprocess 3951383 00:29:51.196 11:54:10 -- common/autotest_common.sh@936 -- # '[' -z 3951383 ']' 00:29:51.196 11:54:10 -- common/autotest_common.sh@940 -- # kill -0 3951383 00:29:51.196 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3951383) - No such process 00:29:51.196 11:54:10 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3951383 is not found' 00:29:51.196 Process with pid 3951383 is not found 00:29:51.196 11:54:10 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:51.196 11:54:10 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:51.762 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:29:51.762 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:29:52.021 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:29:52.021 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:29:52.021 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:29:52.021 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:29:52.021 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:29:52.021 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:29:52.021 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:29:52.021 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:29:52.021 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:29:52.021 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:29:52.021 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:29:52.021 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:29:52.021 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:29:52.021 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:29:52.021 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:29:52.280 11:54:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:52.280 11:54:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:52.280 11:54:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:52.280 11:54:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:52.280 11:54:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:52.280 11:54:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:52.280 11:54:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:54.183 11:54:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:54.183 00:29:54.183 real 0m35.488s 00:29:54.183 user 1m3.614s 00:29:54.183 sys 0m8.503s 00:29:54.183 11:54:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:54.183 11:54:14 -- common/autotest_common.sh@10 -- # set +x 00:29:54.183 ************************************ 00:29:54.183 END TEST nvmf_abort_qd_sizes 00:29:54.183 ************************************ 00:29:54.183 11:54:14 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:29:54.183 11:54:14 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:29:54.183 11:54:14 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:29:54.183 11:54:14 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:29:54.183 11:54:14 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:29:54.183 11:54:14 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:29:54.183 11:54:14 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:29:54.183 11:54:14 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:29:54.183 11:54:14 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:29:54.183 11:54:14 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:29:54.183 11:54:14 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:29:54.183 11:54:14 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:29:54.183 11:54:14 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:29:54.183 11:54:14 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:29:54.183 11:54:14 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:29:54.183 11:54:14 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:29:54.183 11:54:14 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:29:54.183 11:54:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:54.183 11:54:14 -- common/autotest_common.sh@10 -- # set +x 00:29:54.183 11:54:14 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:29:54.183 11:54:14 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:29:54.183 11:54:14 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:29:54.183 11:54:14 -- common/autotest_common.sh@10 -- # set +x 00:29:56.088 INFO: APP EXITING 00:29:56.088 INFO: killing all VMs 00:29:56.088 INFO: killing vhost app 00:29:56.088 INFO: EXIT DONE 00:29:57.465 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:29:57.465 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:29:57.465 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:29:57.465 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:29:57.465 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:29:57.465 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:29:57.465 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:29:57.465 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:29:57.465 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:29:57.465 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:29:57.465 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:29:57.465 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:29:57.465 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:29:57.465 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:29:57.465 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:29:57.465 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:29:57.465 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:29:58.843 Cleaning 00:29:58.843 Removing: /var/run/dpdk/spdk0/config 00:29:58.843 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:29:58.843 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:29:58.843 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:29:58.843 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:29:58.843 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:29:58.844 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:29:58.844 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:29:58.844 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:29:58.844 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:29:58.844 Removing: /var/run/dpdk/spdk0/hugepage_info 00:29:58.844 Removing: /var/run/dpdk/spdk1/config 00:29:58.844 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:29:58.844 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:29:58.844 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:29:58.844 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:29:58.844 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:29:58.844 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:29:58.844 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:29:58.844 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:29:58.844 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:29:58.844 Removing: /var/run/dpdk/spdk1/hugepage_info 00:29:58.844 Removing: /var/run/dpdk/spdk1/mp_socket 00:29:58.844 Removing: /var/run/dpdk/spdk2/config 00:29:58.844 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:29:58.844 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:29:58.844 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:29:58.844 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:29:58.844 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:29:58.844 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:29:58.844 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:29:58.844 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:29:58.844 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:29:58.844 Removing: /var/run/dpdk/spdk2/hugepage_info 00:29:58.844 Removing: /var/run/dpdk/spdk3/config 00:29:58.844 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:29:58.844 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:29:58.844 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:29:58.844 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:29:58.844 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:29:58.844 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:29:58.844 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:29:58.844 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:29:58.844 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:29:58.844 Removing: /var/run/dpdk/spdk3/hugepage_info 00:29:58.844 Removing: /var/run/dpdk/spdk4/config 00:29:58.844 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:29:58.844 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:29:58.844 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:29:58.844 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:29:58.844 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:29:58.844 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:29:58.844 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:29:58.844 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:29:58.844 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:29:58.844 Removing: /var/run/dpdk/spdk4/hugepage_info 00:29:58.844 Removing: /dev/shm/bdev_svc_trace.1 00:29:58.844 Removing: /dev/shm/nvmf_trace.0 00:29:58.844 Removing: /dev/shm/spdk_tgt_trace.pid3681471 00:29:58.844 Removing: /var/run/dpdk/spdk0 00:29:58.844 Removing: /var/run/dpdk/spdk1 00:29:58.844 Removing: /var/run/dpdk/spdk2 00:29:58.844 Removing: /var/run/dpdk/spdk3 00:29:58.844 Removing: /var/run/dpdk/spdk4 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3679752 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3680539 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3681471 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3681970 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3683317 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3684268 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3684600 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3684925 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3685150 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3685476 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3685644 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3685811 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3686130 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3686591 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3689145 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3689446 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3689619 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3689759 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3690200 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3690339 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3690652 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3690788 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3690962 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3691100 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3691290 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3691410 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3691918 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3692074 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3692280 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3692581 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3692606 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3692794 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3692932 00:29:58.844 Removing: /var/run/dpdk/spdk_pid3693109 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3693363 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3693519 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3693663 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3693945 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3694091 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3694246 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3694509 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3694674 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3694818 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3695043 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3695245 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3695401 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3695545 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3695828 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3695967 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3696128 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3696389 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3696556 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3696694 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3696974 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3697121 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3697283 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3697540 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3697711 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3697854 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3698096 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3698275 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3698480 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3698714 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3698975 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3699120 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3699341 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3699867 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3700222 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3700406 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3700648 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3700787 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3701015 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3701144 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3701367 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3703710 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3761606 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3764277 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3771400 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3774870 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3777267 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3777697 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3782901 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3783184 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3785870 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3789780 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3792020 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3799279 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3804821 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3806051 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3806858 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3817508 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3819877 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3822728 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3823942 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3825312 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3825584 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3825736 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3825894 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3826606 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3827976 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3829114 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3829559 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3833689 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3837156 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3840798 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3865407 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3868372 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3872359 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3873458 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3874586 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3877291 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3879827 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3884226 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3884228 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3887177 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3887320 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3887579 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3887858 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3887866 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3888971 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3890186 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3891403 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3893104 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3894447 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3895734 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3899710 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3900149 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3901485 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3902242 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3906043 00:29:59.103 Removing: /var/run/dpdk/spdk_pid3908089 00:29:59.361 Removing: /var/run/dpdk/spdk_pid3911836 00:29:59.361 Removing: /var/run/dpdk/spdk_pid3915468 00:29:59.361 Removing: /var/run/dpdk/spdk_pid3919145 00:29:59.361 Removing: /var/run/dpdk/spdk_pid3919563 00:29:59.361 Removing: /var/run/dpdk/spdk_pid3919985 00:29:59.361 Removing: /var/run/dpdk/spdk_pid3920474 00:29:59.361 Removing: /var/run/dpdk/spdk_pid3920999 00:29:59.361 Removing: /var/run/dpdk/spdk_pid3921547 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3922224 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3923179 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3925950 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3926218 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3930084 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3930265 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3932048 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3937209 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3937214 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3940276 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3941723 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3943164 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3943937 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3945384 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3946275 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3951823 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3952226 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3952630 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3954183 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3954631 00:29:59.362 Removing: /var/run/dpdk/spdk_pid3955195 00:29:59.362 Clean 00:29:59.362 killing process with pid 3651330 00:30:07.544 killing process with pid 3651327 00:30:07.544 killing process with pid 3651329 00:30:07.544 killing process with pid 3651328 00:30:07.544 11:54:27 -- common/autotest_common.sh@1446 -- # return 0 00:30:07.544 11:54:27 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:07.544 11:54:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:07.544 11:54:27 -- common/autotest_common.sh@10 -- # set +x 00:30:07.544 11:54:27 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:07.544 11:54:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:07.544 11:54:27 -- common/autotest_common.sh@10 -- # set +x 00:30:07.544 11:54:27 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:07.545 11:54:27 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:07.545 11:54:27 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:07.545 11:54:27 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:07.545 11:54:27 -- spdk/autotest.sh@383 -- # hostname 00:30:07.545 11:54:27 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:07.803 geninfo: WARNING: invalid characters removed from testname! 00:30:34.355 11:54:53 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:37.655 11:54:57 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:40.196 11:54:59 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:42.735 11:55:02 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:45.271 11:55:04 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:47.807 11:55:07 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:50.350 11:55:10 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:30:50.350 11:55:10 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:30:50.350 11:55:10 -- common/autotest_common.sh@1690 -- $ lcov --version 00:30:50.350 11:55:10 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:30:50.350 11:55:10 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:30:50.350 11:55:10 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:30:50.350 11:55:10 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:30:50.350 11:55:10 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:30:50.350 11:55:10 -- scripts/common.sh@335 -- $ IFS=.-: 00:30:50.350 11:55:10 -- scripts/common.sh@335 -- $ read -ra ver1 00:30:50.350 11:55:10 -- scripts/common.sh@336 -- $ IFS=.-: 00:30:50.350 11:55:10 -- scripts/common.sh@336 -- $ read -ra ver2 00:30:50.350 11:55:10 -- scripts/common.sh@337 -- $ local 'op=<' 00:30:50.350 11:55:10 -- scripts/common.sh@339 -- $ ver1_l=2 00:30:50.350 11:55:10 -- scripts/common.sh@340 -- $ ver2_l=1 00:30:50.350 11:55:10 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:30:50.350 11:55:10 -- scripts/common.sh@343 -- $ case "$op" in 00:30:50.350 11:55:10 -- scripts/common.sh@344 -- $ : 1 00:30:50.350 11:55:10 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:30:50.350 11:55:10 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:50.350 11:55:10 -- scripts/common.sh@364 -- $ decimal 1 00:30:50.350 11:55:10 -- scripts/common.sh@352 -- $ local d=1 00:30:50.350 11:55:10 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:30:50.350 11:55:10 -- scripts/common.sh@354 -- $ echo 1 00:30:50.350 11:55:10 -- scripts/common.sh@364 -- $ ver1[v]=1 00:30:50.350 11:55:10 -- scripts/common.sh@365 -- $ decimal 2 00:30:50.350 11:55:10 -- scripts/common.sh@352 -- $ local d=2 00:30:50.350 11:55:10 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:30:50.350 11:55:10 -- scripts/common.sh@354 -- $ echo 2 00:30:50.350 11:55:10 -- scripts/common.sh@365 -- $ ver2[v]=2 00:30:50.350 11:55:10 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:30:50.350 11:55:10 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:30:50.350 11:55:10 -- scripts/common.sh@367 -- $ return 0 00:30:50.350 11:55:10 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:50.350 11:55:10 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:30:50.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:50.350 --rc genhtml_branch_coverage=1 00:30:50.350 --rc genhtml_function_coverage=1 00:30:50.350 --rc genhtml_legend=1 00:30:50.350 --rc geninfo_all_blocks=1 00:30:50.350 --rc geninfo_unexecuted_blocks=1 00:30:50.350 00:30:50.350 ' 00:30:50.350 11:55:10 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:30:50.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:50.350 --rc genhtml_branch_coverage=1 00:30:50.350 --rc genhtml_function_coverage=1 00:30:50.350 --rc genhtml_legend=1 00:30:50.350 --rc geninfo_all_blocks=1 00:30:50.350 --rc geninfo_unexecuted_blocks=1 00:30:50.350 00:30:50.350 ' 00:30:50.350 11:55:10 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:30:50.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:50.350 --rc genhtml_branch_coverage=1 00:30:50.350 --rc genhtml_function_coverage=1 00:30:50.350 --rc genhtml_legend=1 00:30:50.350 --rc geninfo_all_blocks=1 00:30:50.350 --rc geninfo_unexecuted_blocks=1 00:30:50.350 00:30:50.350 ' 00:30:50.350 11:55:10 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:30:50.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:50.350 --rc genhtml_branch_coverage=1 00:30:50.350 --rc genhtml_function_coverage=1 00:30:50.350 --rc genhtml_legend=1 00:30:50.350 --rc geninfo_all_blocks=1 00:30:50.350 --rc geninfo_unexecuted_blocks=1 00:30:50.350 00:30:50.350 ' 00:30:50.350 11:55:10 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:50.350 11:55:10 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:30:50.350 11:55:10 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:50.350 11:55:10 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:50.350 11:55:10 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:50.350 11:55:10 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:50.350 11:55:10 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:50.350 11:55:10 -- paths/export.sh@5 -- $ export PATH 00:30:50.350 11:55:10 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:50.350 11:55:10 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:30:50.350 11:55:10 -- common/autobuild_common.sh@440 -- $ date +%s 00:30:50.350 11:55:10 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732791310.XXXXXX 00:30:50.350 11:55:10 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732791310.zmD6NU 00:30:50.350 11:55:10 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:30:50.350 11:55:10 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:30:50.350 11:55:10 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:30:50.350 11:55:10 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:30:50.350 11:55:10 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:30:50.350 11:55:10 -- common/autobuild_common.sh@456 -- $ get_config_params 00:30:50.350 11:55:10 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:30:50.350 11:55:10 -- common/autotest_common.sh@10 -- $ set +x 00:30:50.350 11:55:10 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:30:50.350 11:55:10 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:30:50.351 11:55:10 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:50.351 11:55:10 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:30:50.351 11:55:10 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:30:50.351 11:55:10 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:30:50.351 11:55:10 -- spdk/autopackage.sh@19 -- $ timing_finish 00:30:50.351 11:55:10 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:30:50.351 11:55:10 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:30:50.351 11:55:10 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:50.351 11:55:10 -- spdk/autopackage.sh@20 -- $ exit 0 00:30:50.351 + [[ -n 3609010 ]] 00:30:50.351 + sudo kill 3609010 00:30:50.360 [Pipeline] } 00:30:50.376 [Pipeline] // stage 00:30:50.382 [Pipeline] } 00:30:50.398 [Pipeline] // timeout 00:30:50.404 [Pipeline] } 00:30:50.415 [Pipeline] // catchError 00:30:50.420 [Pipeline] } 00:30:50.434 [Pipeline] // wrap 00:30:50.440 [Pipeline] } 00:30:50.450 [Pipeline] // catchError 00:30:50.457 [Pipeline] stage 00:30:50.460 [Pipeline] { (Epilogue) 00:30:50.470 [Pipeline] catchError 00:30:50.474 [Pipeline] { 00:30:50.483 [Pipeline] echo 00:30:50.485 Cleanup processes 00:30:50.490 [Pipeline] sh 00:30:50.770 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:50.770 3967545 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:50.785 [Pipeline] sh 00:30:51.067 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:51.067 ++ grep -v 'sudo pgrep' 00:30:51.067 ++ awk '{print $1}' 00:30:51.067 + sudo kill -9 00:30:51.067 + true 00:30:51.078 [Pipeline] sh 00:30:51.355 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:03.570 [Pipeline] sh 00:31:03.921 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:03.921 Artifacts sizes are good 00:31:03.935 [Pipeline] archiveArtifacts 00:31:03.944 Archiving artifacts 00:31:04.108 [Pipeline] sh 00:31:04.394 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:04.411 [Pipeline] cleanWs 00:31:04.425 [WS-CLEANUP] Deleting project workspace... 00:31:04.426 [WS-CLEANUP] Deferred wipeout is used... 00:31:04.434 [WS-CLEANUP] done 00:31:04.435 [Pipeline] } 00:31:04.452 [Pipeline] // catchError 00:31:04.463 [Pipeline] sh 00:31:04.744 + logger -p user.info -t JENKINS-CI 00:31:04.752 [Pipeline] } 00:31:04.765 [Pipeline] // stage 00:31:04.770 [Pipeline] } 00:31:04.784 [Pipeline] // node 00:31:04.789 [Pipeline] End of Pipeline 00:31:04.825 Finished: SUCCESS